Aug 14 22:51:06 user nova-compute[72766]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 14 22:51:09 user nova-compute[72766]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=72766) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 14 22:51:09 user nova-compute[72766]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=72766) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 14 22:51:09 user nova-compute[72766]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=72766) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 14 22:51:09 user nova-compute[72766]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 14 22:51:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:51:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:51:09 user nova-compute[72766]: INFO nova.virt.driver [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 14 22:51:09 user nova-compute[72766]: INFO nova.compute.provider_config [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] Acquiring lock "singleton_lock" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] Acquired lock "singleton_lock" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] Releasing lock "singleton_lock" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] Full set of CONF: {{(pid=72766) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] ******************************************************************************** {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] Configuration options gathered from: {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] ================================================================================ {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] allow_resize_to_same_host      = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] arq_binding_timeout            = 300 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] backdoor_port                  = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] backdoor_socket                = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] block_device_allocate_retries  = 300 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] block_device_allocate_retries_interval = 5 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cert                           = self.pem {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] compute_monitors               = [] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] config_dir                     = [] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] config_drive_format            = iso9660 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] config_source                  = [] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] console_host                   = user {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] control_exchange               = nova {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cpu_allocation_ratio           = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] daemon                         = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] debug                          = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] default_access_ip_network_name = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] default_availability_zone      = nova {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] default_ephemeral_format       = ext4 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] default_schedule_zone          = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] disk_allocation_ratio          = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] enable_new_services            = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] enabled_apis                   = ['osapi_compute'] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] enabled_ssl_apis               = [] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] flat_injected                  = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] force_config_drive             = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] force_raw_images               = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] graceful_shutdown_timeout      = 5 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] heal_instance_info_cache_interval = 60 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] host                           = user {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] instance_build_timeout         = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] instance_delete_interval       = 300 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] instance_name_template         = instance-%08x {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] instance_usage_audit           = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] instance_usage_audit_period    = month {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] internal_service_availability_zone = internal {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] key                            = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] live_migration_retry_count     = 30 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] log_config_append              = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] log_dir                        = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] log_file                       = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] log_options                    = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] log_rotate_interval            = 1 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] log_rotate_interval_type       = days {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] log_rotation_type              = none {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] long_rpc_timeout               = 1800 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] max_concurrent_builds          = 10 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] max_concurrent_live_migrations = 1 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] max_concurrent_snapshots       = 5 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] max_local_block_devices        = 3 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] max_logfile_count              = 30 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] max_logfile_size_mb            = 200 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] maximum_instance_delete_attempts = 5 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] metadata_listen                = 0.0.0.0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] metadata_listen_port           = 8775 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] metadata_workers               = 3 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] migrate_max_retries            = -1 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] mkisofs_cmd                    = genisoimage {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] my_ip                          = 10.0.0.210 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] network_allocate_retries       = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] osapi_compute_listen_port      = 8774 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] osapi_compute_unique_server_name_scope =  {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] osapi_compute_workers          = 3 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] password_length                = 12 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] periodic_enable                = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] periodic_fuzzy_delay           = 60 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] pointer_model                  = ps2mouse {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] preallocate_images             = none {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] publish_errors                 = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] pybasedir                      = /opt/stack/nova {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] ram_allocation_ratio           = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] rate_limit_burst               = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] rate_limit_except_level        = CRITICAL {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] rate_limit_interval            = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] reboot_timeout                 = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] reclaim_instance_interval      = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] record                         = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] reimage_timeout_per_gb         = 60 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] report_interval                = 120 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] rescue_timeout                 = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] reserved_host_cpus             = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] reserved_host_disk_mb          = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] reserved_host_memory_mb        = 512 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] reserved_huge_pages            = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] resize_confirm_window          = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] resize_fs_using_block_device   = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] resume_guests_state_on_host_boot = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] rpc_response_timeout           = 60 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] run_external_periodic_tasks    = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] running_deleted_instance_action = reap {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] running_deleted_instance_poll_interval = 1800 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] running_deleted_instance_timeout = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] scheduler_instance_sync_interval = 120 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] service_down_time              = 720 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] servicegroup_driver            = db {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] shelved_offload_time           = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] shelved_poll_interval          = 3600 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] shutdown_timeout               = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] source_is_ipv6                 = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] ssl_only                       = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] state_path                     = /opt/stack/data/nova {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] sync_power_state_interval      = 600 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] sync_power_state_pool_size     = 1000 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] syslog_log_facility            = LOG_USER {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] tempdir                        = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] timeout_nbd                    = 10 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] transport_url                  = **** {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] update_resources_interval      = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] use_cow_images                 = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] use_eventlog                   = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] use_journal                    = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] use_json                       = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] use_rootwrap_daemon            = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] use_stderr                     = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] use_syslog                     = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vcpu_pin_set                   = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vif_plugging_is_fatal          = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vif_plugging_timeout           = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] virt_mkfs                      = [] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] volume_usage_poll_interval     = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] watch_log_file                 = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] web                            = /usr/share/spice-html5 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_concurrency.disable_process_locking = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] api.auth_strategy              = keystone {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] api.compute_link_prefix        = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] api.dhcp_domain                = novalocal {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] api.enable_instance_password   = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] api.glance_link_prefix         = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] api.instance_list_per_project_cells = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] api.list_records_by_skipping_down_cells = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] api.local_metadata_per_cell    = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] api.max_limit                  = 1000 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] api.metadata_cache_expiration  = 15 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] api.neutron_default_tenant_id  = default {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] api.use_forwarded_for          = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] api.use_neutron_default_nets   = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] api.vendordata_dynamic_targets = [] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] api.vendordata_jsonfile_path   = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cache.backend                  = dogpile.cache.memcached {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cache.backend_argument         = **** {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cache.config_prefix            = cache.oslo {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cache.dead_timeout             = 60.0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cache.debug_cache_backend      = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cache.enable_retry_client      = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cache.enable_socket_keepalive  = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cache.enabled                  = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cache.expiration_time          = 600 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cache.hashclient_retry_attempts = 2 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cache.memcache_dead_retry      = 300 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cache.memcache_password        =  {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cache.memcache_sasl_enabled    = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cache.memcache_username        =  {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cache.proxies                  = [] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cache.retry_attempts           = 2 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cache.retry_delay              = 0.0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cache.socket_keepalive_count   = 1 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cache.socket_keepalive_idle    = 1 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cache.socket_keepalive_interval = 1 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cache.tls_allowed_ciphers      = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cache.tls_cafile               = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cache.tls_certfile             = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cache.tls_enabled              = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cache.tls_keyfile              = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cinder.auth_section            = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cinder.auth_type               = password {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cinder.cafile                  = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cinder.certfile                = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cinder.collect_timing          = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cinder.cross_az_attach         = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cinder.debug                   = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cinder.endpoint_template       = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cinder.http_retries            = 3 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cinder.insecure                = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cinder.keyfile                 = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cinder.os_region_name          = RegionOne {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cinder.split_loggers           = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cinder.timeout                 = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] compute.cpu_dedicated_set      = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] compute.cpu_shared_set         = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] compute.image_type_exclude_list = [] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] compute.max_concurrent_disk_ops = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] compute.max_disk_devices_to_attach = -1 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] compute.resource_provider_association_refresh = 300 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] compute.shutdown_retry_interval = 10 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] conductor.workers              = 3 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] console.allowed_origins        = [] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] console.ssl_ciphers            = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] console.ssl_minimum_version    = default {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] consoleauth.token_ttl          = 600 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cyborg.cafile                  = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cyborg.certfile                = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cyborg.collect_timing          = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cyborg.connect_retries         = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cyborg.connect_retry_delay     = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cyborg.endpoint_override       = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cyborg.insecure                = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cyborg.keyfile                 = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cyborg.max_version             = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cyborg.min_version             = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cyborg.region_name             = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cyborg.service_name            = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cyborg.service_type            = accelerator {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cyborg.split_loggers           = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cyborg.status_code_retries     = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cyborg.status_code_retry_delay = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cyborg.timeout                 = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] cyborg.version                 = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] database.backend               = sqlalchemy {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] database.connection            = **** {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] database.connection_debug      = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] database.connection_parameters =  {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] database.connection_recycle_time = 3600 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] database.connection_trace      = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] database.db_inc_retry_interval = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] database.db_max_retries        = 20 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] database.db_max_retry_interval = 10 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] database.db_retry_interval     = 1 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] database.max_overflow          = 50 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] database.max_pool_size         = 5 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] database.max_retries           = 10 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] database.mysql_enable_ndb      = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] database.mysql_wsrep_sync_wait = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] database.pool_timeout          = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] database.retry_interval        = 10 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] database.slave_connection      = **** {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] database.sqlite_synchronous    = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] api_database.backend           = sqlalchemy {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] api_database.connection        = **** {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] api_database.connection_debug  = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] api_database.connection_parameters =  {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] api_database.connection_recycle_time = 3600 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] api_database.connection_trace  = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] api_database.db_inc_retry_interval = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] api_database.db_max_retries    = 20 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] api_database.db_max_retry_interval = 10 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] api_database.db_retry_interval = 1 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] api_database.max_overflow      = 50 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] api_database.max_pool_size     = 5 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] api_database.max_retries       = 10 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] api_database.mysql_enable_ndb  = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] api_database.pool_timeout      = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] api_database.retry_interval    = 10 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] api_database.slave_connection  = **** {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] api_database.sqlite_synchronous = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] devices.enabled_mdev_types     = [] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] ephemeral_storage_encryption.enabled = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] glance.api_servers             = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] glance.cafile                  = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] glance.certfile                = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] glance.collect_timing          = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] glance.connect_retries         = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] glance.connect_retry_delay     = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] glance.debug                   = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] glance.default_trusted_certificate_ids = [] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] glance.enable_certificate_validation = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] glance.enable_rbd_download     = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] glance.endpoint_override       = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] glance.insecure                = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] glance.keyfile                 = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] glance.max_version             = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] glance.min_version             = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] glance.num_retries             = 3 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] glance.rbd_ceph_conf           =  {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] glance.rbd_connect_timeout     = 5 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] glance.rbd_pool                =  {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] glance.rbd_user                =  {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] glance.region_name             = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] glance.service_name            = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] glance.service_type            = image {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] glance.split_loggers           = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] glance.status_code_retries     = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] glance.status_code_retry_delay = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] glance.timeout                 = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] glance.verify_glance_signatures = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] glance.version                 = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] guestfs.debug                  = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] hyperv.config_drive_cdrom      = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] hyperv.config_drive_inject_password = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] hyperv.enable_instance_metrics_collection = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] hyperv.enable_remotefx         = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] hyperv.instances_path_share    =  {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] hyperv.iscsi_initiator_list    = [] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] hyperv.limit_cpu_features      = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] hyperv.power_state_check_timeframe = 60 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] hyperv.use_multipath_io        = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] hyperv.volume_attach_retry_count = 10 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] hyperv.vswitch_name            = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] mks.enabled                    = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] image_cache.manager_interval   = 2400 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] image_cache.precache_concurrency = 1 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] image_cache.remove_unused_base_images = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] image_cache.subdirectory_name  = _base {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] ironic.api_max_retries         = 60 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] ironic.api_retry_interval      = 2 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] ironic.auth_section            = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] ironic.auth_type               = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] ironic.cafile                  = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] ironic.certfile                = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] ironic.collect_timing          = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] ironic.connect_retries         = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] ironic.connect_retry_delay     = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] ironic.endpoint_override       = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] ironic.insecure                = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] ironic.keyfile                 = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] ironic.max_version             = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] ironic.min_version             = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] ironic.partition_key           = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] ironic.peer_list               = [] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] ironic.region_name             = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] ironic.serial_console_state_timeout = 10 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] ironic.service_name            = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] ironic.service_type            = baremetal {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] ironic.split_loggers           = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] ironic.status_code_retries     = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] ironic.status_code_retry_delay = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] ironic.timeout                 = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] ironic.version                 = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] key_manager.fixed_key          = **** {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] barbican.barbican_api_version  = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] barbican.barbican_endpoint     = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] barbican.barbican_endpoint_type = public {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] barbican.barbican_region_name  = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] barbican.cafile                = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] barbican.certfile              = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] barbican.collect_timing        = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] barbican.insecure              = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] barbican.keyfile               = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] barbican.number_of_retries     = 60 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] barbican.retry_delay           = 1 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] barbican.send_service_user_token = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] barbican.split_loggers         = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] barbican.timeout               = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] barbican.verify_ssl            = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] barbican.verify_ssl_path       = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] barbican_service_user.auth_section = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] barbican_service_user.auth_type = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] barbican_service_user.cafile   = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] barbican_service_user.certfile = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] barbican_service_user.collect_timing = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] barbican_service_user.insecure = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] barbican_service_user.keyfile  = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] barbican_service_user.split_loggers = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] barbican_service_user.timeout  = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vault.approle_role_id          = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vault.approle_secret_id        = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vault.cafile                   = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vault.certfile                 = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vault.collect_timing           = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vault.insecure                 = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vault.keyfile                  = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vault.kv_mountpoint            = secret {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vault.kv_version               = 2 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vault.namespace                = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vault.root_token_id            = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vault.split_loggers            = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vault.ssl_ca_crt_file          = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vault.timeout                  = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vault.use_ssl                  = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] keystone.cafile                = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] keystone.certfile              = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] keystone.collect_timing        = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] keystone.connect_retries       = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] keystone.connect_retry_delay   = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] keystone.endpoint_override     = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] keystone.insecure              = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] keystone.keyfile               = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] keystone.max_version           = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] keystone.min_version           = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] keystone.region_name           = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] keystone.service_name          = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] keystone.service_type          = identity {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] keystone.split_loggers         = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] keystone.status_code_retries   = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] keystone.status_code_retry_delay = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] keystone.timeout               = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] keystone.version               = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.connection_uri         =  {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.cpu_mode               = custom {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: WARNING oslo_config.cfg [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.cpu_power_governor_high = performance {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.cpu_power_governor_low = powersave {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.cpu_power_management   = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.device_detach_attempts = 8 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.device_detach_timeout  = 20 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.disk_cachemodes        = [] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.disk_prefix            = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.enabled_perf_events    = [] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.file_backed_memory     = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.gid_maps               = [] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.hw_disk_discard        = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.hw_machine_type        = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.images_rbd_glance_store_name =  {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.images_rbd_pool        = rbd {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.images_type            = default {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.images_volume_group    = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.inject_key             = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.inject_partition       = -2 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.inject_password        = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.iscsi_iface            = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.iser_use_multipath     = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.live_migration_bandwidth = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.live_migration_downtime = 500 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.live_migration_inbound_addr = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.live_migration_permit_post_copy = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.live_migration_scheme  = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.live_migration_timeout_action = abort {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.live_migration_tunnelled = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: WARNING oslo_config.cfg [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 14 22:51:10 user nova-compute[72766]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 14 22:51:10 user nova-compute[72766]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 14 22:51:10 user nova-compute[72766]: and ``live_migration_inbound_addr`` respectively.
Aug 14 22:51:10 user nova-compute[72766]: ).  Its value may be silently ignored in the future.
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.live_migration_with_native_tls = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.max_queues             = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.nfs_mount_options      = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.num_memory_encrypted_guests = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.num_pcie_ports         = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.pmem_namespaces        = [] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.quobyte_client_cfg     = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.rbd_secret_uuid        = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.rbd_user               = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.remote_filesystem_transport = ssh {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.rescue_image_id        = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.rescue_kernel_id       = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.rescue_ramdisk_id      = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.rx_queue_size          = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.smbfs_mount_options    =  {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.snapshot_compression   = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.snapshot_image_format  = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.sparse_logical_volumes = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.swtpm_enabled          = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.swtpm_group            = tss {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.swtpm_user             = tss {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.sysinfo_serial         = unique {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.tb_cache_size          = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.tx_queue_size          = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.uid_maps               = [] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.use_virtio_for_bridges = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.virt_type              = kvm {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.volume_clear           = zero {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.volume_clear_size      = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.volume_use_multipath   = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.vzstorage_cache_path   = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.vzstorage_mount_user   = stack {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] neutron.auth_section           = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] neutron.auth_type              = password {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] neutron.cafile                 = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] neutron.certfile               = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] neutron.collect_timing         = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] neutron.connect_retries        = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] neutron.connect_retry_delay    = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] neutron.default_floating_pool  = public {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] neutron.endpoint_override      = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] neutron.extension_sync_interval = 600 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] neutron.http_retries           = 3 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] neutron.insecure               = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] neutron.keyfile                = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] neutron.max_version            = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] neutron.min_version            = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] neutron.ovs_bridge             = br-int {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] neutron.physnets               = [] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] neutron.region_name            = RegionOne {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] neutron.service_metadata_proxy = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] neutron.service_name           = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] neutron.service_type           = network {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] neutron.split_loggers          = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] neutron.status_code_retries    = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] neutron.status_code_retry_delay = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] neutron.timeout                = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] neutron.version                = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] notifications.bdms_in_notifications = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] notifications.default_level    = INFO {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] notifications.notification_format = unversioned {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] notifications.notify_on_state_change = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] pci.alias                      = [] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] pci.device_spec                = [] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] pci.report_in_placement        = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] placement.auth_section         = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] placement.auth_type            = password {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] placement.cafile               = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] placement.certfile             = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] placement.collect_timing       = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] placement.connect_retries      = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] placement.connect_retry_delay  = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] placement.default_domain_id    = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] placement.default_domain_name  = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] placement.domain_id            = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] placement.domain_name          = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] placement.endpoint_override    = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] placement.insecure             = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] placement.keyfile              = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] placement.max_version          = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] placement.min_version          = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] placement.password             = **** {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] placement.project_domain_id    = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] placement.project_domain_name  = Default {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] placement.project_id           = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] placement.project_name         = service {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] placement.region_name          = RegionOne {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] placement.service_name         = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] placement.service_type         = placement {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] placement.split_loggers        = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] placement.status_code_retries  = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] placement.status_code_retry_delay = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] placement.system_scope         = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] placement.timeout              = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] placement.trust_id             = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] placement.user_domain_id       = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] placement.user_domain_name     = Default {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] placement.user_id              = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] placement.username             = placement {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] placement.version              = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] quota.cores                    = 20 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] quota.count_usage_from_placement = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] quota.injected_file_content_bytes = 10240 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] quota.injected_file_path_length = 255 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] quota.injected_files           = 5 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] quota.instances                = 10 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] quota.key_pairs                = 100 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] quota.metadata_items           = 128 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] quota.ram                      = 51200 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] quota.recheck_quota            = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] quota.server_group_members     = 10 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] quota.server_groups            = 10 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] rdp.enabled                    = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] scheduler.image_metadata_prefilter = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] scheduler.max_attempts         = 3 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] scheduler.max_placement_results = 1000 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] scheduler.query_placement_for_availability_zone = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] scheduler.query_placement_for_image_type_support = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] scheduler.workers              = 3 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] filter_scheduler.host_subset_size = 1 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] filter_scheduler.isolated_hosts = [] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] filter_scheduler.isolated_images = [] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] filter_scheduler.pci_in_placement = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] filter_scheduler.track_instance_changes = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] metrics.required               = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] metrics.weight_multiplier      = 1.0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] metrics.weight_setting         = [] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] serial_console.enabled         = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] serial_console.port_range      = 10000:20000 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] serial_console.serialproxy_port = 6083 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] service_user.auth_section      = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] service_user.auth_type         = password {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] service_user.cafile            = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] service_user.certfile          = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] service_user.collect_timing    = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] service_user.insecure          = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] service_user.keyfile           = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] service_user.send_service_user_token = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] service_user.split_loggers     = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] service_user.timeout           = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] spice.agent_enabled            = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] spice.enabled                  = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] spice.html5proxy_port          = 6082 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] spice.image_compression        = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] spice.jpeg_compression         = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] spice.playback_compression     = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] spice.server_listen            = 127.0.0.1 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] spice.streaming_mode           = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] spice.zlib_compression         = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] upgrade_levels.baseapi         = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] upgrade_levels.cert            = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] upgrade_levels.compute         = auto {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] upgrade_levels.conductor       = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] upgrade_levels.scheduler       = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vendordata_dynamic_auth.auth_section = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vendordata_dynamic_auth.auth_type = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vendordata_dynamic_auth.cafile = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vendordata_dynamic_auth.certfile = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vendordata_dynamic_auth.insecure = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vendordata_dynamic_auth.keyfile = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vendordata_dynamic_auth.timeout = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vmware.api_retry_count         = 10 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vmware.ca_file                 = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vmware.cache_prefix            = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vmware.cluster_name            = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vmware.connection_pool_size    = 10 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vmware.console_delay_seconds   = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vmware.datastore_regex         = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vmware.host_ip                 = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vmware.host_password           = **** {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vmware.host_port               = 443 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vmware.host_username           = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vmware.insecure                = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vmware.integration_bridge      = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vmware.maximum_objects         = 100 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vmware.pbm_default_policy      = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vmware.pbm_enabled             = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vmware.pbm_wsdl_location       = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vmware.serial_port_proxy_uri   = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vmware.serial_port_service_uri = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vmware.task_poll_interval      = 0.5 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vmware.use_linked_clone        = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vmware.vnc_keymap              = en-us {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vmware.vnc_port                = 5900 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vmware.vnc_port_total          = 10000 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vnc.auth_schemes               = ['none'] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vnc.enabled                    = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vnc.novncproxy_port            = 6080 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vnc.server_listen              = 0.0.0.0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vnc.vencrypt_ca_certs          = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vnc.vencrypt_client_cert       = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vnc.vencrypt_client_key        = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] workarounds.disable_rootwrap   = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] workarounds.enable_numa_live_migration = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] workarounds.libvirt_disable_apic = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] wsgi.client_socket_timeout     = 900 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] wsgi.default_pool_size         = 1000 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] wsgi.keep_alive                = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] wsgi.max_header_line           = 16384 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] wsgi.ssl_ca_file               = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] wsgi.ssl_cert_file             = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] wsgi.ssl_key_file              = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] wsgi.tcp_keepidle              = 600 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] zvm.ca_file                    = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] zvm.cloud_connector_url        = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] zvm.reachable_timeout          = 300 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_policy.enforce_new_defaults = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_policy.enforce_scope      = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_policy.policy_default_rule = default {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] profiler.connection_string     = messaging:// {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] profiler.enabled               = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] profiler.es_doc_type           = notification {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] profiler.es_scroll_size        = 10000 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] profiler.es_scroll_time        = 2m {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] profiler.filter_error_trace    = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] profiler.hmac_keys             = **** {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] profiler.sentinel_service_name = mymaster {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] profiler.socket_timeout        = 0.1 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] profiler.trace_requests        = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] profiler.trace_sqlalchemy      = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] profiler_jaeger.process_tags   = {} {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] profiler_jaeger.service_name_prefix = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] profiler_otlp.service_name_prefix = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] remote_debug.host              = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] remote_debug.port              = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_messaging_notifications.retry = -1 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_limit.auth_section        = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_limit.auth_type           = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_limit.cafile              = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_limit.certfile            = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_limit.collect_timing      = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_limit.connect_retries     = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_limit.connect_retry_delay = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_limit.endpoint_id         = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_limit.endpoint_override   = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_limit.insecure            = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_limit.keyfile             = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_limit.max_version         = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_limit.min_version         = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_limit.region_name         = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_limit.service_name        = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_limit.service_type        = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_limit.split_loggers       = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_limit.status_code_retries = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_limit.status_code_retry_delay = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_limit.timeout             = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_limit.valid_interfaces    = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_limit.version             = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_reports.file_event_handler = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] oslo_reports.log_dir           = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vif_plug_ovs_privileged.group  = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] vif_plug_ovs_privileged.user   = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] os_vif_linux_bridge.flat_interface = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] os_vif_ovs.isolate_vif         = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] os_vif_ovs.per_port_bridge     = False {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] os_brick.lock_path             = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] privsep_osbrick.capabilities   = [21] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] privsep_osbrick.group          = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] privsep_osbrick.helper_command = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] privsep_osbrick.user           = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] nova_sys_admin.group           = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] nova_sys_admin.helper_command  = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] nova_sys_admin.user            = None {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG oslo_service.service [None req-5a371c2f-25ac-4924-950a-dc70d094b229 None None] ******************************************************************************** {{(pid=72766) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 14 22:51:10 user nova-compute[72766]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 14 22:51:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Starting native event thread {{(pid=72766) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Starting green dispatch thread {{(pid=72766) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Starting connection event dispatch thread {{(pid=72766) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Connecting to libvirt: qemu:///system {{(pid=72766) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7ff17511cd90> {{(pid=72766) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 14 22:51:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7ff17511cd90> {{(pid=72766) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 14 22:51:10 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Connection event '1' reason 'None'
Aug 14 22:51:10 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 14 22:51:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.mount [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Initialising _HostMountState generation 0 {{(pid=72766) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 14 22:51:17 user nova-compute[72766]: INFO nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Libvirt host capabilities <capabilities>
Aug 14 22:51:17 user nova-compute[72766]:   <host>
Aug 14 22:51:17 user nova-compute[72766]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 14 22:51:17 user nova-compute[72766]:     <cpu>
Aug 14 22:51:17 user nova-compute[72766]:       <arch>x86_64</arch>
Aug 14 22:51:17 user nova-compute[72766]:       <model>IvyBridge-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <vendor>Intel</vendor>
Aug 14 22:51:17 user nova-compute[72766]:       <microcode version='1070'/>
Aug 14 22:51:17 user nova-compute[72766]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 14 22:51:17 user nova-compute[72766]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature name='ss'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature name='vmx'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature name='pcid'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature name='osxsave'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature name='hypervisor'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature name='arat'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature name='tsc_adjust'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature name='md-clear'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature name='stibp'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature name='arch-capabilities'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature name='ssbd'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature name='invtsc'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature name='rsba'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature name='skip-l1dfl-vmentry'/>
Aug 14 22:51:17 user nova-compute[72766]:       <pages unit='KiB' size='4'/>
Aug 14 22:51:17 user nova-compute[72766]:       <pages unit='KiB' size='2048'/>
Aug 14 22:51:17 user nova-compute[72766]:     </cpu>
Aug 14 22:51:17 user nova-compute[72766]:     <power_management>
Aug 14 22:51:17 user nova-compute[72766]:       <suspend_mem/>
Aug 14 22:51:17 user nova-compute[72766]:       <suspend_disk/>
Aug 14 22:51:17 user nova-compute[72766]:       <suspend_hybrid/>
Aug 14 22:51:17 user nova-compute[72766]:     </power_management>
Aug 14 22:51:17 user nova-compute[72766]:     <iommu support='no'/>
Aug 14 22:51:17 user nova-compute[72766]:     <migration_features>
Aug 14 22:51:17 user nova-compute[72766]:       <live/>
Aug 14 22:51:17 user nova-compute[72766]:       <uri_transports>
Aug 14 22:51:17 user nova-compute[72766]:         <uri_transport>tcp</uri_transport>
Aug 14 22:51:17 user nova-compute[72766]:         <uri_transport>rdma</uri_transport>
Aug 14 22:51:17 user nova-compute[72766]:       </uri_transports>
Aug 14 22:51:17 user nova-compute[72766]:     </migration_features>
Aug 14 22:51:17 user nova-compute[72766]:     <topology>
Aug 14 22:51:17 user nova-compute[72766]:       <cells num='2'>
Aug 14 22:51:17 user nova-compute[72766]:         <cell id='0'>
Aug 14 22:51:17 user nova-compute[72766]:           <memory unit='KiB'>8189224</memory>
Aug 14 22:51:17 user nova-compute[72766]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 14 22:51:17 user nova-compute[72766]:           <pages unit='KiB' size='2048'>0</pages>
Aug 14 22:51:17 user nova-compute[72766]:           <distances>
Aug 14 22:51:17 user nova-compute[72766]:             <sibling id='0' value='10'/>
Aug 14 22:51:17 user nova-compute[72766]:             <sibling id='1' value='20'/>
Aug 14 22:51:17 user nova-compute[72766]:           </distances>
Aug 14 22:51:17 user nova-compute[72766]:           <cpus num='6'>
Aug 14 22:51:17 user nova-compute[72766]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 14 22:51:17 user nova-compute[72766]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 14 22:51:17 user nova-compute[72766]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 14 22:51:17 user nova-compute[72766]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 14 22:51:17 user nova-compute[72766]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 14 22:51:17 user nova-compute[72766]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 14 22:51:17 user nova-compute[72766]:           </cpus>
Aug 14 22:51:17 user nova-compute[72766]:         </cell>
Aug 14 22:51:17 user nova-compute[72766]:         <cell id='1'>
Aug 14 22:51:17 user nova-compute[72766]:           <memory unit='KiB'>8206460</memory>
Aug 14 22:51:17 user nova-compute[72766]:           <pages unit='KiB' size='4'>2051615</pages>
Aug 14 22:51:17 user nova-compute[72766]:           <pages unit='KiB' size='2048'>0</pages>
Aug 14 22:51:17 user nova-compute[72766]:           <distances>
Aug 14 22:51:17 user nova-compute[72766]:             <sibling id='0' value='20'/>
Aug 14 22:51:17 user nova-compute[72766]:             <sibling id='1' value='10'/>
Aug 14 22:51:17 user nova-compute[72766]:           </distances>
Aug 14 22:51:17 user nova-compute[72766]:           <cpus num='6'>
Aug 14 22:51:17 user nova-compute[72766]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 14 22:51:17 user nova-compute[72766]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 14 22:51:17 user nova-compute[72766]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 14 22:51:17 user nova-compute[72766]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 14 22:51:17 user nova-compute[72766]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 14 22:51:17 user nova-compute[72766]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 14 22:51:17 user nova-compute[72766]:           </cpus>
Aug 14 22:51:17 user nova-compute[72766]:         </cell>
Aug 14 22:51:17 user nova-compute[72766]:       </cells>
Aug 14 22:51:17 user nova-compute[72766]:     </topology>
Aug 14 22:51:17 user nova-compute[72766]:     <cache>
Aug 14 22:51:17 user nova-compute[72766]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 14 22:51:17 user nova-compute[72766]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 14 22:51:17 user nova-compute[72766]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 14 22:51:17 user nova-compute[72766]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 14 22:51:17 user nova-compute[72766]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 14 22:51:17 user nova-compute[72766]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 14 22:51:17 user nova-compute[72766]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 14 22:51:17 user nova-compute[72766]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 14 22:51:17 user nova-compute[72766]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 14 22:51:17 user nova-compute[72766]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 14 22:51:17 user nova-compute[72766]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 14 22:51:17 user nova-compute[72766]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 14 22:51:17 user nova-compute[72766]:     </cache>
Aug 14 22:51:17 user nova-compute[72766]:     <secmodel>
Aug 14 22:51:17 user nova-compute[72766]:       <model>apparmor</model>
Aug 14 22:51:17 user nova-compute[72766]:       <doi>0</doi>
Aug 14 22:51:17 user nova-compute[72766]:     </secmodel>
Aug 14 22:51:17 user nova-compute[72766]:     <secmodel>
Aug 14 22:51:17 user nova-compute[72766]:       <model>dac</model>
Aug 14 22:51:17 user nova-compute[72766]:       <doi>0</doi>
Aug 14 22:51:17 user nova-compute[72766]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 14 22:51:17 user nova-compute[72766]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 14 22:51:17 user nova-compute[72766]:     </secmodel>
Aug 14 22:51:17 user nova-compute[72766]:   </host>
Aug 14 22:51:17 user nova-compute[72766]:   <guest>
Aug 14 22:51:17 user nova-compute[72766]:     <os_type>hvm</os_type>
Aug 14 22:51:17 user nova-compute[72766]:     <arch name='alpha'>
Aug 14 22:51:17 user nova-compute[72766]:       <wordsize>64</wordsize>
Aug 14 22:51:17 user nova-compute[72766]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='4'>clipper</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <domain type='qemu'/>
Aug 14 22:51:17 user nova-compute[72766]:     </arch>
Aug 14 22:51:17 user nova-compute[72766]:     <features>
Aug 14 22:51:17 user nova-compute[72766]:       <cpuselection/>
Aug 14 22:51:17 user nova-compute[72766]:       <deviceboot/>
Aug 14 22:51:17 user nova-compute[72766]:       <disksnapshot default='on' toggle='no'/>
Aug 14 22:51:17 user nova-compute[72766]:     </features>
Aug 14 22:51:17 user nova-compute[72766]:   </guest>
Aug 14 22:51:17 user nova-compute[72766]:   <guest>
Aug 14 22:51:17 user nova-compute[72766]:     <os_type>hvm</os_type>
Aug 14 22:51:17 user nova-compute[72766]:     <arch name='armv6l'>
Aug 14 22:51:17 user nova-compute[72766]:       <wordsize>32</wordsize>
Aug 14 22:51:17 user nova-compute[72766]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>integratorcp</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>borzoi</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>spitz</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>nuri</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>musca-b1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>versatileab</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>kzm</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>musca-a</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>smdkc210</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>sx1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>z2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>tosa</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='4'>sabrelite</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>realview-eb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>n810</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>n800</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>versatilepb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>terrier</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>mainstone</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='4'>midway</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>musicpal</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>microbit</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>cubieboard</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>verdex</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>netduino2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='4'>raspi2b</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>cheetah</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='4'>highbank</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>akita</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>connex</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>collie</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>raspi0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <domain type='qemu'/>
Aug 14 22:51:17 user nova-compute[72766]:     </arch>
Aug 14 22:51:17 user nova-compute[72766]:     <features>
Aug 14 22:51:17 user nova-compute[72766]:       <cpuselection/>
Aug 14 22:51:17 user nova-compute[72766]:       <deviceboot/>
Aug 14 22:51:17 user nova-compute[72766]:       <disksnapshot default='on' toggle='no'/>
Aug 14 22:51:17 user nova-compute[72766]:     </features>
Aug 14 22:51:17 user nova-compute[72766]:   </guest>
Aug 14 22:51:17 user nova-compute[72766]:   <guest>
Aug 14 22:51:17 user nova-compute[72766]:     <os_type>hvm</os_type>
Aug 14 22:51:17 user nova-compute[72766]:     <arch name='armv7l'>
Aug 14 22:51:17 user nova-compute[72766]:       <wordsize>32</wordsize>
Aug 14 22:51:17 user nova-compute[72766]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>integratorcp</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>borzoi</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>spitz</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>nuri</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>musca-b1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>versatileab</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>kzm</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>musca-a</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>smdkc210</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>sx1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>z2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>tosa</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='4'>sabrelite</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>realview-eb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>n810</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>n800</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>versatilepb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>terrier</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>mainstone</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='4'>midway</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>musicpal</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>microbit</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>cubieboard</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>verdex</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>netduino2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='4'>raspi2b</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>cheetah</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='4'>highbank</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>akita</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>connex</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>collie</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>raspi0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <domain type='qemu'/>
Aug 14 22:51:17 user nova-compute[72766]:     </arch>
Aug 14 22:51:17 user nova-compute[72766]:     <features>
Aug 14 22:51:17 user nova-compute[72766]:       <cpuselection/>
Aug 14 22:51:17 user nova-compute[72766]:       <deviceboot/>
Aug 14 22:51:17 user nova-compute[72766]:       <disksnapshot default='on' toggle='no'/>
Aug 14 22:51:17 user nova-compute[72766]:     </features>
Aug 14 22:51:17 user nova-compute[72766]:   </guest>
Aug 14 22:51:17 user nova-compute[72766]:   <guest>
Aug 14 22:51:17 user nova-compute[72766]:     <os_type>hvm</os_type>
Aug 14 22:51:17 user nova-compute[72766]:     <arch name='aarch64'>
Aug 14 22:51:17 user nova-compute[72766]:       <wordsize>64</wordsize>
Aug 14 22:51:17 user nova-compute[72766]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>integratorcp</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>borzoi</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>spitz</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>nuri</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>musca-b1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>versatileab</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>kzm</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>musca-a</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>smdkc210</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>sx1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>z2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>tosa</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='4'>sabrelite</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>realview-eb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>n810</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>n800</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>versatilepb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>terrier</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>mainstone</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='4'>midway</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>musicpal</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>microbit</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>cubieboard</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>verdex</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>netduino2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='4'>raspi3b</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='4'>raspi2b</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>cheetah</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='4'>highbank</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>akita</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>connex</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>collie</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>raspi0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <domain type='qemu'/>
Aug 14 22:51:17 user nova-compute[72766]:     </arch>
Aug 14 22:51:17 user nova-compute[72766]:     <features>
Aug 14 22:51:17 user nova-compute[72766]:       <acpi default='on' toggle='yes'/>
Aug 14 22:51:17 user nova-compute[72766]:       <cpuselection/>
Aug 14 22:51:17 user nova-compute[72766]:       <deviceboot/>
Aug 14 22:51:17 user nova-compute[72766]:       <disksnapshot default='on' toggle='no'/>
Aug 14 22:51:17 user nova-compute[72766]:     </features>
Aug 14 22:51:17 user nova-compute[72766]:   </guest>
Aug 14 22:51:17 user nova-compute[72766]:   <guest>
Aug 14 22:51:17 user nova-compute[72766]:     <os_type>hvm</os_type>
Aug 14 22:51:17 user nova-compute[72766]:     <arch name='cris'>
Aug 14 22:51:17 user nova-compute[72766]:       <wordsize>32</wordsize>
Aug 14 22:51:17 user nova-compute[72766]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <domain type='qemu'/>
Aug 14 22:51:17 user nova-compute[72766]:     </arch>
Aug 14 22:51:17 user nova-compute[72766]:     <features>
Aug 14 22:51:17 user nova-compute[72766]:       <cpuselection/>
Aug 14 22:51:17 user nova-compute[72766]:       <deviceboot/>
Aug 14 22:51:17 user nova-compute[72766]:       <disksnapshot default='on' toggle='no'/>
Aug 14 22:51:17 user nova-compute[72766]:     </features>
Aug 14 22:51:17 user nova-compute[72766]:   </guest>
Aug 14 22:51:17 user nova-compute[72766]:   <guest>
Aug 14 22:51:17 user nova-compute[72766]:     <os_type>hvm</os_type>
Aug 14 22:51:17 user nova-compute[72766]:     <arch name='i686'>
Aug 14 22:51:17 user nova-compute[72766]:       <wordsize>32</wordsize>
Aug 14 22:51:17 user nova-compute[72766]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>x-remote</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>isapc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>microvm</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <domain type='qemu'/>
Aug 14 22:51:17 user nova-compute[72766]:       <domain type='kvm'/>
Aug 14 22:51:17 user nova-compute[72766]:     </arch>
Aug 14 22:51:17 user nova-compute[72766]:     <features>
Aug 14 22:51:17 user nova-compute[72766]:       <pae/>
Aug 14 22:51:17 user nova-compute[72766]:       <nonpae/>
Aug 14 22:51:17 user nova-compute[72766]:       <acpi default='on' toggle='yes'/>
Aug 14 22:51:17 user nova-compute[72766]:       <apic default='on' toggle='no'/>
Aug 14 22:51:17 user nova-compute[72766]:       <cpuselection/>
Aug 14 22:51:17 user nova-compute[72766]:       <deviceboot/>
Aug 14 22:51:17 user nova-compute[72766]:       <disksnapshot default='on' toggle='no'/>
Aug 14 22:51:17 user nova-compute[72766]:     </features>
Aug 14 22:51:17 user nova-compute[72766]:   </guest>
Aug 14 22:51:17 user nova-compute[72766]:   <guest>
Aug 14 22:51:17 user nova-compute[72766]:     <os_type>hvm</os_type>
Aug 14 22:51:17 user nova-compute[72766]:     <arch name='m68k'>
Aug 14 22:51:17 user nova-compute[72766]:       <wordsize>32</wordsize>
Aug 14 22:51:17 user nova-compute[72766]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>an5206</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>q800</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>next-cube</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <domain type='qemu'/>
Aug 14 22:51:17 user nova-compute[72766]:     </arch>
Aug 14 22:51:17 user nova-compute[72766]:     <features>
Aug 14 22:51:17 user nova-compute[72766]:       <cpuselection/>
Aug 14 22:51:17 user nova-compute[72766]:       <deviceboot/>
Aug 14 22:51:17 user nova-compute[72766]:       <disksnapshot default='on' toggle='no'/>
Aug 14 22:51:17 user nova-compute[72766]:     </features>
Aug 14 22:51:17 user nova-compute[72766]:   </guest>
Aug 14 22:51:17 user nova-compute[72766]:   <guest>
Aug 14 22:51:17 user nova-compute[72766]:     <os_type>hvm</os_type>
Aug 14 22:51:17 user nova-compute[72766]:     <arch name='microblaze'>
Aug 14 22:51:17 user nova-compute[72766]:       <wordsize>32</wordsize>
Aug 14 22:51:17 user nova-compute[72766]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <domain type='qemu'/>
Aug 14 22:51:17 user nova-compute[72766]:     </arch>
Aug 14 22:51:17 user nova-compute[72766]:     <features>
Aug 14 22:51:17 user nova-compute[72766]:       <cpuselection/>
Aug 14 22:51:17 user nova-compute[72766]:       <deviceboot/>
Aug 14 22:51:17 user nova-compute[72766]:       <disksnapshot default='on' toggle='no'/>
Aug 14 22:51:17 user nova-compute[72766]:     </features>
Aug 14 22:51:17 user nova-compute[72766]:   </guest>
Aug 14 22:51:17 user nova-compute[72766]:   <guest>
Aug 14 22:51:17 user nova-compute[72766]:     <os_type>hvm</os_type>
Aug 14 22:51:17 user nova-compute[72766]:     <arch name='microblazeel'>
Aug 14 22:51:17 user nova-compute[72766]:       <wordsize>32</wordsize>
Aug 14 22:51:17 user nova-compute[72766]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <domain type='qemu'/>
Aug 14 22:51:17 user nova-compute[72766]:     </arch>
Aug 14 22:51:17 user nova-compute[72766]:     <features>
Aug 14 22:51:17 user nova-compute[72766]:       <cpuselection/>
Aug 14 22:51:17 user nova-compute[72766]:       <deviceboot/>
Aug 14 22:51:17 user nova-compute[72766]:       <disksnapshot default='on' toggle='no'/>
Aug 14 22:51:17 user nova-compute[72766]:     </features>
Aug 14 22:51:17 user nova-compute[72766]:   </guest>
Aug 14 22:51:17 user nova-compute[72766]:   <guest>
Aug 14 22:51:17 user nova-compute[72766]:     <os_type>hvm</os_type>
Aug 14 22:51:17 user nova-compute[72766]:     <arch name='mips'>
Aug 14 22:51:17 user nova-compute[72766]:       <wordsize>32</wordsize>
Aug 14 22:51:17 user nova-compute[72766]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='16'>malta</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>mipssim</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <domain type='qemu'/>
Aug 14 22:51:17 user nova-compute[72766]:     </arch>
Aug 14 22:51:17 user nova-compute[72766]:     <features>
Aug 14 22:51:17 user nova-compute[72766]:       <cpuselection/>
Aug 14 22:51:17 user nova-compute[72766]:       <deviceboot/>
Aug 14 22:51:17 user nova-compute[72766]:       <disksnapshot default='on' toggle='no'/>
Aug 14 22:51:17 user nova-compute[72766]:     </features>
Aug 14 22:51:17 user nova-compute[72766]:   </guest>
Aug 14 22:51:17 user nova-compute[72766]:   <guest>
Aug 14 22:51:17 user nova-compute[72766]:     <os_type>hvm</os_type>
Aug 14 22:51:17 user nova-compute[72766]:     <arch name='mipsel'>
Aug 14 22:51:17 user nova-compute[72766]:       <wordsize>32</wordsize>
Aug 14 22:51:17 user nova-compute[72766]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='16'>malta</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>mipssim</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <domain type='qemu'/>
Aug 14 22:51:17 user nova-compute[72766]:     </arch>
Aug 14 22:51:17 user nova-compute[72766]:     <features>
Aug 14 22:51:17 user nova-compute[72766]:       <cpuselection/>
Aug 14 22:51:17 user nova-compute[72766]:       <deviceboot/>
Aug 14 22:51:17 user nova-compute[72766]:       <disksnapshot default='on' toggle='no'/>
Aug 14 22:51:17 user nova-compute[72766]:     </features>
Aug 14 22:51:17 user nova-compute[72766]:   </guest>
Aug 14 22:51:17 user nova-compute[72766]:   <guest>
Aug 14 22:51:17 user nova-compute[72766]:     <os_type>hvm</os_type>
Aug 14 22:51:17 user nova-compute[72766]:     <arch name='mips64'>
Aug 14 22:51:17 user nova-compute[72766]:       <wordsize>64</wordsize>
Aug 14 22:51:17 user nova-compute[72766]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='16'>malta</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>mipssim</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>pica61</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>magnum</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <domain type='qemu'/>
Aug 14 22:51:17 user nova-compute[72766]:     </arch>
Aug 14 22:51:17 user nova-compute[72766]:     <features>
Aug 14 22:51:17 user nova-compute[72766]:       <cpuselection/>
Aug 14 22:51:17 user nova-compute[72766]:       <deviceboot/>
Aug 14 22:51:17 user nova-compute[72766]:       <disksnapshot default='on' toggle='no'/>
Aug 14 22:51:17 user nova-compute[72766]:     </features>
Aug 14 22:51:17 user nova-compute[72766]:   </guest>
Aug 14 22:51:17 user nova-compute[72766]:   <guest>
Aug 14 22:51:17 user nova-compute[72766]:     <os_type>hvm</os_type>
Aug 14 22:51:17 user nova-compute[72766]:     <arch name='mips64el'>
Aug 14 22:51:17 user nova-compute[72766]:       <wordsize>64</wordsize>
Aug 14 22:51:17 user nova-compute[72766]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='16'>malta</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>mipssim</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>pica61</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>magnum</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='16'>boston</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <domain type='qemu'/>
Aug 14 22:51:17 user nova-compute[72766]:     </arch>
Aug 14 22:51:17 user nova-compute[72766]:     <features>
Aug 14 22:51:17 user nova-compute[72766]:       <cpuselection/>
Aug 14 22:51:17 user nova-compute[72766]:       <deviceboot/>
Aug 14 22:51:17 user nova-compute[72766]:       <disksnapshot default='on' toggle='no'/>
Aug 14 22:51:17 user nova-compute[72766]:     </features>
Aug 14 22:51:17 user nova-compute[72766]:   </guest>
Aug 14 22:51:17 user nova-compute[72766]:   <guest>
Aug 14 22:51:17 user nova-compute[72766]:     <os_type>hvm</os_type>
Aug 14 22:51:17 user nova-compute[72766]:     <arch name='ppc'>
Aug 14 22:51:17 user nova-compute[72766]:       <wordsize>32</wordsize>
Aug 14 22:51:17 user nova-compute[72766]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>g3beige</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>mac99</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='32'>ppce500</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>pegasos2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>sam460ex</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>bamboo</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>40p</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>ref405ep</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>taihu</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <domain type='qemu'/>
Aug 14 22:51:17 user nova-compute[72766]:     </arch>
Aug 14 22:51:17 user nova-compute[72766]:     <features>
Aug 14 22:51:17 user nova-compute[72766]:       <cpuselection/>
Aug 14 22:51:17 user nova-compute[72766]:       <deviceboot/>
Aug 14 22:51:17 user nova-compute[72766]:       <disksnapshot default='on' toggle='no'/>
Aug 14 22:51:17 user nova-compute[72766]:     </features>
Aug 14 22:51:17 user nova-compute[72766]:   </guest>
Aug 14 22:51:17 user nova-compute[72766]:   <guest>
Aug 14 22:51:17 user nova-compute[72766]:     <os_type>hvm</os_type>
Aug 14 22:51:17 user nova-compute[72766]:     <arch name='ppc64'>
Aug 14 22:51:17 user nova-compute[72766]:       <wordsize>64</wordsize>
Aug 14 22:51:17 user nova-compute[72766]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2048'>powernv9</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>taihu</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2048'>powernv10</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='32'>ppce500</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>40p</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>pegasos2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>bamboo</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>g3beige</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>mac99</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>sam460ex</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>ref405ep</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2048'>powernv8</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <domain type='qemu'/>
Aug 14 22:51:17 user nova-compute[72766]:     </arch>
Aug 14 22:51:17 user nova-compute[72766]:     <features>
Aug 14 22:51:17 user nova-compute[72766]:       <cpuselection/>
Aug 14 22:51:17 user nova-compute[72766]:       <deviceboot/>
Aug 14 22:51:17 user nova-compute[72766]:       <disksnapshot default='on' toggle='no'/>
Aug 14 22:51:17 user nova-compute[72766]:     </features>
Aug 14 22:51:17 user nova-compute[72766]:   </guest>
Aug 14 22:51:17 user nova-compute[72766]:   <guest>
Aug 14 22:51:17 user nova-compute[72766]:     <os_type>hvm</os_type>
Aug 14 22:51:17 user nova-compute[72766]:     <arch name='ppc64le'>
Aug 14 22:51:17 user nova-compute[72766]:       <wordsize>64</wordsize>
Aug 14 22:51:17 user nova-compute[72766]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2048'>powernv9</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>taihu</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2048'>powernv10</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='32'>ppce500</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>40p</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>pegasos2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>bamboo</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>g3beige</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>mac99</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>sam460ex</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>ref405ep</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2048'>powernv8</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <domain type='qemu'/>
Aug 14 22:51:17 user nova-compute[72766]:     </arch>
Aug 14 22:51:17 user nova-compute[72766]:     <features>
Aug 14 22:51:17 user nova-compute[72766]:       <cpuselection/>
Aug 14 22:51:17 user nova-compute[72766]:       <deviceboot/>
Aug 14 22:51:17 user nova-compute[72766]:       <disksnapshot default='on' toggle='no'/>
Aug 14 22:51:17 user nova-compute[72766]:     </features>
Aug 14 22:51:17 user nova-compute[72766]:   </guest>
Aug 14 22:51:17 user nova-compute[72766]:   <guest>
Aug 14 22:51:17 user nova-compute[72766]:     <os_type>hvm</os_type>
Aug 14 22:51:17 user nova-compute[72766]:     <arch name='riscv32'>
Aug 14 22:51:17 user nova-compute[72766]:       <wordsize>32</wordsize>
Aug 14 22:51:17 user nova-compute[72766]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='8'>spike</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>opentitan</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='5'>sifive_u</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>sifive_e</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='8'>virt</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <domain type='qemu'/>
Aug 14 22:51:17 user nova-compute[72766]:     </arch>
Aug 14 22:51:17 user nova-compute[72766]:     <features>
Aug 14 22:51:17 user nova-compute[72766]:       <cpuselection/>
Aug 14 22:51:17 user nova-compute[72766]:       <deviceboot/>
Aug 14 22:51:17 user nova-compute[72766]:       <disksnapshot default='on' toggle='no'/>
Aug 14 22:51:17 user nova-compute[72766]:     </features>
Aug 14 22:51:17 user nova-compute[72766]:   </guest>
Aug 14 22:51:17 user nova-compute[72766]:   <guest>
Aug 14 22:51:17 user nova-compute[72766]:     <os_type>hvm</os_type>
Aug 14 22:51:17 user nova-compute[72766]:     <arch name='riscv64'>
Aug 14 22:51:17 user nova-compute[72766]:       <wordsize>64</wordsize>
Aug 14 22:51:17 user nova-compute[72766]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='8'>spike</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='5'>sifive_u</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>shakti_c</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>sifive_e</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='8'>virt</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <domain type='qemu'/>
Aug 14 22:51:17 user nova-compute[72766]:     </arch>
Aug 14 22:51:17 user nova-compute[72766]:     <features>
Aug 14 22:51:17 user nova-compute[72766]:       <cpuselection/>
Aug 14 22:51:17 user nova-compute[72766]:       <deviceboot/>
Aug 14 22:51:17 user nova-compute[72766]:       <disksnapshot default='on' toggle='no'/>
Aug 14 22:51:17 user nova-compute[72766]:     </features>
Aug 14 22:51:17 user nova-compute[72766]:   </guest>
Aug 14 22:51:17 user nova-compute[72766]:   <guest>
Aug 14 22:51:17 user nova-compute[72766]:     <os_type>hvm</os_type>
Aug 14 22:51:17 user nova-compute[72766]:     <arch name='s390x'>
Aug 14 22:51:17 user nova-compute[72766]:       <wordsize>64</wordsize>
Aug 14 22:51:17 user nova-compute[72766]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <domain type='qemu'/>
Aug 14 22:51:17 user nova-compute[72766]:     </arch>
Aug 14 22:51:17 user nova-compute[72766]:     <features>
Aug 14 22:51:17 user nova-compute[72766]:       <cpuselection/>
Aug 14 22:51:17 user nova-compute[72766]:       <deviceboot/>
Aug 14 22:51:17 user nova-compute[72766]:       <disksnapshot default='on' toggle='no'/>
Aug 14 22:51:17 user nova-compute[72766]:     </features>
Aug 14 22:51:17 user nova-compute[72766]:   </guest>
Aug 14 22:51:17 user nova-compute[72766]:   <guest>
Aug 14 22:51:17 user nova-compute[72766]:     <os_type>hvm</os_type>
Aug 14 22:51:17 user nova-compute[72766]:     <arch name='sh4'>
Aug 14 22:51:17 user nova-compute[72766]:       <wordsize>32</wordsize>
Aug 14 22:51:17 user nova-compute[72766]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>shix</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>r2d</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <domain type='qemu'/>
Aug 14 22:51:17 user nova-compute[72766]:     </arch>
Aug 14 22:51:17 user nova-compute[72766]:     <features>
Aug 14 22:51:17 user nova-compute[72766]:       <cpuselection/>
Aug 14 22:51:17 user nova-compute[72766]:       <deviceboot/>
Aug 14 22:51:17 user nova-compute[72766]:       <disksnapshot default='on' toggle='no'/>
Aug 14 22:51:17 user nova-compute[72766]:     </features>
Aug 14 22:51:17 user nova-compute[72766]:   </guest>
Aug 14 22:51:17 user nova-compute[72766]:   <guest>
Aug 14 22:51:17 user nova-compute[72766]:     <os_type>hvm</os_type>
Aug 14 22:51:17 user nova-compute[72766]:     <arch name='sh4eb'>
Aug 14 22:51:17 user nova-compute[72766]:       <wordsize>64</wordsize>
Aug 14 22:51:17 user nova-compute[72766]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>shix</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>r2d</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <domain type='qemu'/>
Aug 14 22:51:17 user nova-compute[72766]:     </arch>
Aug 14 22:51:17 user nova-compute[72766]:     <features>
Aug 14 22:51:17 user nova-compute[72766]:       <cpuselection/>
Aug 14 22:51:17 user nova-compute[72766]:       <deviceboot/>
Aug 14 22:51:17 user nova-compute[72766]:       <disksnapshot default='on' toggle='no'/>
Aug 14 22:51:17 user nova-compute[72766]:     </features>
Aug 14 22:51:17 user nova-compute[72766]:   </guest>
Aug 14 22:51:17 user nova-compute[72766]:   <guest>
Aug 14 22:51:17 user nova-compute[72766]:     <os_type>hvm</os_type>
Aug 14 22:51:17 user nova-compute[72766]:     <arch name='sparc'>
Aug 14 22:51:17 user nova-compute[72766]:       <wordsize>32</wordsize>
Aug 14 22:51:17 user nova-compute[72766]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>SS-5</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='4'>SS-20</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>LX</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>SS-4</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='4'>SS-10</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>Voyager</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <domain type='qemu'/>
Aug 14 22:51:17 user nova-compute[72766]:     </arch>
Aug 14 22:51:17 user nova-compute[72766]:     <features>
Aug 14 22:51:17 user nova-compute[72766]:       <cpuselection/>
Aug 14 22:51:17 user nova-compute[72766]:       <deviceboot/>
Aug 14 22:51:17 user nova-compute[72766]:       <disksnapshot default='on' toggle='no'/>
Aug 14 22:51:17 user nova-compute[72766]:     </features>
Aug 14 22:51:17 user nova-compute[72766]:   </guest>
Aug 14 22:51:17 user nova-compute[72766]:   <guest>
Aug 14 22:51:17 user nova-compute[72766]:     <os_type>hvm</os_type>
Aug 14 22:51:17 user nova-compute[72766]:     <arch name='sparc64'>
Aug 14 22:51:17 user nova-compute[72766]:       <wordsize>64</wordsize>
Aug 14 22:51:17 user nova-compute[72766]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>sun4u</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>niagara</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>sun4v</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <domain type='qemu'/>
Aug 14 22:51:17 user nova-compute[72766]:     </arch>
Aug 14 22:51:17 user nova-compute[72766]:     <features>
Aug 14 22:51:17 user nova-compute[72766]:       <cpuselection/>
Aug 14 22:51:17 user nova-compute[72766]:       <deviceboot/>
Aug 14 22:51:17 user nova-compute[72766]:       <disksnapshot default='on' toggle='no'/>
Aug 14 22:51:17 user nova-compute[72766]:     </features>
Aug 14 22:51:17 user nova-compute[72766]:   </guest>
Aug 14 22:51:17 user nova-compute[72766]:   <guest>
Aug 14 22:51:17 user nova-compute[72766]:     <os_type>hvm</os_type>
Aug 14 22:51:17 user nova-compute[72766]:     <arch name='x86_64'>
Aug 14 22:51:17 user nova-compute[72766]:       <wordsize>64</wordsize>
Aug 14 22:51:17 user nova-compute[72766]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>x-remote</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='1'>isapc</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>microvm</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <domain type='qemu'/>
Aug 14 22:51:17 user nova-compute[72766]:       <domain type='kvm'/>
Aug 14 22:51:17 user nova-compute[72766]:     </arch>
Aug 14 22:51:17 user nova-compute[72766]:     <features>
Aug 14 22:51:17 user nova-compute[72766]:       <acpi default='on' toggle='yes'/>
Aug 14 22:51:17 user nova-compute[72766]:       <apic default='on' toggle='no'/>
Aug 14 22:51:17 user nova-compute[72766]:       <cpuselection/>
Aug 14 22:51:17 user nova-compute[72766]:       <deviceboot/>
Aug 14 22:51:17 user nova-compute[72766]:       <disksnapshot default='on' toggle='no'/>
Aug 14 22:51:17 user nova-compute[72766]:     </features>
Aug 14 22:51:17 user nova-compute[72766]:   </guest>
Aug 14 22:51:17 user nova-compute[72766]:   <guest>
Aug 14 22:51:17 user nova-compute[72766]:     <os_type>hvm</os_type>
Aug 14 22:51:17 user nova-compute[72766]:     <arch name='xtensa'>
Aug 14 22:51:17 user nova-compute[72766]:       <wordsize>32</wordsize>
Aug 14 22:51:17 user nova-compute[72766]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='4'>sim</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='32'>kc705</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='32'>ml605</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='32'>virt</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='32'>lx200</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='32'>lx60</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <domain type='qemu'/>
Aug 14 22:51:17 user nova-compute[72766]:     </arch>
Aug 14 22:51:17 user nova-compute[72766]:     <features>
Aug 14 22:51:17 user nova-compute[72766]:       <cpuselection/>
Aug 14 22:51:17 user nova-compute[72766]:       <deviceboot/>
Aug 14 22:51:17 user nova-compute[72766]:       <disksnapshot default='on' toggle='no'/>
Aug 14 22:51:17 user nova-compute[72766]:     </features>
Aug 14 22:51:17 user nova-compute[72766]:   </guest>
Aug 14 22:51:17 user nova-compute[72766]:   <guest>
Aug 14 22:51:17 user nova-compute[72766]:     <os_type>hvm</os_type>
Aug 14 22:51:17 user nova-compute[72766]:     <arch name='xtensaeb'>
Aug 14 22:51:17 user nova-compute[72766]:       <wordsize>32</wordsize>
Aug 14 22:51:17 user nova-compute[72766]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='4'>sim</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='32'>kc705</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='32'>ml605</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='32'>virt</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='32'>lx200</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='32'>lx60</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 14 22:51:17 user nova-compute[72766]:       <domain type='qemu'/>
Aug 14 22:51:17 user nova-compute[72766]:     </arch>
Aug 14 22:51:17 user nova-compute[72766]:     <features>
Aug 14 22:51:17 user nova-compute[72766]:       <cpuselection/>
Aug 14 22:51:17 user nova-compute[72766]:       <deviceboot/>
Aug 14 22:51:17 user nova-compute[72766]:       <disksnapshot default='on' toggle='no'/>
Aug 14 22:51:17 user nova-compute[72766]:     </features>
Aug 14 22:51:17 user nova-compute[72766]:   </guest>
Aug 14 22:51:17 user nova-compute[72766]: </capabilities>
Aug 14 22:51:17 user nova-compute[72766]: 
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=72766) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=72766) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=72766) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72766) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72766) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=72766) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72766) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=72766) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=72766) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=72766) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=72766) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu-q35', 'q35', 'ubuntu'} {{(pid=72766) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 14 22:51:17 user nova-compute[72766]: <domainCapabilities>
Aug 14 22:51:17 user nova-compute[72766]:   <path>/usr/bin/qemu-system-i386</path>
Aug 14 22:51:17 user nova-compute[72766]:   <domain>kvm</domain>
Aug 14 22:51:17 user nova-compute[72766]:   <machine>pc-i440fx-6.2</machine>
Aug 14 22:51:17 user nova-compute[72766]:   <arch>i686</arch>
Aug 14 22:51:17 user nova-compute[72766]:   <vcpu max='255'/>
Aug 14 22:51:17 user nova-compute[72766]:   <iothreads supported='yes'/>
Aug 14 22:51:17 user nova-compute[72766]:   <os supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:     <enum name='firmware'/>
Aug 14 22:51:17 user nova-compute[72766]:     <loader supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 14 22:51:17 user nova-compute[72766]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 14 22:51:17 user nova-compute[72766]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 14 22:51:17 user nova-compute[72766]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 14 22:51:17 user nova-compute[72766]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='type'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>rom</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>pflash</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='readonly'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>yes</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>no</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='secure'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>no</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </loader>
Aug 14 22:51:17 user nova-compute[72766]:   </os>
Aug 14 22:51:17 user nova-compute[72766]:   <cpu>
Aug 14 22:51:17 user nova-compute[72766]:     <mode name='host-passthrough' supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='hostPassthroughMigratable'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>off</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </mode>
Aug 14 22:51:17 user nova-compute[72766]:     <mode name='maximum' supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='maximumMigratable'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>on</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>off</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </mode>
Aug 14 22:51:17 user nova-compute[72766]:     <mode name='host-model' supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <vendor>Intel</vendor>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='ss'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='vmx'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='pcid'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='hypervisor'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='arat'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='umip'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='md-clear'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='stibp'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='ssbd'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='ibpb'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='ibrs'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='amd-stibp'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='disable' name='erms'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='disable' name='lm'/>
Aug 14 22:51:17 user nova-compute[72766]:     </mode>
Aug 14 22:51:17 user nova-compute[72766]:     <mode name='custom' supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>qemu64</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>qemu32</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>phenom</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>pentium3</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>pentium2</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>pentium</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>n270</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>kvm64</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>kvm32</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>coreduo</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>core2duo</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>athlon</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Westmere-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Westmere</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Snowridge</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Server</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Client</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>SandyBridge</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Penryn</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Opteron_G5</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Opteron_G4</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Opteron_G3</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Opteron_G2</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Opteron_G1</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Nehalem-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Nehalem</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>IvyBridge</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Icelake-Server</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Haswell</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>EPYC-Rome</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>EPYC-Milan</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>EPYC</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Dhyana</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Cooperlake</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Conroe</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Broadwell</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>486</model>
Aug 14 22:51:17 user nova-compute[72766]:     </mode>
Aug 14 22:51:17 user nova-compute[72766]:   </cpu>
Aug 14 22:51:17 user nova-compute[72766]:   <memoryBacking supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:     <enum name='sourceType'>
Aug 14 22:51:17 user nova-compute[72766]:       <value>file</value>
Aug 14 22:51:17 user nova-compute[72766]:       <value>anonymous</value>
Aug 14 22:51:17 user nova-compute[72766]:       <value>memfd</value>
Aug 14 22:51:17 user nova-compute[72766]:     </enum>
Aug 14 22:51:17 user nova-compute[72766]:   </memoryBacking>
Aug 14 22:51:17 user nova-compute[72766]:   <devices>
Aug 14 22:51:17 user nova-compute[72766]:     <disk supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='diskDevice'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>disk</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>cdrom</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>floppy</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>lun</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='bus'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>ide</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>fdc</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>scsi</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>usb</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>sata</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='model'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio-transitional</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio-non-transitional</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </disk>
Aug 14 22:51:17 user nova-compute[72766]:     <graphics supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='type'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>sdl</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>vnc</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>spice</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>egl-headless</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </graphics>
Aug 14 22:51:17 user nova-compute[72766]:     <video supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='modelType'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>vga</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>cirrus</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>vmvga</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>qxl</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>none</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>bochs</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>ramfb</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </video>
Aug 14 22:51:17 user nova-compute[72766]:     <hostdev supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='mode'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>subsystem</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='startupPolicy'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>default</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>mandatory</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>requisite</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>optional</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='subsysType'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>usb</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>pci</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>scsi</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='capsType'/>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='pciBackend'/>
Aug 14 22:51:17 user nova-compute[72766]:     </hostdev>
Aug 14 22:51:17 user nova-compute[72766]:     <rng supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='model'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio-transitional</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio-non-transitional</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='backendModel'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>random</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>egd</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>builtin</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </rng>
Aug 14 22:51:17 user nova-compute[72766]:     <filesystem supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='driverType'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>path</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>handle</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtiofs</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </filesystem>
Aug 14 22:51:17 user nova-compute[72766]:     <tpm supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='model'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>tpm-tis</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>tpm-crb</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='backendModel'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>passthrough</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>emulator</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </tpm>
Aug 14 22:51:17 user nova-compute[72766]:   </devices>
Aug 14 22:51:17 user nova-compute[72766]:   <features>
Aug 14 22:51:17 user nova-compute[72766]:     <gic supported='no'/>
Aug 14 22:51:17 user nova-compute[72766]:     <vmcoreinfo supported='yes'/>
Aug 14 22:51:17 user nova-compute[72766]:     <genid supported='yes'/>
Aug 14 22:51:17 user nova-compute[72766]:     <backingStoreInput supported='yes'/>
Aug 14 22:51:17 user nova-compute[72766]:     <backup supported='yes'/>
Aug 14 22:51:17 user nova-compute[72766]:     <sev supported='no'/>
Aug 14 22:51:17 user nova-compute[72766]:   </features>
Aug 14 22:51:17 user nova-compute[72766]: </domainCapabilities>
Aug 14 22:51:17 user nova-compute[72766]:  {{(pid=72766) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 14 22:51:17 user nova-compute[72766]: <domainCapabilities>
Aug 14 22:51:17 user nova-compute[72766]:   <path>/usr/bin/qemu-system-i386</path>
Aug 14 22:51:17 user nova-compute[72766]:   <domain>kvm</domain>
Aug 14 22:51:17 user nova-compute[72766]:   <machine>pc-q35-jammy</machine>
Aug 14 22:51:17 user nova-compute[72766]:   <arch>i686</arch>
Aug 14 22:51:17 user nova-compute[72766]:   <vcpu max='288'/>
Aug 14 22:51:17 user nova-compute[72766]:   <iothreads supported='yes'/>
Aug 14 22:51:17 user nova-compute[72766]:   <os supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:     <enum name='firmware'/>
Aug 14 22:51:17 user nova-compute[72766]:     <loader supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 14 22:51:17 user nova-compute[72766]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 14 22:51:17 user nova-compute[72766]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 14 22:51:17 user nova-compute[72766]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 14 22:51:17 user nova-compute[72766]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='type'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>rom</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>pflash</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='readonly'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>yes</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>no</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='secure'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>no</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </loader>
Aug 14 22:51:17 user nova-compute[72766]:   </os>
Aug 14 22:51:17 user nova-compute[72766]:   <cpu>
Aug 14 22:51:17 user nova-compute[72766]:     <mode name='host-passthrough' supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='hostPassthroughMigratable'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>off</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </mode>
Aug 14 22:51:17 user nova-compute[72766]:     <mode name='maximum' supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='maximumMigratable'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>on</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>off</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </mode>
Aug 14 22:51:17 user nova-compute[72766]:     <mode name='host-model' supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <vendor>Intel</vendor>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='ss'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='vmx'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='pcid'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='hypervisor'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='arat'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='umip'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='md-clear'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='stibp'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='ssbd'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='ibpb'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='ibrs'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='amd-stibp'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='disable' name='erms'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='disable' name='lm'/>
Aug 14 22:51:17 user nova-compute[72766]:     </mode>
Aug 14 22:51:17 user nova-compute[72766]:     <mode name='custom' supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>qemu64</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>qemu32</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>phenom</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>pentium3</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>pentium2</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>pentium</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>n270</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>kvm64</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>kvm32</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>coreduo</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>core2duo</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>athlon</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Westmere-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Westmere</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Snowridge</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Server</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Client</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>SandyBridge</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Penryn</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Opteron_G5</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Opteron_G4</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Opteron_G3</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Opteron_G2</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Opteron_G1</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Nehalem-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Nehalem</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>IvyBridge</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Icelake-Server</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Haswell</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>EPYC-Rome</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>EPYC-Milan</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>EPYC</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Dhyana</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Cooperlake</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Conroe</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Broadwell</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>486</model>
Aug 14 22:51:17 user nova-compute[72766]:     </mode>
Aug 14 22:51:17 user nova-compute[72766]:   </cpu>
Aug 14 22:51:17 user nova-compute[72766]:   <memoryBacking supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:     <enum name='sourceType'>
Aug 14 22:51:17 user nova-compute[72766]:       <value>file</value>
Aug 14 22:51:17 user nova-compute[72766]:       <value>anonymous</value>
Aug 14 22:51:17 user nova-compute[72766]:       <value>memfd</value>
Aug 14 22:51:17 user nova-compute[72766]:     </enum>
Aug 14 22:51:17 user nova-compute[72766]:   </memoryBacking>
Aug 14 22:51:17 user nova-compute[72766]:   <devices>
Aug 14 22:51:17 user nova-compute[72766]:     <disk supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='diskDevice'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>disk</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>cdrom</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>floppy</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>lun</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='bus'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>fdc</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>scsi</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>usb</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>sata</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='model'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio-transitional</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio-non-transitional</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </disk>
Aug 14 22:51:17 user nova-compute[72766]:     <graphics supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='type'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>sdl</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>vnc</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>spice</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>egl-headless</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </graphics>
Aug 14 22:51:17 user nova-compute[72766]:     <video supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='modelType'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>vga</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>cirrus</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>vmvga</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>qxl</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>none</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>bochs</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>ramfb</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </video>
Aug 14 22:51:17 user nova-compute[72766]:     <hostdev supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='mode'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>subsystem</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='startupPolicy'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>default</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>mandatory</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>requisite</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>optional</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='subsysType'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>usb</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>pci</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>scsi</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='capsType'/>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='pciBackend'/>
Aug 14 22:51:17 user nova-compute[72766]:     </hostdev>
Aug 14 22:51:17 user nova-compute[72766]:     <rng supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='model'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio-transitional</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio-non-transitional</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='backendModel'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>random</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>egd</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>builtin</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </rng>
Aug 14 22:51:17 user nova-compute[72766]:     <filesystem supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='driverType'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>path</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>handle</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtiofs</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </filesystem>
Aug 14 22:51:17 user nova-compute[72766]:     <tpm supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='model'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>tpm-tis</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>tpm-crb</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='backendModel'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>passthrough</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>emulator</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </tpm>
Aug 14 22:51:17 user nova-compute[72766]:   </devices>
Aug 14 22:51:17 user nova-compute[72766]:   <features>
Aug 14 22:51:17 user nova-compute[72766]:     <gic supported='no'/>
Aug 14 22:51:17 user nova-compute[72766]:     <vmcoreinfo supported='yes'/>
Aug 14 22:51:17 user nova-compute[72766]:     <genid supported='yes'/>
Aug 14 22:51:17 user nova-compute[72766]:     <backingStoreInput supported='yes'/>
Aug 14 22:51:17 user nova-compute[72766]:     <backup supported='yes'/>
Aug 14 22:51:17 user nova-compute[72766]:     <sev supported='no'/>
Aug 14 22:51:17 user nova-compute[72766]:   </features>
Aug 14 22:51:17 user nova-compute[72766]: </domainCapabilities>
Aug 14 22:51:17 user nova-compute[72766]:  {{(pid=72766) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 14 22:51:17 user nova-compute[72766]: <domainCapabilities>
Aug 14 22:51:17 user nova-compute[72766]:   <path>/usr/bin/qemu-system-i386</path>
Aug 14 22:51:17 user nova-compute[72766]:   <domain>kvm</domain>
Aug 14 22:51:17 user nova-compute[72766]:   <machine>pc-q35-6.2</machine>
Aug 14 22:51:17 user nova-compute[72766]:   <arch>i686</arch>
Aug 14 22:51:17 user nova-compute[72766]:   <vcpu max='288'/>
Aug 14 22:51:17 user nova-compute[72766]:   <iothreads supported='yes'/>
Aug 14 22:51:17 user nova-compute[72766]:   <os supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:     <enum name='firmware'/>
Aug 14 22:51:17 user nova-compute[72766]:     <loader supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 14 22:51:17 user nova-compute[72766]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 14 22:51:17 user nova-compute[72766]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 14 22:51:17 user nova-compute[72766]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 14 22:51:17 user nova-compute[72766]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='type'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>rom</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>pflash</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='readonly'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>yes</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>no</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='secure'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>no</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </loader>
Aug 14 22:51:17 user nova-compute[72766]:   </os>
Aug 14 22:51:17 user nova-compute[72766]:   <cpu>
Aug 14 22:51:17 user nova-compute[72766]:     <mode name='host-passthrough' supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='hostPassthroughMigratable'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>off</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </mode>
Aug 14 22:51:17 user nova-compute[72766]:     <mode name='maximum' supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='maximumMigratable'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>on</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>off</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </mode>
Aug 14 22:51:17 user nova-compute[72766]:     <mode name='host-model' supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <vendor>Intel</vendor>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='ss'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='vmx'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='pcid'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='hypervisor'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='arat'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='umip'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='md-clear'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='stibp'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='ssbd'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='ibpb'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='ibrs'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='amd-stibp'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='disable' name='erms'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='disable' name='lm'/>
Aug 14 22:51:17 user nova-compute[72766]:     </mode>
Aug 14 22:51:17 user nova-compute[72766]:     <mode name='custom' supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>qemu64</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>qemu32</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>phenom</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>pentium3</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>pentium2</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>pentium</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>n270</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>kvm64</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>kvm32</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>coreduo</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>core2duo</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>athlon</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Westmere-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Westmere</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Snowridge</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Server</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Client</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>SandyBridge</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Penryn</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Opteron_G5</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Opteron_G4</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Opteron_G3</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Opteron_G2</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Opteron_G1</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Nehalem-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Nehalem</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>IvyBridge</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Icelake-Server</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Haswell</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>EPYC-Rome</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>EPYC-Milan</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>EPYC</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Dhyana</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Cooperlake</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Conroe</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Broadwell</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>486</model>
Aug 14 22:51:17 user nova-compute[72766]:     </mode>
Aug 14 22:51:17 user nova-compute[72766]:   </cpu>
Aug 14 22:51:17 user nova-compute[72766]:   <memoryBacking supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:     <enum name='sourceType'>
Aug 14 22:51:17 user nova-compute[72766]:       <value>file</value>
Aug 14 22:51:17 user nova-compute[72766]:       <value>anonymous</value>
Aug 14 22:51:17 user nova-compute[72766]:       <value>memfd</value>
Aug 14 22:51:17 user nova-compute[72766]:     </enum>
Aug 14 22:51:17 user nova-compute[72766]:   </memoryBacking>
Aug 14 22:51:17 user nova-compute[72766]:   <devices>
Aug 14 22:51:17 user nova-compute[72766]:     <disk supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='diskDevice'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>disk</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>cdrom</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>floppy</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>lun</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='bus'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>fdc</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>scsi</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>usb</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>sata</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='model'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio-transitional</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio-non-transitional</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </disk>
Aug 14 22:51:17 user nova-compute[72766]:     <graphics supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='type'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>sdl</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>vnc</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>spice</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>egl-headless</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </graphics>
Aug 14 22:51:17 user nova-compute[72766]:     <video supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='modelType'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>vga</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>cirrus</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>vmvga</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>qxl</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>none</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>bochs</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>ramfb</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </video>
Aug 14 22:51:17 user nova-compute[72766]:     <hostdev supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='mode'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>subsystem</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='startupPolicy'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>default</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>mandatory</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>requisite</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>optional</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='subsysType'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>usb</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>pci</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>scsi</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='capsType'/>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='pciBackend'/>
Aug 14 22:51:17 user nova-compute[72766]:     </hostdev>
Aug 14 22:51:17 user nova-compute[72766]:     <rng supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='model'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio-transitional</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio-non-transitional</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='backendModel'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>random</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>egd</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>builtin</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </rng>
Aug 14 22:51:17 user nova-compute[72766]:     <filesystem supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='driverType'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>path</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>handle</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtiofs</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </filesystem>
Aug 14 22:51:17 user nova-compute[72766]:     <tpm supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='model'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>tpm-tis</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>tpm-crb</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='backendModel'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>passthrough</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>emulator</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </tpm>
Aug 14 22:51:17 user nova-compute[72766]:   </devices>
Aug 14 22:51:17 user nova-compute[72766]:   <features>
Aug 14 22:51:17 user nova-compute[72766]:     <gic supported='no'/>
Aug 14 22:51:17 user nova-compute[72766]:     <vmcoreinfo supported='yes'/>
Aug 14 22:51:17 user nova-compute[72766]:     <genid supported='yes'/>
Aug 14 22:51:17 user nova-compute[72766]:     <backingStoreInput supported='yes'/>
Aug 14 22:51:17 user nova-compute[72766]:     <backup supported='yes'/>
Aug 14 22:51:17 user nova-compute[72766]:     <sev supported='no'/>
Aug 14 22:51:17 user nova-compute[72766]:   </features>
Aug 14 22:51:17 user nova-compute[72766]: </domainCapabilities>
Aug 14 22:51:17 user nova-compute[72766]:  {{(pid=72766) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 14 22:51:17 user nova-compute[72766]: <domainCapabilities>
Aug 14 22:51:17 user nova-compute[72766]:   <path>/usr/bin/qemu-system-i386</path>
Aug 14 22:51:17 user nova-compute[72766]:   <domain>kvm</domain>
Aug 14 22:51:17 user nova-compute[72766]:   <machine>pc-i440fx-jammy</machine>
Aug 14 22:51:17 user nova-compute[72766]:   <arch>i686</arch>
Aug 14 22:51:17 user nova-compute[72766]:   <vcpu max='255'/>
Aug 14 22:51:17 user nova-compute[72766]:   <iothreads supported='yes'/>
Aug 14 22:51:17 user nova-compute[72766]:   <os supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:     <enum name='firmware'/>
Aug 14 22:51:17 user nova-compute[72766]:     <loader supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 14 22:51:17 user nova-compute[72766]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 14 22:51:17 user nova-compute[72766]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 14 22:51:17 user nova-compute[72766]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 14 22:51:17 user nova-compute[72766]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='type'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>rom</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>pflash</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='readonly'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>yes</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>no</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='secure'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>no</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </loader>
Aug 14 22:51:17 user nova-compute[72766]:   </os>
Aug 14 22:51:17 user nova-compute[72766]:   <cpu>
Aug 14 22:51:17 user nova-compute[72766]:     <mode name='host-passthrough' supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='hostPassthroughMigratable'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>off</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </mode>
Aug 14 22:51:17 user nova-compute[72766]:     <mode name='maximum' supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='maximumMigratable'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>on</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>off</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </mode>
Aug 14 22:51:17 user nova-compute[72766]:     <mode name='host-model' supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <vendor>Intel</vendor>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='ss'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='vmx'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='pcid'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='hypervisor'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='arat'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='umip'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='md-clear'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='stibp'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='ssbd'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='ibpb'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='ibrs'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='amd-stibp'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='disable' name='erms'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='disable' name='lm'/>
Aug 14 22:51:17 user nova-compute[72766]:     </mode>
Aug 14 22:51:17 user nova-compute[72766]:     <mode name='custom' supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>qemu64</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>qemu32</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>phenom</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>pentium3</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>pentium2</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>pentium</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>n270</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>kvm64</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>kvm32</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>coreduo</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>core2duo</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>athlon</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Westmere-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Westmere</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Snowridge</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Server</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Client</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>SandyBridge</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Penryn</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Opteron_G5</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Opteron_G4</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Opteron_G3</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Opteron_G2</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Opteron_G1</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Nehalem-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Nehalem</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>IvyBridge</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Icelake-Server</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Haswell</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>EPYC-Rome</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>EPYC-Milan</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>EPYC</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Dhyana</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Cooperlake</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Conroe</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Broadwell</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>486</model>
Aug 14 22:51:17 user nova-compute[72766]:     </mode>
Aug 14 22:51:17 user nova-compute[72766]:   </cpu>
Aug 14 22:51:17 user nova-compute[72766]:   <memoryBacking supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:     <enum name='sourceType'>
Aug 14 22:51:17 user nova-compute[72766]:       <value>file</value>
Aug 14 22:51:17 user nova-compute[72766]:       <value>anonymous</value>
Aug 14 22:51:17 user nova-compute[72766]:       <value>memfd</value>
Aug 14 22:51:17 user nova-compute[72766]:     </enum>
Aug 14 22:51:17 user nova-compute[72766]:   </memoryBacking>
Aug 14 22:51:17 user nova-compute[72766]:   <devices>
Aug 14 22:51:17 user nova-compute[72766]:     <disk supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='diskDevice'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>disk</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>cdrom</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>floppy</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>lun</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='bus'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>ide</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>fdc</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>scsi</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>usb</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>sata</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='model'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio-transitional</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio-non-transitional</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </disk>
Aug 14 22:51:17 user nova-compute[72766]:     <graphics supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='type'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>sdl</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>vnc</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>spice</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>egl-headless</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </graphics>
Aug 14 22:51:17 user nova-compute[72766]:     <video supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='modelType'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>vga</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>cirrus</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>vmvga</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>qxl</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>none</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>bochs</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>ramfb</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </video>
Aug 14 22:51:17 user nova-compute[72766]:     <hostdev supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='mode'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>subsystem</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='startupPolicy'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>default</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>mandatory</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>requisite</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>optional</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='subsysType'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>usb</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>pci</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>scsi</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='capsType'/>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='pciBackend'/>
Aug 14 22:51:17 user nova-compute[72766]:     </hostdev>
Aug 14 22:51:17 user nova-compute[72766]:     <rng supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='model'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio-transitional</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio-non-transitional</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='backendModel'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>random</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>egd</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>builtin</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </rng>
Aug 14 22:51:17 user nova-compute[72766]:     <filesystem supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='driverType'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>path</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>handle</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtiofs</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </filesystem>
Aug 14 22:51:17 user nova-compute[72766]:     <tpm supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='model'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>tpm-tis</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>tpm-crb</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='backendModel'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>passthrough</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>emulator</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </tpm>
Aug 14 22:51:17 user nova-compute[72766]:   </devices>
Aug 14 22:51:17 user nova-compute[72766]:   <features>
Aug 14 22:51:17 user nova-compute[72766]:     <gic supported='no'/>
Aug 14 22:51:17 user nova-compute[72766]:     <vmcoreinfo supported='yes'/>
Aug 14 22:51:17 user nova-compute[72766]:     <genid supported='yes'/>
Aug 14 22:51:17 user nova-compute[72766]:     <backingStoreInput supported='yes'/>
Aug 14 22:51:17 user nova-compute[72766]:     <backup supported='yes'/>
Aug 14 22:51:17 user nova-compute[72766]:     <sev supported='no'/>
Aug 14 22:51:17 user nova-compute[72766]:   </features>
Aug 14 22:51:17 user nova-compute[72766]: </domainCapabilities>
Aug 14 22:51:17 user nova-compute[72766]:  {{(pid=72766) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=72766) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72766) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72766) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=72766) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=72766) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=72766) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=72766) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=72766) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=72766) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=72766) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=72766) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=72766) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=72766) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=72766) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=72766) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=72766) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=72766) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', None, 'pseries'} {{(pid=72766) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72766) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72766) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72766) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=72766) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72766) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72766) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=72766) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=72766) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=72766) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=72766) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=72766) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=72766) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=72766) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=72766) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=72766) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=72766) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=72766) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=72766) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=72766) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=72766) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu-q35', 'q35', 'ubuntu'} {{(pid=72766) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 14 22:51:17 user nova-compute[72766]: <domainCapabilities>
Aug 14 22:51:17 user nova-compute[72766]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 14 22:51:17 user nova-compute[72766]:   <domain>kvm</domain>
Aug 14 22:51:17 user nova-compute[72766]:   <machine>pc-i440fx-6.2</machine>
Aug 14 22:51:17 user nova-compute[72766]:   <arch>x86_64</arch>
Aug 14 22:51:17 user nova-compute[72766]:   <vcpu max='255'/>
Aug 14 22:51:17 user nova-compute[72766]:   <iothreads supported='yes'/>
Aug 14 22:51:17 user nova-compute[72766]:   <os supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:     <enum name='firmware'>
Aug 14 22:51:17 user nova-compute[72766]:       <value>efi</value>
Aug 14 22:51:17 user nova-compute[72766]:     </enum>
Aug 14 22:51:17 user nova-compute[72766]:     <loader supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='type'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>rom</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>pflash</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='readonly'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>yes</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>no</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='secure'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>no</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </loader>
Aug 14 22:51:17 user nova-compute[72766]:   </os>
Aug 14 22:51:17 user nova-compute[72766]:   <cpu>
Aug 14 22:51:17 user nova-compute[72766]:     <mode name='host-passthrough' supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='hostPassthroughMigratable'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>on</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>off</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </mode>
Aug 14 22:51:17 user nova-compute[72766]:     <mode name='maximum' supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='maximumMigratable'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>on</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>off</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </mode>
Aug 14 22:51:17 user nova-compute[72766]:     <mode name='host-model' supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <vendor>Intel</vendor>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='ss'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='vmx'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='pcid'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='hypervisor'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='arat'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='umip'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='md-clear'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='stibp'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='ssbd'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='invtsc'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='ibpb'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='ibrs'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='amd-stibp'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='rsba'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='pschange-mc-no'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='disable' name='erms'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 22:51:17 user nova-compute[72766]:     </mode>
Aug 14 22:51:17 user nova-compute[72766]:     <mode name='custom' supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>qemu64</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>qemu32</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>phenom</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>pentium3</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>pentium2</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>pentium</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>n270</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>kvm64</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>kvm32</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>coreduo</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>core2duo</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>athlon</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>Westmere-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>Westmere</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Snowridge</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Server</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Client</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>SandyBridge</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>Penryn</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Opteron_G5</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Opteron_G4</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Opteron_G3</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Opteron_G2</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>Opteron_G1</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>Nehalem</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>IvyBridge</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Icelake-Server</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Haswell</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>EPYC-Rome</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>EPYC-Milan</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>EPYC</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Dhyana</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Cooperlake</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>Conroe</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Broadwell</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>486</model>
Aug 14 22:51:17 user nova-compute[72766]:     </mode>
Aug 14 22:51:17 user nova-compute[72766]:   </cpu>
Aug 14 22:51:17 user nova-compute[72766]:   <memoryBacking supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:     <enum name='sourceType'>
Aug 14 22:51:17 user nova-compute[72766]:       <value>file</value>
Aug 14 22:51:17 user nova-compute[72766]:       <value>anonymous</value>
Aug 14 22:51:17 user nova-compute[72766]:       <value>memfd</value>
Aug 14 22:51:17 user nova-compute[72766]:     </enum>
Aug 14 22:51:17 user nova-compute[72766]:   </memoryBacking>
Aug 14 22:51:17 user nova-compute[72766]:   <devices>
Aug 14 22:51:17 user nova-compute[72766]:     <disk supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='diskDevice'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>disk</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>cdrom</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>floppy</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>lun</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='bus'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>ide</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>fdc</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>scsi</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>usb</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>sata</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='model'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio-transitional</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio-non-transitional</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </disk>
Aug 14 22:51:17 user nova-compute[72766]:     <graphics supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='type'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>sdl</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>vnc</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>spice</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>egl-headless</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </graphics>
Aug 14 22:51:17 user nova-compute[72766]:     <video supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='modelType'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>vga</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>cirrus</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>vmvga</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>qxl</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>none</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>bochs</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>ramfb</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </video>
Aug 14 22:51:17 user nova-compute[72766]:     <hostdev supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='mode'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>subsystem</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='startupPolicy'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>default</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>mandatory</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>requisite</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>optional</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='subsysType'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>usb</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>pci</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>scsi</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='capsType'/>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='pciBackend'/>
Aug 14 22:51:17 user nova-compute[72766]:     </hostdev>
Aug 14 22:51:17 user nova-compute[72766]:     <rng supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='model'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio-transitional</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio-non-transitional</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='backendModel'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>random</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>egd</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>builtin</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </rng>
Aug 14 22:51:17 user nova-compute[72766]:     <filesystem supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='driverType'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>path</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>handle</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtiofs</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </filesystem>
Aug 14 22:51:17 user nova-compute[72766]:     <tpm supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='model'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>tpm-tis</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>tpm-crb</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='backendModel'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>passthrough</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>emulator</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </tpm>
Aug 14 22:51:17 user nova-compute[72766]:   </devices>
Aug 14 22:51:17 user nova-compute[72766]:   <features>
Aug 14 22:51:17 user nova-compute[72766]:     <gic supported='no'/>
Aug 14 22:51:17 user nova-compute[72766]:     <vmcoreinfo supported='yes'/>
Aug 14 22:51:17 user nova-compute[72766]:     <genid supported='yes'/>
Aug 14 22:51:17 user nova-compute[72766]:     <backingStoreInput supported='yes'/>
Aug 14 22:51:17 user nova-compute[72766]:     <backup supported='yes'/>
Aug 14 22:51:17 user nova-compute[72766]:     <sev supported='no'/>
Aug 14 22:51:17 user nova-compute[72766]:   </features>
Aug 14 22:51:17 user nova-compute[72766]: </domainCapabilities>
Aug 14 22:51:17 user nova-compute[72766]:  {{(pid=72766) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 14 22:51:17 user nova-compute[72766]: <domainCapabilities>
Aug 14 22:51:17 user nova-compute[72766]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 14 22:51:17 user nova-compute[72766]:   <domain>kvm</domain>
Aug 14 22:51:17 user nova-compute[72766]:   <machine>pc-q35-jammy</machine>
Aug 14 22:51:17 user nova-compute[72766]:   <arch>x86_64</arch>
Aug 14 22:51:17 user nova-compute[72766]:   <vcpu max='288'/>
Aug 14 22:51:17 user nova-compute[72766]:   <iothreads supported='yes'/>
Aug 14 22:51:17 user nova-compute[72766]:   <os supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:     <enum name='firmware'>
Aug 14 22:51:17 user nova-compute[72766]:       <value>efi</value>
Aug 14 22:51:17 user nova-compute[72766]:     </enum>
Aug 14 22:51:17 user nova-compute[72766]:     <loader supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 14 22:51:17 user nova-compute[72766]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 14 22:51:17 user nova-compute[72766]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='type'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>rom</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>pflash</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='readonly'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>yes</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>no</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='secure'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>yes</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>no</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </loader>
Aug 14 22:51:17 user nova-compute[72766]:   </os>
Aug 14 22:51:17 user nova-compute[72766]:   <cpu>
Aug 14 22:51:17 user nova-compute[72766]:     <mode name='host-passthrough' supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='hostPassthroughMigratable'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>on</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>off</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </mode>
Aug 14 22:51:17 user nova-compute[72766]:     <mode name='maximum' supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='maximumMigratable'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>on</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>off</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </mode>
Aug 14 22:51:17 user nova-compute[72766]:     <mode name='host-model' supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <vendor>Intel</vendor>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='ss'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='vmx'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='pcid'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='hypervisor'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='arat'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='umip'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='md-clear'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='stibp'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='ssbd'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='invtsc'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='ibpb'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='ibrs'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='amd-stibp'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='rsba'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='pschange-mc-no'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='disable' name='erms'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 22:51:17 user nova-compute[72766]:     </mode>
Aug 14 22:51:17 user nova-compute[72766]:     <mode name='custom' supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>qemu64</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>qemu32</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>phenom</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>pentium3</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>pentium2</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>pentium</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>n270</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>kvm64</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>kvm32</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>coreduo</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>core2duo</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>athlon</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>Westmere-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>Westmere</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Snowridge</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Server</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Client</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>SandyBridge</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>Penryn</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Opteron_G5</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Opteron_G4</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Opteron_G3</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Opteron_G2</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>Opteron_G1</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>Nehalem</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>IvyBridge</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Icelake-Server</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Haswell</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>EPYC-Rome</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>EPYC-Milan</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>EPYC</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Dhyana</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Cooperlake</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>Conroe</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Broadwell</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>486</model>
Aug 14 22:51:17 user nova-compute[72766]:     </mode>
Aug 14 22:51:17 user nova-compute[72766]:   </cpu>
Aug 14 22:51:17 user nova-compute[72766]:   <memoryBacking supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:     <enum name='sourceType'>
Aug 14 22:51:17 user nova-compute[72766]:       <value>file</value>
Aug 14 22:51:17 user nova-compute[72766]:       <value>anonymous</value>
Aug 14 22:51:17 user nova-compute[72766]:       <value>memfd</value>
Aug 14 22:51:17 user nova-compute[72766]:     </enum>
Aug 14 22:51:17 user nova-compute[72766]:   </memoryBacking>
Aug 14 22:51:17 user nova-compute[72766]:   <devices>
Aug 14 22:51:17 user nova-compute[72766]:     <disk supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='diskDevice'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>disk</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>cdrom</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>floppy</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>lun</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='bus'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>fdc</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>scsi</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>usb</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>sata</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='model'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio-transitional</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio-non-transitional</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </disk>
Aug 14 22:51:17 user nova-compute[72766]:     <graphics supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='type'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>sdl</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>vnc</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>spice</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>egl-headless</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </graphics>
Aug 14 22:51:17 user nova-compute[72766]:     <video supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='modelType'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>vga</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>cirrus</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>vmvga</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>qxl</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>none</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>bochs</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>ramfb</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </video>
Aug 14 22:51:17 user nova-compute[72766]:     <hostdev supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='mode'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>subsystem</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='startupPolicy'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>default</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>mandatory</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>requisite</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>optional</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='subsysType'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>usb</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>pci</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>scsi</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='capsType'/>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='pciBackend'/>
Aug 14 22:51:17 user nova-compute[72766]:     </hostdev>
Aug 14 22:51:17 user nova-compute[72766]:     <rng supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='model'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio-transitional</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio-non-transitional</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='backendModel'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>random</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>egd</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>builtin</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </rng>
Aug 14 22:51:17 user nova-compute[72766]:     <filesystem supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='driverType'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>path</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>handle</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtiofs</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </filesystem>
Aug 14 22:51:17 user nova-compute[72766]:     <tpm supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='model'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>tpm-tis</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>tpm-crb</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='backendModel'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>passthrough</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>emulator</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </tpm>
Aug 14 22:51:17 user nova-compute[72766]:   </devices>
Aug 14 22:51:17 user nova-compute[72766]:   <features>
Aug 14 22:51:17 user nova-compute[72766]:     <gic supported='no'/>
Aug 14 22:51:17 user nova-compute[72766]:     <vmcoreinfo supported='yes'/>
Aug 14 22:51:17 user nova-compute[72766]:     <genid supported='yes'/>
Aug 14 22:51:17 user nova-compute[72766]:     <backingStoreInput supported='yes'/>
Aug 14 22:51:17 user nova-compute[72766]:     <backup supported='yes'/>
Aug 14 22:51:17 user nova-compute[72766]:     <sev supported='no'/>
Aug 14 22:51:17 user nova-compute[72766]:   </features>
Aug 14 22:51:17 user nova-compute[72766]: </domainCapabilities>
Aug 14 22:51:17 user nova-compute[72766]:  {{(pid=72766) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 14 22:51:17 user nova-compute[72766]: <domainCapabilities>
Aug 14 22:51:17 user nova-compute[72766]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 14 22:51:17 user nova-compute[72766]:   <domain>kvm</domain>
Aug 14 22:51:17 user nova-compute[72766]:   <machine>pc-q35-6.2</machine>
Aug 14 22:51:17 user nova-compute[72766]:   <arch>x86_64</arch>
Aug 14 22:51:17 user nova-compute[72766]:   <vcpu max='288'/>
Aug 14 22:51:17 user nova-compute[72766]:   <iothreads supported='yes'/>
Aug 14 22:51:17 user nova-compute[72766]:   <os supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:     <enum name='firmware'>
Aug 14 22:51:17 user nova-compute[72766]:       <value>efi</value>
Aug 14 22:51:17 user nova-compute[72766]:     </enum>
Aug 14 22:51:17 user nova-compute[72766]:     <loader supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 14 22:51:17 user nova-compute[72766]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 14 22:51:17 user nova-compute[72766]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='type'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>rom</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>pflash</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='readonly'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>yes</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>no</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='secure'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>yes</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>no</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </loader>
Aug 14 22:51:17 user nova-compute[72766]:   </os>
Aug 14 22:51:17 user nova-compute[72766]:   <cpu>
Aug 14 22:51:17 user nova-compute[72766]:     <mode name='host-passthrough' supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='hostPassthroughMigratable'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>on</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>off</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </mode>
Aug 14 22:51:17 user nova-compute[72766]:     <mode name='maximum' supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='maximumMigratable'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>on</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>off</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </mode>
Aug 14 22:51:17 user nova-compute[72766]:     <mode name='host-model' supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <vendor>Intel</vendor>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='ss'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='vmx'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='pcid'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='hypervisor'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='arat'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='umip'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='md-clear'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='stibp'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='ssbd'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='invtsc'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='ibpb'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='ibrs'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='amd-stibp'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='rsba'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='pschange-mc-no'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='disable' name='erms'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 22:51:17 user nova-compute[72766]:     </mode>
Aug 14 22:51:17 user nova-compute[72766]:     <mode name='custom' supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>qemu64</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>qemu32</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>phenom</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>pentium3</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>pentium2</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>pentium</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>n270</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>kvm64</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>kvm32</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>coreduo</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>core2duo</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>athlon</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>Westmere-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>Westmere</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Snowridge</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Server</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Client</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>SandyBridge</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>Penryn</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Opteron_G5</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Opteron_G4</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Opteron_G3</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Opteron_G2</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>Opteron_G1</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>Nehalem</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>IvyBridge</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Icelake-Server</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Haswell</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>EPYC-Rome</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>EPYC-Milan</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>EPYC</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Dhyana</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Cooperlake</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>Conroe</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Broadwell</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>486</model>
Aug 14 22:51:17 user nova-compute[72766]:     </mode>
Aug 14 22:51:17 user nova-compute[72766]:   </cpu>
Aug 14 22:51:17 user nova-compute[72766]:   <memoryBacking supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:     <enum name='sourceType'>
Aug 14 22:51:17 user nova-compute[72766]:       <value>file</value>
Aug 14 22:51:17 user nova-compute[72766]:       <value>anonymous</value>
Aug 14 22:51:17 user nova-compute[72766]:       <value>memfd</value>
Aug 14 22:51:17 user nova-compute[72766]:     </enum>
Aug 14 22:51:17 user nova-compute[72766]:   </memoryBacking>
Aug 14 22:51:17 user nova-compute[72766]:   <devices>
Aug 14 22:51:17 user nova-compute[72766]:     <disk supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='diskDevice'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>disk</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>cdrom</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>floppy</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>lun</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='bus'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>fdc</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>scsi</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>usb</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>sata</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='model'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio-transitional</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio-non-transitional</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </disk>
Aug 14 22:51:17 user nova-compute[72766]:     <graphics supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='type'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>sdl</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>vnc</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>spice</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>egl-headless</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </graphics>
Aug 14 22:51:17 user nova-compute[72766]:     <video supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='modelType'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>vga</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>cirrus</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>vmvga</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>qxl</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>none</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>bochs</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>ramfb</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </video>
Aug 14 22:51:17 user nova-compute[72766]:     <hostdev supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='mode'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>subsystem</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='startupPolicy'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>default</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>mandatory</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>requisite</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>optional</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='subsysType'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>usb</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>pci</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>scsi</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='capsType'/>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='pciBackend'/>
Aug 14 22:51:17 user nova-compute[72766]:     </hostdev>
Aug 14 22:51:17 user nova-compute[72766]:     <rng supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='model'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio-transitional</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio-non-transitional</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='backendModel'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>random</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>egd</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>builtin</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </rng>
Aug 14 22:51:17 user nova-compute[72766]:     <filesystem supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='driverType'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>path</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>handle</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtiofs</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </filesystem>
Aug 14 22:51:17 user nova-compute[72766]:     <tpm supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='model'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>tpm-tis</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>tpm-crb</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='backendModel'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>passthrough</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>emulator</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </tpm>
Aug 14 22:51:17 user nova-compute[72766]:   </devices>
Aug 14 22:51:17 user nova-compute[72766]:   <features>
Aug 14 22:51:17 user nova-compute[72766]:     <gic supported='no'/>
Aug 14 22:51:17 user nova-compute[72766]:     <vmcoreinfo supported='yes'/>
Aug 14 22:51:17 user nova-compute[72766]:     <genid supported='yes'/>
Aug 14 22:51:17 user nova-compute[72766]:     <backingStoreInput supported='yes'/>
Aug 14 22:51:17 user nova-compute[72766]:     <backup supported='yes'/>
Aug 14 22:51:17 user nova-compute[72766]:     <sev supported='no'/>
Aug 14 22:51:17 user nova-compute[72766]:   </features>
Aug 14 22:51:17 user nova-compute[72766]: </domainCapabilities>
Aug 14 22:51:17 user nova-compute[72766]:  {{(pid=72766) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 14 22:51:17 user nova-compute[72766]: <domainCapabilities>
Aug 14 22:51:17 user nova-compute[72766]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 14 22:51:17 user nova-compute[72766]:   <domain>kvm</domain>
Aug 14 22:51:17 user nova-compute[72766]:   <machine>pc-i440fx-jammy</machine>
Aug 14 22:51:17 user nova-compute[72766]:   <arch>x86_64</arch>
Aug 14 22:51:17 user nova-compute[72766]:   <vcpu max='255'/>
Aug 14 22:51:17 user nova-compute[72766]:   <iothreads supported='yes'/>
Aug 14 22:51:17 user nova-compute[72766]:   <os supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:     <enum name='firmware'>
Aug 14 22:51:17 user nova-compute[72766]:       <value>efi</value>
Aug 14 22:51:17 user nova-compute[72766]:     </enum>
Aug 14 22:51:17 user nova-compute[72766]:     <loader supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='type'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>rom</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>pflash</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='readonly'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>yes</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>no</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='secure'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>no</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </loader>
Aug 14 22:51:17 user nova-compute[72766]:   </os>
Aug 14 22:51:17 user nova-compute[72766]:   <cpu>
Aug 14 22:51:17 user nova-compute[72766]:     <mode name='host-passthrough' supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='hostPassthroughMigratable'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>on</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>off</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </mode>
Aug 14 22:51:17 user nova-compute[72766]:     <mode name='maximum' supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='maximumMigratable'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>on</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>off</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </mode>
Aug 14 22:51:17 user nova-compute[72766]:     <mode name='host-model' supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <vendor>Intel</vendor>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='ss'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='vmx'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='pcid'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='hypervisor'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='arat'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='umip'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='md-clear'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='stibp'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='ssbd'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='invtsc'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='ibpb'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='ibrs'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='amd-stibp'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='rsba'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='require' name='pschange-mc-no'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='disable' name='erms'/>
Aug 14 22:51:17 user nova-compute[72766]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 22:51:17 user nova-compute[72766]:     </mode>
Aug 14 22:51:17 user nova-compute[72766]:     <mode name='custom' supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>qemu64</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>qemu32</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>phenom</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>pentium3</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>pentium2</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>pentium</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>n270</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>kvm64</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>kvm32</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>coreduo</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>core2duo</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>athlon</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>Westmere-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>Westmere</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Snowridge</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Server</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Skylake-Client</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>SandyBridge</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>Penryn</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Opteron_G5</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Opteron_G4</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Opteron_G3</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Opteron_G2</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>Opteron_G1</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>Nehalem</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>IvyBridge</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Icelake-Server</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Haswell</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>EPYC-Rome</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>EPYC-Milan</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>EPYC</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Dhyana</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Cooperlake</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>Conroe</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='no'>Broadwell</model>
Aug 14 22:51:17 user nova-compute[72766]:       <model usable='yes'>486</model>
Aug 14 22:51:17 user nova-compute[72766]:     </mode>
Aug 14 22:51:17 user nova-compute[72766]:   </cpu>
Aug 14 22:51:17 user nova-compute[72766]:   <memoryBacking supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:     <enum name='sourceType'>
Aug 14 22:51:17 user nova-compute[72766]:       <value>file</value>
Aug 14 22:51:17 user nova-compute[72766]:       <value>anonymous</value>
Aug 14 22:51:17 user nova-compute[72766]:       <value>memfd</value>
Aug 14 22:51:17 user nova-compute[72766]:     </enum>
Aug 14 22:51:17 user nova-compute[72766]:   </memoryBacking>
Aug 14 22:51:17 user nova-compute[72766]:   <devices>
Aug 14 22:51:17 user nova-compute[72766]:     <disk supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='diskDevice'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>disk</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>cdrom</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>floppy</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>lun</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='bus'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>ide</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>fdc</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>scsi</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>usb</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>sata</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='model'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio-transitional</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio-non-transitional</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </disk>
Aug 14 22:51:17 user nova-compute[72766]:     <graphics supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='type'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>sdl</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>vnc</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>spice</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>egl-headless</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </graphics>
Aug 14 22:51:17 user nova-compute[72766]:     <video supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='modelType'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>vga</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>cirrus</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>vmvga</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>qxl</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>none</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>bochs</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>ramfb</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </video>
Aug 14 22:51:17 user nova-compute[72766]:     <hostdev supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='mode'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>subsystem</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='startupPolicy'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>default</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>mandatory</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>requisite</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>optional</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='subsysType'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>usb</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>pci</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>scsi</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='capsType'/>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='pciBackend'/>
Aug 14 22:51:17 user nova-compute[72766]:     </hostdev>
Aug 14 22:51:17 user nova-compute[72766]:     <rng supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='model'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio-transitional</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtio-non-transitional</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='backendModel'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>random</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>egd</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>builtin</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </rng>
Aug 14 22:51:17 user nova-compute[72766]:     <filesystem supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='driverType'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>path</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>handle</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>virtiofs</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </filesystem>
Aug 14 22:51:17 user nova-compute[72766]:     <tpm supported='yes'>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='model'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>tpm-tis</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>tpm-crb</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:       <enum name='backendModel'>
Aug 14 22:51:17 user nova-compute[72766]:         <value>passthrough</value>
Aug 14 22:51:17 user nova-compute[72766]:         <value>emulator</value>
Aug 14 22:51:17 user nova-compute[72766]:       </enum>
Aug 14 22:51:17 user nova-compute[72766]:     </tpm>
Aug 14 22:51:17 user nova-compute[72766]:   </devices>
Aug 14 22:51:17 user nova-compute[72766]:   <features>
Aug 14 22:51:17 user nova-compute[72766]:     <gic supported='no'/>
Aug 14 22:51:17 user nova-compute[72766]:     <vmcoreinfo supported='yes'/>
Aug 14 22:51:17 user nova-compute[72766]:     <genid supported='yes'/>
Aug 14 22:51:17 user nova-compute[72766]:     <backingStoreInput supported='yes'/>
Aug 14 22:51:17 user nova-compute[72766]:     <backup supported='yes'/>
Aug 14 22:51:17 user nova-compute[72766]:     <sev supported='no'/>
Aug 14 22:51:17 user nova-compute[72766]:   </features>
Aug 14 22:51:17 user nova-compute[72766]: </domainCapabilities>
Aug 14 22:51:17 user nova-compute[72766]:  {{(pid=72766) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=72766) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=72766) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=72766) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=72766) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Checking secure boot support for host arch (x86_64) {{(pid=72766) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Checking secure boot support for host arch (x86_64) {{(pid=72766) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Checking secure boot support for host arch (x86_64) {{(pid=72766) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 14 22:51:17 user nova-compute[72766]: INFO nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Secure Boot support detected
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] cpu compare xml: <cpu match="exact">
Aug 14 22:51:17 user nova-compute[72766]:   <model>Nehalem</model>
Aug 14 22:51:17 user nova-compute[72766]: </cpu>
Aug 14 22:51:17 user nova-compute[72766]:  {{(pid=72766) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 14 22:51:17 user nova-compute[72766]: INFO nova.virt.node [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Generated node identity 45c8ff08-bf31-4ab6-8452-2e293102f899
Aug 14 22:51:17 user nova-compute[72766]: INFO nova.virt.node [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Wrote node identity 45c8ff08-bf31-4ab6-8452-2e293102f899 to /opt/stack/data/nova/compute_id
Aug 14 22:51:17 user nova-compute[72766]: WARNING nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Compute nodes ['45c8ff08-bf31-4ab6-8452-2e293102f899'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 14 22:51:17 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 14 22:51:17 user nova-compute[72766]: WARNING nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 14 22:51:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:51:17 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 22:51:18 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:51:18 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:51:18 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Hypervisor/Node resource view: name=user free_ram=10948MB free_disk=26.380165100097656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 22:51:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:51:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:51:18 user nova-compute[72766]: WARNING nova.compute.resource_tracker [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] No compute node record for user:45c8ff08-bf31-4ab6-8452-2e293102f899: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 45c8ff08-bf31-4ab6-8452-2e293102f899 could not be found.
Aug 14 22:51:18 user nova-compute[72766]: INFO nova.compute.resource_tracker [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Compute node record created for user:user with uuid: 45c8ff08-bf31-4ab6-8452-2e293102f899
Aug 14 22:51:18 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 22:51:18 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 22:51:18 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [req-520a88b4-7244-4b4c-b72e-1a7b91eba599] Created resource provider record via placement API for resource provider with UUID 45c8ff08-bf31-4ab6-8452-2e293102f899 and name user.
Aug 14 22:51:18 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=72766) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 14 22:51:18 user nova-compute[72766]: INFO nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] kernel doesn't support AMD SEV
Aug 14 22:51:18 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Updating inventory in ProviderTree for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 22:51:18 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 22:51:18 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Libvirt baseline CPU <cpu>
Aug 14 22:51:18 user nova-compute[72766]:   <arch>x86_64</arch>
Aug 14 22:51:18 user nova-compute[72766]:   <model>Nehalem</model>
Aug 14 22:51:18 user nova-compute[72766]:   <vendor>Intel</vendor>
Aug 14 22:51:18 user nova-compute[72766]:   <topology sockets="6" cores="1" threads="1"/>
Aug 14 22:51:18 user nova-compute[72766]: </cpu>
Aug 14 22:51:18 user nova-compute[72766]:  {{(pid=72766) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 14 22:51:18 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Updated inventory for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 14 22:51:18 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Updating resource provider 45c8ff08-bf31-4ab6-8452-2e293102f899 generation from 0 to 1 during operation: update_inventory {{(pid=72766) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 14 22:51:18 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Updating inventory in ProviderTree for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 22:51:18 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Updating resource provider 45c8ff08-bf31-4ab6-8452-2e293102f899 generation from 1 to 2 during operation: update_traits {{(pid=72766) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 14 22:51:18 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 22:51:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.669s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:51:18 user nova-compute[72766]: DEBUG nova.service [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Creating RPC server for service compute {{(pid=72766) start /opt/stack/nova/nova/service.py:182}}
Aug 14 22:51:18 user nova-compute[72766]: DEBUG nova.service [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Join ServiceGroup membership for this service compute {{(pid=72766) start /opt/stack/nova/nova/service.py:199}}
Aug 14 22:51:18 user nova-compute[72766]: DEBUG nova.servicegroup.drivers.db [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=72766) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 14 22:51:22 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:51:22 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:52:09 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:52:09 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:52:09 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 22:52:09 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Rebuilding the list of instances to heal {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 22:52:09 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Didn't find any instances for network info cache update. {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 22:52:09 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:52:09 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:52:09 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:52:09 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:52:09 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:52:09 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:52:09 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 22:52:09 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:52:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:52:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:52:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:52:09 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 22:52:10 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:52:10 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:52:10 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=10247MB free_disk=26.283729553222656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 22:52:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:52:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:52:10 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 22:52:10 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 22:52:10 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:52:10 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:52:10 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 22:52:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:53:10 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:53:10 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:53:10 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:53:10 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:53:10 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 22:53:10 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:53:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:53:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:53:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:53:10 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 22:53:10 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:53:10 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:53:10 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=10194MB free_disk=26.33000946044922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 22:53:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:53:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:53:10 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 22:53:10 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 22:53:10 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:53:10 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:53:10 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 22:53:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.106s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:53:11 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:53:11 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:53:11 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 22:53:11 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Rebuilding the list of instances to heal {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 22:53:11 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Didn't find any instances for network info cache update. {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 22:53:11 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:53:11 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:53:11 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:54:10 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:54:10 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 22:54:10 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Rebuilding the list of instances to heal {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 22:54:10 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Didn't find any instances for network info cache update. {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 22:54:10 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:54:10 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:54:10 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 22:54:11 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:54:11 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:54:11 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:54:11 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:54:11 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:54:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:54:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:54:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:54:11 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 22:54:12 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:54:12 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:54:12 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=10169MB free_disk=26.113967895507812GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 22:54:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:54:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:54:12 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 22:54:12 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 22:54:12 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:54:12 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:54:12 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 22:54:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.153s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:54:13 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:55:09 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:55:10 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:55:11 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:55:11 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 22:55:11 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Rebuilding the list of instances to heal {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 22:55:11 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Didn't find any instances for network info cache update. {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 22:55:11 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:55:11 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:55:11 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:55:11 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 22:55:11 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:55:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:55:11 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 22:55:12 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:55:12 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:55:12 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=9459MB free_disk=26.136932373046875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 22:55:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:12 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 22:55:12 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 22:55:12 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:55:12 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:55:12 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 22:55:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.144s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:55:13 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:55:13 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:55:13 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:55:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Acquiring lock "023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Lock "023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:22 user nova-compute[72766]: DEBUG nova.compute.manager [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 22:55:23 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:23 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:23 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 22:55:23 user nova-compute[72766]: INFO nova.compute.claims [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Claim successful on node user
Aug 14 22:55:23 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:55:23 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:55:23 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:55:23 user nova-compute[72766]: DEBUG nova.compute.manager [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 22:55:23 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Acquiring lock "b563c62d-d117-4bb5-9157-7387c51ed641" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:23 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Lock "b563c62d-d117-4bb5-9157-7387c51ed641" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:23 user nova-compute[72766]: DEBUG nova.compute.manager [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 22:55:23 user nova-compute[72766]: DEBUG nova.compute.manager [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 22:55:23 user nova-compute[72766]: DEBUG nova.network.neutron [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 22:55:23 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 22:55:23 user nova-compute[72766]: DEBUG nova.compute.manager [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 22:55:23 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:23 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:23 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 22:55:23 user nova-compute[72766]: INFO nova.compute.claims [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Claim successful on node user
Aug 14 22:55:23 user nova-compute[72766]: DEBUG nova.compute.manager [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 22:55:23 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 22:55:23 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Creating image(s)
Aug 14 22:55:23 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Acquiring lock "/opt/stack/data/nova/instances/023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:23 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Lock "/opt/stack/data/nova/instances/023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:23 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Lock "/opt/stack/data/nova/instances/023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:55:23 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Acquiring lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:23 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:23 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:55:23 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:55:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.325s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:55:24 user nova-compute[72766]: DEBUG nova.compute.manager [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 22:55:24 user nova-compute[72766]: DEBUG nova.compute.manager [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 22:55:24 user nova-compute[72766]: DEBUG nova.network.neutron [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 22:55:24 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 22:55:24 user nova-compute[72766]: DEBUG nova.compute.manager [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 22:55:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb.part --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:55:24 user nova-compute[72766]: DEBUG nova.policy [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0421d92f15f44629b1885a36b4583a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c9d8bf74b94b4c9d82ec1308a7036e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 22:55:24 user nova-compute[72766]: DEBUG nova.policy [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4701a1ef84d94ce99ec55e44c1df9032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142137ab929f4e5289b06319af10751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 22:55:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb.part --force-share --output=json" returned: 0 in 0.200s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:55:24 user nova-compute[72766]: DEBUG nova.virt.images [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] d2900d30-2c4c-4d57-9135-d45564c0c596 was qcow2, converting to raw {{(pid=72766) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 22:55:24 user nova-compute[72766]: DEBUG nova.privsep.utils [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72766) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 22:55:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb.part /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb.converted {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:55:24 user nova-compute[72766]: DEBUG nova.compute.manager [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 22:55:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 22:55:24 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Creating image(s)
Aug 14 22:55:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Acquiring lock "/opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Lock "/opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Lock "/opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:55:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Acquiring lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb.part /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb.converted" returned: 0 in 0.421s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:55:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb.converted --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:55:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb.converted --force-share --output=json" returned: 0 in 0.185s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:55:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.419s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:55:25 user nova-compute[72766]: INFO oslo.privsep.daemon [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpqlafzhuf/privsep.sock']
Aug 14 22:55:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.344s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:55:25 user sudo[82346]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpqlafzhuf/privsep.sock
Aug 14 22:55:25 user sudo[82346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 14 22:55:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Acquiring lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:26 user nova-compute[72766]: DEBUG nova.compute.manager [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 22:55:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:26 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 22:55:26 user nova-compute[72766]: INFO nova.compute.claims [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Claim successful on node user
Aug 14 22:55:26 user nova-compute[72766]: DEBUG nova.network.neutron [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Successfully created port: 098d7854-a4f9-4a29-ad8d-552083e4cf23 {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 22:55:26 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:55:26 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:55:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.434s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:55:26 user nova-compute[72766]: DEBUG nova.compute.manager [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 22:55:27 user nova-compute[72766]: DEBUG nova.compute.manager [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 22:55:27 user nova-compute[72766]: DEBUG nova.network.neutron [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 22:55:27 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 22:55:27 user nova-compute[72766]: DEBUG nova.compute.manager [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 22:55:27 user sudo[82346]: pam_unix(sudo:session): session closed for user root
Aug 14 22:55:27 user nova-compute[72766]: INFO oslo.privsep.daemon [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Spawned new privsep daemon via rootwrap
Aug 14 22:55:27 user nova-compute[72766]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 14 22:55:27 user nova-compute[72766]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 14 22:55:27 user nova-compute[72766]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 14 22:55:27 user nova-compute[72766]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82365
Aug 14 22:55:27 user nova-compute[72766]: WARNING oslo_privsep.priv_context [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] privsep daemon already running
Aug 14 22:55:27 user nova-compute[72766]: DEBUG nova.compute.manager [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 22:55:27 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 22:55:27 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Creating image(s)
Aug 14 22:55:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Acquiring lock "/opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lock "/opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lock "/opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:55:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:55:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:55:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:55:27 user nova-compute[72766]: DEBUG nova.policy [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76b70ec93e9c47d7a4c224fb05c52fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6942d31258304de68c9f7f8bb9304acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 22:55:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.188s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:55:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Acquiring lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:55:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.213s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:55:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Acquiring lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.200s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:55:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Acquiring lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.210s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:55:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa/disk 1073741824 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:55:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa/disk 1073741824" returned: 0 in 0.257s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:55:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.471s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:55:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:55:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.453s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG nova.network.neutron [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Successfully created port: 1663df0b-566c-4588-a5e1-5082de0e3bcf {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.190s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Checking if we can resize image /opt/stack/data/nova/instances/023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa/disk. size=1073741824 {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.233s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk 1073741824 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk 1073741824" returned: 0 in 0.050s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.759s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Cannot resize image /opt/stack/data/nova/instances/023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa/disk to a smaller size. {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG nova.objects.instance [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Lazy-loading 'migration_context' on Instance uuid 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Ensure instance console log exists: /opt/stack/data/nova/instances/023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.209s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Checking if we can resize image /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk. size=1073741824 {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.254s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641/disk 1073741824 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641/disk 1073741824" returned: 0 in 0.058s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.319s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Cannot resize image /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk to a smaller size. {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG nova.objects.instance [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lazy-loading 'migration_context' on Instance uuid 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Ensure instance console log exists: /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.222s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641/disk. size=1073741824 {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Cannot resize image /opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641/disk to a smaller size. {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG nova.objects.instance [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Lazy-loading 'migration_context' on Instance uuid b563c62d-d117-4bb5-9157-7387c51ed641 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Ensure instance console log exists: /opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:55:29 user nova-compute[72766]: DEBUG nova.network.neutron [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Successfully updated port: 098d7854-a4f9-4a29-ad8d-552083e4cf23 {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 22:55:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Acquiring lock "refresh_cache-023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:55:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Acquired lock "refresh_cache-023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:55:29 user nova-compute[72766]: DEBUG nova.network.neutron [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:55:29 user nova-compute[72766]: DEBUG nova.network.neutron [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 22:55:29 user nova-compute[72766]: DEBUG nova.compute.manager [req-070be871-872b-45b6-b2ae-d43e61632d63 req-ec949bd1-7ca5-4c71-b2d8-23385464f7fa service nova] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Received event network-changed-098d7854-a4f9-4a29-ad8d-552083e4cf23 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:55:29 user nova-compute[72766]: DEBUG nova.compute.manager [req-070be871-872b-45b6-b2ae-d43e61632d63 req-ec949bd1-7ca5-4c71-b2d8-23385464f7fa service nova] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Refreshing instance network info cache due to event network-changed-098d7854-a4f9-4a29-ad8d-552083e4cf23. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:55:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-070be871-872b-45b6-b2ae-d43e61632d63 req-ec949bd1-7ca5-4c71-b2d8-23385464f7fa service nova] Acquiring lock "refresh_cache-023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:55:30 user nova-compute[72766]: DEBUG nova.network.neutron [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Updating instance_info_cache with network_info: [{"id": "098d7854-a4f9-4a29-ad8d-552083e4cf23", "address": "fa:16:3e:50:0b:52", "network": {"id": "aedbfcc5-5c6c-4eba-9533-aa5e618d1f4c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1720375606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c9d8bf74b94b4c9d82ec1308a7036e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap098d7854-a4", "ovs_interfaceid": "098d7854-a4f9-4a29-ad8d-552083e4cf23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:55:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Releasing lock "refresh_cache-023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:55:30 user nova-compute[72766]: DEBUG nova.compute.manager [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Instance network_info: |[{"id": "098d7854-a4f9-4a29-ad8d-552083e4cf23", "address": "fa:16:3e:50:0b:52", "network": {"id": "aedbfcc5-5c6c-4eba-9533-aa5e618d1f4c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1720375606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c9d8bf74b94b4c9d82ec1308a7036e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap098d7854-a4", "ovs_interfaceid": "098d7854-a4f9-4a29-ad8d-552083e4cf23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 22:55:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-070be871-872b-45b6-b2ae-d43e61632d63 req-ec949bd1-7ca5-4c71-b2d8-23385464f7fa service nova] Acquired lock "refresh_cache-023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:55:30 user nova-compute[72766]: DEBUG nova.network.neutron [req-070be871-872b-45b6-b2ae-d43e61632d63 req-ec949bd1-7ca5-4c71-b2d8-23385464f7fa service nova] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Refreshing network info cache for port 098d7854-a4f9-4a29-ad8d-552083e4cf23 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:55:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Start _get_guest_xml network_info=[{"id": "098d7854-a4f9-4a29-ad8d-552083e4cf23", "address": "fa:16:3e:50:0b:52", "network": {"id": "aedbfcc5-5c6c-4eba-9533-aa5e618d1f4c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1720375606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c9d8bf74b94b4c9d82ec1308a7036e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap098d7854-a4", "ovs_interfaceid": "098d7854-a4f9-4a29-ad8d-552083e4cf23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd2900d30-2c4c-4d57-9135-d45564c0c596'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 22:55:30 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:55:30 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:55:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 22:55:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 22:55:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 22:55:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 22:55:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 22:55:30 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 22:55:30 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 22:55:30 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 22:55:30 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 22:55:30 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 22:55:30 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 22:55:30 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 22:55:30 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 22:55:30 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 22:55:30 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 22:55:30 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 22:55:30 user nova-compute[72766]: DEBUG nova.privsep.utils [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72766) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 22:55:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:55:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-322917443',display_name='tempest-DeleteServersTestJSON-server-322917443',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-322917443',id=1,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77c9d8bf74b94b4c9d82ec1308a7036e',ramdisk_id='',reservation_id='r-8fk0a1kt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1357277735',owner_user_name='tempest-DeleteServersTestJSON-1357277735-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:55:24Z,user_data=None,user_id='0421d92f15f44629b1885a36b4583a92',uuid=023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "098d7854-a4f9-4a29-ad8d-552083e4cf23", "address": "fa:16:3e:50:0b:52", "network": {"id": "aedbfcc5-5c6c-4eba-9533-aa5e618d1f4c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1720375606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c9d8bf74b94b4c9d82ec1308a7036e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap098d7854-a4", "ovs_interfaceid": "098d7854-a4f9-4a29-ad8d-552083e4cf23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 22:55:30 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Converting VIF {"id": "098d7854-a4f9-4a29-ad8d-552083e4cf23", "address": "fa:16:3e:50:0b:52", "network": {"id": "aedbfcc5-5c6c-4eba-9533-aa5e618d1f4c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1720375606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c9d8bf74b94b4c9d82ec1308a7036e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap098d7854-a4", "ovs_interfaceid": "098d7854-a4f9-4a29-ad8d-552083e4cf23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:55:30 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:0b:52,bridge_name='br-int',has_traffic_filtering=True,id=098d7854-a4f9-4a29-ad8d-552083e4cf23,network=Network(aedbfcc5-5c6c-4eba-9533-aa5e618d1f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap098d7854-a4') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:55:30 user nova-compute[72766]: DEBUG nova.objects.instance [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Lazy-loading 'pci_devices' on Instance uuid 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:55:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] End _get_guest_xml xml=<domain type="kvm">
Aug 14 22:55:30 user nova-compute[72766]:   <uuid>023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa</uuid>
Aug 14 22:55:30 user nova-compute[72766]:   <name>instance-00000001</name>
Aug 14 22:55:30 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 22:55:30 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 22:55:30 user nova-compute[72766]:   <metadata>
Aug 14 22:55:30 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:55:30 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 22:55:30 user nova-compute[72766]:       <nova:name>tempest-DeleteServersTestJSON-server-322917443</nova:name>
Aug 14 22:55:30 user nova-compute[72766]:       <nova:creationTime>2023-08-14 22:55:30</nova:creationTime>
Aug 14 22:55:30 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 22:55:30 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 22:55:30 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 22:55:30 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 22:55:30 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:55:30 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 22:55:30 user nova-compute[72766]:       </nova:flavor>
Aug 14 22:55:30 user nova-compute[72766]:       <nova:owner>
Aug 14 22:55:30 user nova-compute[72766]:         <nova:user uuid="0421d92f15f44629b1885a36b4583a92">tempest-DeleteServersTestJSON-1357277735-project-member</nova:user>
Aug 14 22:55:30 user nova-compute[72766]:         <nova:project uuid="77c9d8bf74b94b4c9d82ec1308a7036e">tempest-DeleteServersTestJSON-1357277735</nova:project>
Aug 14 22:55:30 user nova-compute[72766]:       </nova:owner>
Aug 14 22:55:30 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 22:55:30 user nova-compute[72766]:       <nova:ports>
Aug 14 22:55:30 user nova-compute[72766]:         <nova:port uuid="098d7854-a4f9-4a29-ad8d-552083e4cf23">
Aug 14 22:55:30 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 14 22:55:30 user nova-compute[72766]:         </nova:port>
Aug 14 22:55:30 user nova-compute[72766]:       </nova:ports>
Aug 14 22:55:30 user nova-compute[72766]:     </nova:instance>
Aug 14 22:55:30 user nova-compute[72766]:   </metadata>
Aug 14 22:55:30 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 22:55:30 user nova-compute[72766]:     <system>
Aug 14 22:55:30 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 22:55:30 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 22:55:30 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 22:55:30 user nova-compute[72766]:       <entry name="serial">023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa</entry>
Aug 14 22:55:30 user nova-compute[72766]:       <entry name="uuid">023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa</entry>
Aug 14 22:55:30 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 22:55:30 user nova-compute[72766]:     </system>
Aug 14 22:55:30 user nova-compute[72766]:   </sysinfo>
Aug 14 22:55:30 user nova-compute[72766]:   <os>
Aug 14 22:55:30 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 22:55:30 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 22:55:30 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 22:55:30 user nova-compute[72766]:   </os>
Aug 14 22:55:30 user nova-compute[72766]:   <features>
Aug 14 22:55:30 user nova-compute[72766]:     <acpi/>
Aug 14 22:55:30 user nova-compute[72766]:     <apic/>
Aug 14 22:55:30 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 22:55:30 user nova-compute[72766]:   </features>
Aug 14 22:55:30 user nova-compute[72766]:   <clock offset="utc">
Aug 14 22:55:30 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 22:55:30 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 22:55:30 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 22:55:30 user nova-compute[72766]:   </clock>
Aug 14 22:55:30 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 22:55:30 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 22:55:30 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 22:55:30 user nova-compute[72766]:   </cpu>
Aug 14 22:55:30 user nova-compute[72766]:   <devices>
Aug 14 22:55:30 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 22:55:30 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 22:55:30 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa/disk"/>
Aug 14 22:55:30 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 22:55:30 user nova-compute[72766]:     </disk>
Aug 14 22:55:30 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 22:55:30 user nova-compute[72766]:       <mac address="fa:16:3e:50:0b:52"/>
Aug 14 22:55:30 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 22:55:30 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 22:55:30 user nova-compute[72766]:       <target dev="tap098d7854-a4"/>
Aug 14 22:55:30 user nova-compute[72766]:     </interface>
Aug 14 22:55:30 user nova-compute[72766]:     <serial type="pty">
Aug 14 22:55:30 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa/console.log" append="off"/>
Aug 14 22:55:30 user nova-compute[72766]:     </serial>
Aug 14 22:55:30 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 22:55:30 user nova-compute[72766]:     <video>
Aug 14 22:55:30 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 22:55:30 user nova-compute[72766]:     </video>
Aug 14 22:55:30 user nova-compute[72766]:     <rng model="virtio">
Aug 14 22:55:30 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 22:55:30 user nova-compute[72766]:     </rng>
Aug 14 22:55:30 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 22:55:30 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 22:55:30 user nova-compute[72766]:       <stats period="10"/>
Aug 14 22:55:30 user nova-compute[72766]:     </memballoon>
Aug 14 22:55:30 user nova-compute[72766]:   </devices>
Aug 14 22:55:30 user nova-compute[72766]: </domain>
Aug 14 22:55:30 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 22:55:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:55:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-322917443',display_name='tempest-DeleteServersTestJSON-server-322917443',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-322917443',id=1,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77c9d8bf74b94b4c9d82ec1308a7036e',ramdisk_id='',reservation_id='r-8fk0a1kt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1357277735',owner_user_name='tempest-DeleteServersTestJSON-1357277735-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:55:24Z,user_data=None,user_id='0421d92f15f44629b1885a36b4583a92',uuid=023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "098d7854-a4f9-4a29-ad8d-552083e4cf23", "address": "fa:16:3e:50:0b:52", "network": {"id": "aedbfcc5-5c6c-4eba-9533-aa5e618d1f4c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1720375606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c9d8bf74b94b4c9d82ec1308a7036e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap098d7854-a4", "ovs_interfaceid": "098d7854-a4f9-4a29-ad8d-552083e4cf23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 22:55:30 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Converting VIF {"id": "098d7854-a4f9-4a29-ad8d-552083e4cf23", "address": "fa:16:3e:50:0b:52", "network": {"id": "aedbfcc5-5c6c-4eba-9533-aa5e618d1f4c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1720375606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c9d8bf74b94b4c9d82ec1308a7036e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap098d7854-a4", "ovs_interfaceid": "098d7854-a4f9-4a29-ad8d-552083e4cf23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:55:30 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:0b:52,bridge_name='br-int',has_traffic_filtering=True,id=098d7854-a4f9-4a29-ad8d-552083e4cf23,network=Network(aedbfcc5-5c6c-4eba-9533-aa5e618d1f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap098d7854-a4') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:55:30 user nova-compute[72766]: DEBUG os_vif [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:0b:52,bridge_name='br-int',has_traffic_filtering=True,id=098d7854-a4f9-4a29-ad8d-552083e4cf23,network=Network(aedbfcc5-5c6c-4eba-9533-aa5e618d1f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap098d7854-a4') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 22:55:30 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Created schema index Interface.name {{(pid=72766) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 14 22:55:30 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Created schema index Port.name {{(pid=72766) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 14 22:55:30 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Created schema index Bridge.name {{(pid=72766) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 14 22:55:30 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 22:55:30 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [POLLOUT] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:30 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 22:55:30 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:30 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:30 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:30 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:30 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:55:30 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 22:55:30 user nova-compute[72766]: INFO oslo.privsep.daemon [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpman6hr1c/privsep.sock']
Aug 14 22:55:30 user sudo[82419]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpman6hr1c/privsep.sock
Aug 14 22:55:30 user sudo[82419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 14 22:55:30 user nova-compute[72766]: DEBUG nova.network.neutron [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Successfully created port: baa7e0c2-91d4-4077-8405-abb537475df2 {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 22:55:31 user nova-compute[72766]: DEBUG nova.network.neutron [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Successfully updated port: 1663df0b-566c-4588-a5e1-5082de0e3bcf {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 22:55:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Acquiring lock "refresh_cache-b563c62d-d117-4bb5-9157-7387c51ed641" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:55:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Acquired lock "refresh_cache-b563c62d-d117-4bb5-9157-7387c51ed641" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:55:31 user nova-compute[72766]: DEBUG nova.network.neutron [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:55:31 user nova-compute[72766]: DEBUG nova.network.neutron [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 22:55:32 user nova-compute[72766]: DEBUG nova.network.neutron [req-070be871-872b-45b6-b2ae-d43e61632d63 req-ec949bd1-7ca5-4c71-b2d8-23385464f7fa service nova] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Updated VIF entry in instance network info cache for port 098d7854-a4f9-4a29-ad8d-552083e4cf23. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:55:32 user nova-compute[72766]: DEBUG nova.network.neutron [req-070be871-872b-45b6-b2ae-d43e61632d63 req-ec949bd1-7ca5-4c71-b2d8-23385464f7fa service nova] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Updating instance_info_cache with network_info: [{"id": "098d7854-a4f9-4a29-ad8d-552083e4cf23", "address": "fa:16:3e:50:0b:52", "network": {"id": "aedbfcc5-5c6c-4eba-9533-aa5e618d1f4c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1720375606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c9d8bf74b94b4c9d82ec1308a7036e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap098d7854-a4", "ovs_interfaceid": "098d7854-a4f9-4a29-ad8d-552083e4cf23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:55:32 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-070be871-872b-45b6-b2ae-d43e61632d63 req-ec949bd1-7ca5-4c71-b2d8-23385464f7fa service nova] Releasing lock "refresh_cache-023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:55:32 user nova-compute[72766]: DEBUG nova.compute.manager [req-24de6bbe-92e0-4926-bbaf-ea6e82da5968 req-d3228851-bf23-4f05-9513-017e6e97789a service nova] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Received event network-changed-1663df0b-566c-4588-a5e1-5082de0e3bcf {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:55:32 user nova-compute[72766]: DEBUG nova.compute.manager [req-24de6bbe-92e0-4926-bbaf-ea6e82da5968 req-d3228851-bf23-4f05-9513-017e6e97789a service nova] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Refreshing instance network info cache due to event network-changed-1663df0b-566c-4588-a5e1-5082de0e3bcf. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:55:32 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-24de6bbe-92e0-4926-bbaf-ea6e82da5968 req-d3228851-bf23-4f05-9513-017e6e97789a service nova] Acquiring lock "refresh_cache-b563c62d-d117-4bb5-9157-7387c51ed641" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:55:32 user sudo[82419]: pam_unix(sudo:session): session closed for user root
Aug 14 22:55:32 user nova-compute[72766]: INFO oslo.privsep.daemon [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Spawned new privsep daemon via rootwrap
Aug 14 22:55:32 user nova-compute[72766]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 14 22:55:32 user nova-compute[72766]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 14 22:55:32 user nova-compute[72766]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 14 22:55:32 user nova-compute[72766]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82434
Aug 14 22:55:33 user nova-compute[72766]: DEBUG nova.network.neutron [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Updating instance_info_cache with network_info: [{"id": "1663df0b-566c-4588-a5e1-5082de0e3bcf", "address": "fa:16:3e:b7:97:01", "network": {"id": "5464d98e-0483-4d6d-895b-b51c50c0cfd9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-581355694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142137ab929f4e5289b06319af10751b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1663df0b-56", "ovs_interfaceid": "1663df0b-566c-4588-a5e1-5082de0e3bcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Releasing lock "refresh_cache-b563c62d-d117-4bb5-9157-7387c51ed641" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG nova.compute.manager [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Instance network_info: |[{"id": "1663df0b-566c-4588-a5e1-5082de0e3bcf", "address": "fa:16:3e:b7:97:01", "network": {"id": "5464d98e-0483-4d6d-895b-b51c50c0cfd9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-581355694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142137ab929f4e5289b06319af10751b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1663df0b-56", "ovs_interfaceid": "1663df0b-566c-4588-a5e1-5082de0e3bcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-24de6bbe-92e0-4926-bbaf-ea6e82da5968 req-d3228851-bf23-4f05-9513-017e6e97789a service nova] Acquired lock "refresh_cache-b563c62d-d117-4bb5-9157-7387c51ed641" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG nova.network.neutron [req-24de6bbe-92e0-4926-bbaf-ea6e82da5968 req-d3228851-bf23-4f05-9513-017e6e97789a service nova] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Refreshing network info cache for port 1663df0b-566c-4588-a5e1-5082de0e3bcf {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Start _get_guest_xml network_info=[{"id": "1663df0b-566c-4588-a5e1-5082de0e3bcf", "address": "fa:16:3e:b7:97:01", "network": {"id": "5464d98e-0483-4d6d-895b-b51c50c0cfd9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-581355694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142137ab929f4e5289b06319af10751b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1663df0b-56", "ovs_interfaceid": "1663df0b-566c-4588-a5e1-5082de0e3bcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd2900d30-2c4c-4d57-9135-d45564c0c596'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 22:55:33 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:55:33 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:55:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:55:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-171284351',display_name='tempest-ServersNegativeTestJSON-server-171284351',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-171284351',id=2,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='142137ab929f4e5289b06319af10751b',ramdisk_id='',reservation_id='r-upij0d7c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-968182857',owner_user_name='tempest-ServersNegativeTestJSON-968182857-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:55:24Z,user_data=None,user_id='4701a1ef84d94ce99ec55e44c1df9032',uuid=b563c62d-d117-4bb5-9157-7387c51ed641,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1663df0b-566c-4588-a5e1-5082de0e3bcf", "address": "fa:16:3e:b7:97:01", "network": {"id": "5464d98e-0483-4d6d-895b-b51c50c0cfd9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-581355694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142137ab929f4e5289b06319af10751b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1663df0b-56", "ovs_interfaceid": "1663df0b-566c-4588-a5e1-5082de0e3bcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Converting VIF {"id": "1663df0b-566c-4588-a5e1-5082de0e3bcf", "address": "fa:16:3e:b7:97:01", "network": {"id": "5464d98e-0483-4d6d-895b-b51c50c0cfd9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-581355694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142137ab929f4e5289b06319af10751b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1663df0b-56", "ovs_interfaceid": "1663df0b-566c-4588-a5e1-5082de0e3bcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:97:01,bridge_name='br-int',has_traffic_filtering=True,id=1663df0b-566c-4588-a5e1-5082de0e3bcf,network=Network(5464d98e-0483-4d6d-895b-b51c50c0cfd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1663df0b-56') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG nova.objects.instance [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Lazy-loading 'pci_devices' on Instance uuid b563c62d-d117-4bb5-9157-7387c51ed641 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] End _get_guest_xml xml=<domain type="kvm">
Aug 14 22:55:33 user nova-compute[72766]:   <uuid>b563c62d-d117-4bb5-9157-7387c51ed641</uuid>
Aug 14 22:55:33 user nova-compute[72766]:   <name>instance-00000002</name>
Aug 14 22:55:33 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 22:55:33 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 22:55:33 user nova-compute[72766]:   <metadata>
Aug 14 22:55:33 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:55:33 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 22:55:33 user nova-compute[72766]:       <nova:name>tempest-ServersNegativeTestJSON-server-171284351</nova:name>
Aug 14 22:55:33 user nova-compute[72766]:       <nova:creationTime>2023-08-14 22:55:33</nova:creationTime>
Aug 14 22:55:33 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 22:55:33 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 22:55:33 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 22:55:33 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 22:55:33 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:55:33 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 22:55:33 user nova-compute[72766]:       </nova:flavor>
Aug 14 22:55:33 user nova-compute[72766]:       <nova:owner>
Aug 14 22:55:33 user nova-compute[72766]:         <nova:user uuid="4701a1ef84d94ce99ec55e44c1df9032">tempest-ServersNegativeTestJSON-968182857-project-member</nova:user>
Aug 14 22:55:33 user nova-compute[72766]:         <nova:project uuid="142137ab929f4e5289b06319af10751b">tempest-ServersNegativeTestJSON-968182857</nova:project>
Aug 14 22:55:33 user nova-compute[72766]:       </nova:owner>
Aug 14 22:55:33 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 22:55:33 user nova-compute[72766]:       <nova:ports>
Aug 14 22:55:33 user nova-compute[72766]:         <nova:port uuid="1663df0b-566c-4588-a5e1-5082de0e3bcf">
Aug 14 22:55:33 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 14 22:55:33 user nova-compute[72766]:         </nova:port>
Aug 14 22:55:33 user nova-compute[72766]:       </nova:ports>
Aug 14 22:55:33 user nova-compute[72766]:     </nova:instance>
Aug 14 22:55:33 user nova-compute[72766]:   </metadata>
Aug 14 22:55:33 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 22:55:33 user nova-compute[72766]:     <system>
Aug 14 22:55:33 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 22:55:33 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 22:55:33 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 22:55:33 user nova-compute[72766]:       <entry name="serial">b563c62d-d117-4bb5-9157-7387c51ed641</entry>
Aug 14 22:55:33 user nova-compute[72766]:       <entry name="uuid">b563c62d-d117-4bb5-9157-7387c51ed641</entry>
Aug 14 22:55:33 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 22:55:33 user nova-compute[72766]:     </system>
Aug 14 22:55:33 user nova-compute[72766]:   </sysinfo>
Aug 14 22:55:33 user nova-compute[72766]:   <os>
Aug 14 22:55:33 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 22:55:33 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 22:55:33 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 22:55:33 user nova-compute[72766]:   </os>
Aug 14 22:55:33 user nova-compute[72766]:   <features>
Aug 14 22:55:33 user nova-compute[72766]:     <acpi/>
Aug 14 22:55:33 user nova-compute[72766]:     <apic/>
Aug 14 22:55:33 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 22:55:33 user nova-compute[72766]:   </features>
Aug 14 22:55:33 user nova-compute[72766]:   <clock offset="utc">
Aug 14 22:55:33 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 22:55:33 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 22:55:33 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 22:55:33 user nova-compute[72766]:   </clock>
Aug 14 22:55:33 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 22:55:33 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 22:55:33 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 22:55:33 user nova-compute[72766]:   </cpu>
Aug 14 22:55:33 user nova-compute[72766]:   <devices>
Aug 14 22:55:33 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 22:55:33 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 22:55:33 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641/disk"/>
Aug 14 22:55:33 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 22:55:33 user nova-compute[72766]:     </disk>
Aug 14 22:55:33 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 22:55:33 user nova-compute[72766]:       <mac address="fa:16:3e:b7:97:01"/>
Aug 14 22:55:33 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 22:55:33 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 22:55:33 user nova-compute[72766]:       <target dev="tap1663df0b-56"/>
Aug 14 22:55:33 user nova-compute[72766]:     </interface>
Aug 14 22:55:33 user nova-compute[72766]:     <serial type="pty">
Aug 14 22:55:33 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641/console.log" append="off"/>
Aug 14 22:55:33 user nova-compute[72766]:     </serial>
Aug 14 22:55:33 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 22:55:33 user nova-compute[72766]:     <video>
Aug 14 22:55:33 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 22:55:33 user nova-compute[72766]:     </video>
Aug 14 22:55:33 user nova-compute[72766]:     <rng model="virtio">
Aug 14 22:55:33 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 22:55:33 user nova-compute[72766]:     </rng>
Aug 14 22:55:33 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 22:55:33 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 22:55:33 user nova-compute[72766]:       <stats period="10"/>
Aug 14 22:55:33 user nova-compute[72766]:     </memballoon>
Aug 14 22:55:33 user nova-compute[72766]:   </devices>
Aug 14 22:55:33 user nova-compute[72766]: </domain>
Aug 14 22:55:33 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:55:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-171284351',display_name='tempest-ServersNegativeTestJSON-server-171284351',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-171284351',id=2,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='142137ab929f4e5289b06319af10751b',ramdisk_id='',reservation_id='r-upij0d7c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-968182857',owner_user_name='tempest-ServersNegativeTestJSON-968182857-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:55:24Z,user_data=None,user_id='4701a1ef84d94ce99ec55e44c1df9032',uuid=b563c62d-d117-4bb5-9157-7387c51ed641,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1663df0b-566c-4588-a5e1-5082de0e3bcf", "address": "fa:16:3e:b7:97:01", "network": {"id": "5464d98e-0483-4d6d-895b-b51c50c0cfd9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-581355694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142137ab929f4e5289b06319af10751b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1663df0b-56", "ovs_interfaceid": "1663df0b-566c-4588-a5e1-5082de0e3bcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Converting VIF {"id": "1663df0b-566c-4588-a5e1-5082de0e3bcf", "address": "fa:16:3e:b7:97:01", "network": {"id": "5464d98e-0483-4d6d-895b-b51c50c0cfd9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-581355694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142137ab929f4e5289b06319af10751b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1663df0b-56", "ovs_interfaceid": "1663df0b-566c-4588-a5e1-5082de0e3bcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:97:01,bridge_name='br-int',has_traffic_filtering=True,id=1663df0b-566c-4588-a5e1-5082de0e3bcf,network=Network(5464d98e-0483-4d6d-895b-b51c50c0cfd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1663df0b-56') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG os_vif [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:97:01,bridge_name='br-int',has_traffic_filtering=True,id=1663df0b-566c-4588-a5e1-5082de0e3bcf,network=Network(5464d98e-0483-4d6d-895b-b51c50c0cfd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1663df0b-56') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap098d7854-a4, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap098d7854-a4, col_values=(('external_ids', {'iface-id': '098d7854-a4f9-4a29-ad8d-552083e4cf23', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:0b:52', 'vm-uuid': '023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:33 user nova-compute[72766]: INFO os_vif [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:0b:52,bridge_name='br-int',has_traffic_filtering=True,id=098d7854-a4f9-4a29-ad8d-552083e4cf23,network=Network(aedbfcc5-5c6c-4eba-9533-aa5e618d1f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap098d7854-a4')
Aug 14 22:55:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1663df0b-56, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1663df0b-56, col_values=(('external_ids', {'iface-id': '1663df0b-566c-4588-a5e1-5082de0e3bcf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:97:01', 'vm-uuid': 'b563c62d-d117-4bb5-9157-7387c51ed641'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:33 user nova-compute[72766]: INFO os_vif [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:97:01,bridge_name='br-int',has_traffic_filtering=True,id=1663df0b-566c-4588-a5e1-5082de0e3bcf,network=Network(5464d98e-0483-4d6d-895b-b51c50c0cfd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1663df0b-56')
Aug 14 22:55:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] No VIF found with MAC fa:16:3e:50:0b:52, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] No VIF found with MAC fa:16:3e:b7:97:01, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:55:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:34 user nova-compute[72766]: DEBUG nova.network.neutron [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Successfully updated port: baa7e0c2-91d4-4077-8405-abb537475df2 {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 22:55:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Acquiring lock "refresh_cache-87712dfd-d67b-4e5e-a75d-ca2dd7c764b1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:55:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Acquired lock "refresh_cache-87712dfd-d67b-4e5e-a75d-ca2dd7c764b1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:55:34 user nova-compute[72766]: DEBUG nova.network.neutron [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:55:34 user nova-compute[72766]: DEBUG nova.network.neutron [req-24de6bbe-92e0-4926-bbaf-ea6e82da5968 req-d3228851-bf23-4f05-9513-017e6e97789a service nova] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Updated VIF entry in instance network info cache for port 1663df0b-566c-4588-a5e1-5082de0e3bcf. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:55:34 user nova-compute[72766]: DEBUG nova.network.neutron [req-24de6bbe-92e0-4926-bbaf-ea6e82da5968 req-d3228851-bf23-4f05-9513-017e6e97789a service nova] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Updating instance_info_cache with network_info: [{"id": "1663df0b-566c-4588-a5e1-5082de0e3bcf", "address": "fa:16:3e:b7:97:01", "network": {"id": "5464d98e-0483-4d6d-895b-b51c50c0cfd9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-581355694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142137ab929f4e5289b06319af10751b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1663df0b-56", "ovs_interfaceid": "1663df0b-566c-4588-a5e1-5082de0e3bcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:55:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-24de6bbe-92e0-4926-bbaf-ea6e82da5968 req-d3228851-bf23-4f05-9513-017e6e97789a service nova] Releasing lock "refresh_cache-b563c62d-d117-4bb5-9157-7387c51ed641" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:55:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:34 user nova-compute[72766]: DEBUG nova.compute.manager [req-6d56c6ee-d7c7-4dc4-bc1b-28153a54c595 req-c23ccd50-9a89-4c48-b81f-eca16154b828 service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Received event network-changed-baa7e0c2-91d4-4077-8405-abb537475df2 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:55:34 user nova-compute[72766]: DEBUG nova.compute.manager [req-6d56c6ee-d7c7-4dc4-bc1b-28153a54c595 req-c23ccd50-9a89-4c48-b81f-eca16154b828 service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Refreshing instance network info cache due to event network-changed-baa7e0c2-91d4-4077-8405-abb537475df2. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:55:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-6d56c6ee-d7c7-4dc4-bc1b-28153a54c595 req-c23ccd50-9a89-4c48-b81f-eca16154b828 service nova] Acquiring lock "refresh_cache-87712dfd-d67b-4e5e-a75d-ca2dd7c764b1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:55:34 user nova-compute[72766]: DEBUG nova.network.neutron [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 22:55:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:36 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:36 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:36 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:36 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:36 user nova-compute[72766]: DEBUG nova.network.neutron [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Updating instance_info_cache with network_info: [{"id": "baa7e0c2-91d4-4077-8405-abb537475df2", "address": "fa:16:3e:88:35:14", "network": {"id": "aff4f146-97db-4102-abf1-6528e74cad55", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1894452367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6942d31258304de68c9f7f8bb9304acb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa7e0c2-91", "ovs_interfaceid": "baa7e0c2-91d4-4077-8405-abb537475df2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:55:36 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Releasing lock "refresh_cache-87712dfd-d67b-4e5e-a75d-ca2dd7c764b1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:55:36 user nova-compute[72766]: DEBUG nova.compute.manager [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Instance network_info: |[{"id": "baa7e0c2-91d4-4077-8405-abb537475df2", "address": "fa:16:3e:88:35:14", "network": {"id": "aff4f146-97db-4102-abf1-6528e74cad55", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1894452367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6942d31258304de68c9f7f8bb9304acb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa7e0c2-91", "ovs_interfaceid": "baa7e0c2-91d4-4077-8405-abb537475df2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 22:55:36 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-6d56c6ee-d7c7-4dc4-bc1b-28153a54c595 req-c23ccd50-9a89-4c48-b81f-eca16154b828 service nova] Acquired lock "refresh_cache-87712dfd-d67b-4e5e-a75d-ca2dd7c764b1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:55:36 user nova-compute[72766]: DEBUG nova.network.neutron [req-6d56c6ee-d7c7-4dc4-bc1b-28153a54c595 req-c23ccd50-9a89-4c48-b81f-eca16154b828 service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Refreshing network info cache for port baa7e0c2-91d4-4077-8405-abb537475df2 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:55:36 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Start _get_guest_xml network_info=[{"id": "baa7e0c2-91d4-4077-8405-abb537475df2", "address": "fa:16:3e:88:35:14", "network": {"id": "aff4f146-97db-4102-abf1-6528e74cad55", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1894452367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6942d31258304de68c9f7f8bb9304acb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa7e0c2-91", "ovs_interfaceid": "baa7e0c2-91d4-4077-8405-abb537475df2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd2900d30-2c4c-4d57-9135-d45564c0c596'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 22:55:36 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:55:36 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:55:36 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 22:55:36 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 22:55:36 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 22:55:36 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 22:55:36 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 22:55:36 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 22:55:36 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 22:55:36 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 22:55:36 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 22:55:36 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 22:55:36 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 22:55:36 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 22:55:36 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 22:55:36 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 22:55:36 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 22:55:36 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 22:55:36 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:55:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-315419637',display_name='tempest-ServerStableDeviceRescueTest-server-315419637',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-315419637',id=3,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBo4nGfM00D0QCYyQV/cI8aNR3E6ibpD8xD1rxYRn2nwO6hDolWgvqHNcTgNVefuExGkBWELmMo7h+sXUj+Cy6+nJ0NZHfxWlgzBRlgC0eaAYciav7rLbA5/A+RXO8R0rg==',key_name='tempest-keypair-255768832',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6942d31258304de68c9f7f8bb9304acb',ramdisk_id='',reservation_id='r-ry04k9s6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1332966635',owner_user_name='tempest-ServerStableDeviceRescueTest-1332966635-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:55:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76b70ec93e9c47d7a4c224fb05c52fbf',uuid=87712dfd-d67b-4e5e-a75d-ca2dd7c764b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "baa7e0c2-91d4-4077-8405-abb537475df2", "address": "fa:16:3e:88:35:14", "network": {"id": "aff4f146-97db-4102-abf1-6528e74cad55", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1894452367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6942d31258304de68c9f7f8bb9304acb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa7e0c2-91", "ovs_interfaceid": "baa7e0c2-91d4-4077-8405-abb537475df2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 22:55:36 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Converting VIF {"id": "baa7e0c2-91d4-4077-8405-abb537475df2", "address": "fa:16:3e:88:35:14", "network": {"id": "aff4f146-97db-4102-abf1-6528e74cad55", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1894452367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6942d31258304de68c9f7f8bb9304acb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa7e0c2-91", "ovs_interfaceid": "baa7e0c2-91d4-4077-8405-abb537475df2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:55:36 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:35:14,bridge_name='br-int',has_traffic_filtering=True,id=baa7e0c2-91d4-4077-8405-abb537475df2,network=Network(aff4f146-97db-4102-abf1-6528e74cad55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaa7e0c2-91') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:55:36 user nova-compute[72766]: DEBUG nova.objects.instance [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lazy-loading 'pci_devices' on Instance uuid 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:55:36 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] End _get_guest_xml xml=<domain type="kvm">
Aug 14 22:55:36 user nova-compute[72766]:   <uuid>87712dfd-d67b-4e5e-a75d-ca2dd7c764b1</uuid>
Aug 14 22:55:36 user nova-compute[72766]:   <name>instance-00000003</name>
Aug 14 22:55:36 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 22:55:36 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 22:55:36 user nova-compute[72766]:   <metadata>
Aug 14 22:55:36 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:55:36 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 22:55:36 user nova-compute[72766]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-315419637</nova:name>
Aug 14 22:55:36 user nova-compute[72766]:       <nova:creationTime>2023-08-14 22:55:36</nova:creationTime>
Aug 14 22:55:36 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 22:55:36 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 22:55:36 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 22:55:36 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 22:55:36 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:55:36 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 22:55:36 user nova-compute[72766]:       </nova:flavor>
Aug 14 22:55:36 user nova-compute[72766]:       <nova:owner>
Aug 14 22:55:36 user nova-compute[72766]:         <nova:user uuid="76b70ec93e9c47d7a4c224fb05c52fbf">tempest-ServerStableDeviceRescueTest-1332966635-project-member</nova:user>
Aug 14 22:55:36 user nova-compute[72766]:         <nova:project uuid="6942d31258304de68c9f7f8bb9304acb">tempest-ServerStableDeviceRescueTest-1332966635</nova:project>
Aug 14 22:55:36 user nova-compute[72766]:       </nova:owner>
Aug 14 22:55:36 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 22:55:36 user nova-compute[72766]:       <nova:ports>
Aug 14 22:55:36 user nova-compute[72766]:         <nova:port uuid="baa7e0c2-91d4-4077-8405-abb537475df2">
Aug 14 22:55:36 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 22:55:36 user nova-compute[72766]:         </nova:port>
Aug 14 22:55:36 user nova-compute[72766]:       </nova:ports>
Aug 14 22:55:36 user nova-compute[72766]:     </nova:instance>
Aug 14 22:55:36 user nova-compute[72766]:   </metadata>
Aug 14 22:55:36 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 22:55:36 user nova-compute[72766]:     <system>
Aug 14 22:55:36 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 22:55:36 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 22:55:36 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 22:55:36 user nova-compute[72766]:       <entry name="serial">87712dfd-d67b-4e5e-a75d-ca2dd7c764b1</entry>
Aug 14 22:55:36 user nova-compute[72766]:       <entry name="uuid">87712dfd-d67b-4e5e-a75d-ca2dd7c764b1</entry>
Aug 14 22:55:36 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 22:55:36 user nova-compute[72766]:     </system>
Aug 14 22:55:36 user nova-compute[72766]:   </sysinfo>
Aug 14 22:55:36 user nova-compute[72766]:   <os>
Aug 14 22:55:36 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 22:55:36 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 22:55:36 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 22:55:36 user nova-compute[72766]:   </os>
Aug 14 22:55:36 user nova-compute[72766]:   <features>
Aug 14 22:55:36 user nova-compute[72766]:     <acpi/>
Aug 14 22:55:36 user nova-compute[72766]:     <apic/>
Aug 14 22:55:36 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 22:55:36 user nova-compute[72766]:   </features>
Aug 14 22:55:36 user nova-compute[72766]:   <clock offset="utc">
Aug 14 22:55:36 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 22:55:36 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 22:55:36 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 22:55:36 user nova-compute[72766]:   </clock>
Aug 14 22:55:36 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 22:55:36 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 22:55:36 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 22:55:36 user nova-compute[72766]:   </cpu>
Aug 14 22:55:36 user nova-compute[72766]:   <devices>
Aug 14 22:55:36 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 22:55:36 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 22:55:36 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk"/>
Aug 14 22:55:36 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 22:55:36 user nova-compute[72766]:     </disk>
Aug 14 22:55:36 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 22:55:36 user nova-compute[72766]:       <mac address="fa:16:3e:88:35:14"/>
Aug 14 22:55:36 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 22:55:36 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 22:55:36 user nova-compute[72766]:       <target dev="tapbaa7e0c2-91"/>
Aug 14 22:55:36 user nova-compute[72766]:     </interface>
Aug 14 22:55:36 user nova-compute[72766]:     <serial type="pty">
Aug 14 22:55:36 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/console.log" append="off"/>
Aug 14 22:55:36 user nova-compute[72766]:     </serial>
Aug 14 22:55:36 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 22:55:36 user nova-compute[72766]:     <video>
Aug 14 22:55:36 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 22:55:36 user nova-compute[72766]:     </video>
Aug 14 22:55:36 user nova-compute[72766]:     <rng model="virtio">
Aug 14 22:55:36 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 22:55:36 user nova-compute[72766]:     </rng>
Aug 14 22:55:36 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 22:55:36 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 22:55:36 user nova-compute[72766]:       <stats period="10"/>
Aug 14 22:55:36 user nova-compute[72766]:     </memballoon>
Aug 14 22:55:36 user nova-compute[72766]:   </devices>
Aug 14 22:55:36 user nova-compute[72766]: </domain>
Aug 14 22:55:36 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 22:55:36 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:55:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-315419637',display_name='tempest-ServerStableDeviceRescueTest-server-315419637',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-315419637',id=3,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBo4nGfM00D0QCYyQV/cI8aNR3E6ibpD8xD1rxYRn2nwO6hDolWgvqHNcTgNVefuExGkBWELmMo7h+sXUj+Cy6+nJ0NZHfxWlgzBRlgC0eaAYciav7rLbA5/A+RXO8R0rg==',key_name='tempest-keypair-255768832',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6942d31258304de68c9f7f8bb9304acb',ramdisk_id='',reservation_id='r-ry04k9s6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1332966635',owner_user_name='tempest-ServerStableDeviceRescueTest-1332966635-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:55:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76b70ec93e9c47d7a4c224fb05c52fbf',uuid=87712dfd-d67b-4e5e-a75d-ca2dd7c764b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "baa7e0c2-91d4-4077-8405-abb537475df2", "address": "fa:16:3e:88:35:14", "network": {"id": "aff4f146-97db-4102-abf1-6528e74cad55", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1894452367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6942d31258304de68c9f7f8bb9304acb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa7e0c2-91", "ovs_interfaceid": "baa7e0c2-91d4-4077-8405-abb537475df2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 22:55:36 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Converting VIF {"id": "baa7e0c2-91d4-4077-8405-abb537475df2", "address": "fa:16:3e:88:35:14", "network": {"id": "aff4f146-97db-4102-abf1-6528e74cad55", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1894452367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6942d31258304de68c9f7f8bb9304acb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa7e0c2-91", "ovs_interfaceid": "baa7e0c2-91d4-4077-8405-abb537475df2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:55:36 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:35:14,bridge_name='br-int',has_traffic_filtering=True,id=baa7e0c2-91d4-4077-8405-abb537475df2,network=Network(aff4f146-97db-4102-abf1-6528e74cad55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaa7e0c2-91') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:55:36 user nova-compute[72766]: DEBUG os_vif [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:35:14,bridge_name='br-int',has_traffic_filtering=True,id=baa7e0c2-91d4-4077-8405-abb537475df2,network=Network(aff4f146-97db-4102-abf1-6528e74cad55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaa7e0c2-91') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 22:55:36 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:36 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:55:36 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 22:55:36 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:36 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbaa7e0c2-91, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:55:36 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbaa7e0c2-91, col_values=(('external_ids', {'iface-id': 'baa7e0c2-91d4-4077-8405-abb537475df2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:35:14', 'vm-uuid': '87712dfd-d67b-4e5e-a75d-ca2dd7c764b1'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:55:36 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:36 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:55:36 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:36 user nova-compute[72766]: INFO os_vif [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:35:14,bridge_name='br-int',has_traffic_filtering=True,id=baa7e0c2-91d4-4077-8405-abb537475df2,network=Network(aff4f146-97db-4102-abf1-6528e74cad55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaa7e0c2-91')
Aug 14 22:55:36 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:55:36 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] No VIF found with MAC fa:16:3e:88:35:14, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:55:37 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:39 user nova-compute[72766]: DEBUG nova.compute.manager [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 22:55:39 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 22:55:39 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:39 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692053739.1725461, 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:55:39 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] VM Resumed (Lifecycle Event)
Aug 14 22:55:39 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Instance spawned successfully.
Aug 14 22:55:39 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 22:55:39 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:55:39 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:55:39 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:55:39 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:55:39 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:55:39 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:55:39 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:55:39 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:39 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:55:39 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:55:39 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692053739.1727722, 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:55:39 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] VM Started (Lifecycle Event)
Aug 14 22:55:39 user nova-compute[72766]: INFO nova.compute.manager [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Took 15.49 seconds to spawn the instance on the hypervisor.
Aug 14 22:55:39 user nova-compute[72766]: DEBUG nova.compute.manager [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:55:39 user nova-compute[72766]: DEBUG nova.compute.manager [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 22:55:39 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 22:55:39 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Instance spawned successfully.
Aug 14 22:55:39 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 22:55:39 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:55:39 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:55:39 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:55:39 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:55:39 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:55:39 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:55:39 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:55:39 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:55:39 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:55:39 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692053739.3700604, b563c62d-d117-4bb5-9157-7387c51ed641 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:55:39 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] VM Resumed (Lifecycle Event)
Aug 14 22:55:39 user nova-compute[72766]: DEBUG nova.network.neutron [req-6d56c6ee-d7c7-4dc4-bc1b-28153a54c595 req-c23ccd50-9a89-4c48-b81f-eca16154b828 service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Updated VIF entry in instance network info cache for port baa7e0c2-91d4-4077-8405-abb537475df2. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:55:39 user nova-compute[72766]: DEBUG nova.network.neutron [req-6d56c6ee-d7c7-4dc4-bc1b-28153a54c595 req-c23ccd50-9a89-4c48-b81f-eca16154b828 service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Updating instance_info_cache with network_info: [{"id": "baa7e0c2-91d4-4077-8405-abb537475df2", "address": "fa:16:3e:88:35:14", "network": {"id": "aff4f146-97db-4102-abf1-6528e74cad55", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1894452367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6942d31258304de68c9f7f8bb9304acb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa7e0c2-91", "ovs_interfaceid": "baa7e0c2-91d4-4077-8405-abb537475df2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:55:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-6d56c6ee-d7c7-4dc4-bc1b-28153a54c595 req-c23ccd50-9a89-4c48-b81f-eca16154b828 service nova] Releasing lock "refresh_cache-87712dfd-d67b-4e5e-a75d-ca2dd7c764b1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:55:39 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:55:39 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:55:39 user nova-compute[72766]: INFO nova.compute.manager [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Took 14.64 seconds to spawn the instance on the hypervisor.
Aug 14 22:55:39 user nova-compute[72766]: DEBUG nova.compute.manager [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:55:39 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:55:39 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692053739.3742561, b563c62d-d117-4bb5-9157-7387c51ed641 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:55:39 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] VM Started (Lifecycle Event)
Aug 14 22:55:39 user nova-compute[72766]: INFO nova.compute.manager [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Took 16.63 seconds to build instance.
Aug 14 22:55:39 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:55:39 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:55:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d8373a63-7671-419b-8764-3ed548efb9a2 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Lock "023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.844s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:55:39 user nova-compute[72766]: INFO nova.compute.manager [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Took 16.08 seconds to build instance.
Aug 14 22:55:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-78d38f59-6dd6-4dc5-8ff2-9a9405a1e0cb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Lock "b563c62d-d117-4bb5-9157-7387c51ed641" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.225s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:55:40 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692053740.366887, 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:55:40 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] VM Resumed (Lifecycle Event)
Aug 14 22:55:40 user nova-compute[72766]: DEBUG nova.compute.manager [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 22:55:40 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 22:55:40 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:55:40 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Instance spawned successfully.
Aug 14 22:55:40 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 22:55:40 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:55:40 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:55:40 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:55:40 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:55:40 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:55:40 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:55:40 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:55:40 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:55:40 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692053740.3707833, 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:55:40 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] VM Started (Lifecycle Event)
Aug 14 22:55:40 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:55:40 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:55:40 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:55:40 user nova-compute[72766]: INFO nova.compute.manager [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Took 13.51 seconds to spawn the instance on the hypervisor.
Aug 14 22:55:40 user nova-compute[72766]: DEBUG nova.compute.manager [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:55:40 user nova-compute[72766]: INFO nova.compute.manager [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Took 14.44 seconds to build instance.
Aug 14 22:55:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-17af2d8d-8a66-4b59-a7c0-93a2e97beaca tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.594s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:55:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Acquiring lock "0850bb6c-6e3e-4007-8478-8eba53089158" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lock "0850bb6c-6e3e-4007-8478-8eba53089158" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:42 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 22:55:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:42 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 22:55:42 user nova-compute[72766]: INFO nova.compute.claims [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Claim successful on node user
Aug 14 22:55:43 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:55:43 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:55:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.696s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:55:43 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 22:55:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:43 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 22:55:43 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 22:55:43 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 22:55:43 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 22:55:43 user nova-compute[72766]: DEBUG nova.policy [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd7df5fafd6ca47179dec9cd295c46233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a77920bef94526816c1a9c95531cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 22:55:43 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 22:55:43 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 22:55:43 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Creating image(s)
Aug 14 22:55:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Acquiring lock "/opt/stack/data/nova/instances/0850bb6c-6e3e-4007-8478-8eba53089158/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lock "/opt/stack/data/nova/instances/0850bb6c-6e3e-4007-8478-8eba53089158/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lock "/opt/stack/data/nova/instances/0850bb6c-6e3e-4007-8478-8eba53089158/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.014s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:55:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:55:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.219s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:55:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Acquiring lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:55:44 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.312s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:55:44 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/0850bb6c-6e3e-4007-8478-8eba53089158/disk 1073741824 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:55:44 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/0850bb6c-6e3e-4007-8478-8eba53089158/disk 1073741824" returned: 0 in 0.090s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:55:44 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.411s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:55:44 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:55:44 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.278s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:55:44 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0850bb6c-6e3e-4007-8478-8eba53089158/disk. size=1073741824 {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 22:55:44 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0850bb6c-6e3e-4007-8478-8eba53089158/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:55:44 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0850bb6c-6e3e-4007-8478-8eba53089158/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:55:44 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Cannot resize image /opt/stack/data/nova/instances/0850bb6c-6e3e-4007-8478-8eba53089158/disk to a smaller size. {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 22:55:44 user nova-compute[72766]: DEBUG nova.objects.instance [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lazy-loading 'migration_context' on Instance uuid 0850bb6c-6e3e-4007-8478-8eba53089158 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:55:44 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 22:55:44 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Ensure instance console log exists: /opt/stack/data/nova/instances/0850bb6c-6e3e-4007-8478-8eba53089158/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 22:55:44 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:44 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:44 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:55:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:45 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Successfully created port: 9c7ce835-f163-4f4a-bd47-26d5e06ff451 {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 22:55:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:47 user nova-compute[72766]: DEBUG nova.compute.manager [req-51c88234-0b09-48d5-a9e7-93cfd97c6e09 req-7d9d4cf1-f8e4-4649-90f1-3c4bcb743ac2 service nova] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Received event network-vif-plugged-098d7854-a4f9-4a29-ad8d-552083e4cf23 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:55:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-51c88234-0b09-48d5-a9e7-93cfd97c6e09 req-7d9d4cf1-f8e4-4649-90f1-3c4bcb743ac2 service nova] Acquiring lock "023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-51c88234-0b09-48d5-a9e7-93cfd97c6e09 req-7d9d4cf1-f8e4-4649-90f1-3c4bcb743ac2 service nova] Lock "023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-51c88234-0b09-48d5-a9e7-93cfd97c6e09 req-7d9d4cf1-f8e4-4649-90f1-3c4bcb743ac2 service nova] Lock "023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:55:47 user nova-compute[72766]: DEBUG nova.compute.manager [req-51c88234-0b09-48d5-a9e7-93cfd97c6e09 req-7d9d4cf1-f8e4-4649-90f1-3c4bcb743ac2 service nova] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] No waiting events found dispatching network-vif-plugged-098d7854-a4f9-4a29-ad8d-552083e4cf23 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:55:47 user nova-compute[72766]: WARNING nova.compute.manager [req-51c88234-0b09-48d5-a9e7-93cfd97c6e09 req-7d9d4cf1-f8e4-4649-90f1-3c4bcb743ac2 service nova] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Received unexpected event network-vif-plugged-098d7854-a4f9-4a29-ad8d-552083e4cf23 for instance with vm_state active and task_state None.
Aug 14 22:55:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:48 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Successfully updated port: 9c7ce835-f163-4f4a-bd47-26d5e06ff451 {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 22:55:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Acquiring lock "refresh_cache-0850bb6c-6e3e-4007-8478-8eba53089158" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:55:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Acquired lock "refresh_cache-0850bb6c-6e3e-4007-8478-8eba53089158" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:55:48 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:55:48 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 22:55:48 user nova-compute[72766]: DEBUG nova.compute.manager [req-48c3a382-c3aa-4bdd-bd79-1bded65ee8b3 req-82c1f6ff-2a22-4f8a-bd00-0ded801b8c7b service nova] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Received event network-changed-9c7ce835-f163-4f4a-bd47-26d5e06ff451 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:55:48 user nova-compute[72766]: DEBUG nova.compute.manager [req-48c3a382-c3aa-4bdd-bd79-1bded65ee8b3 req-82c1f6ff-2a22-4f8a-bd00-0ded801b8c7b service nova] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Refreshing instance network info cache due to event network-changed-9c7ce835-f163-4f4a-bd47-26d5e06ff451. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:55:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-48c3a382-c3aa-4bdd-bd79-1bded65ee8b3 req-82c1f6ff-2a22-4f8a-bd00-0ded801b8c7b service nova] Acquiring lock "refresh_cache-0850bb6c-6e3e-4007-8478-8eba53089158" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:55:49 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Updating instance_info_cache with network_info: [{"id": "9c7ce835-f163-4f4a-bd47-26d5e06ff451", "address": "fa:16:3e:38:75:a9", "network": {"id": "9bdd38f5-9734-4c5a-8a1c-5296215e6944", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1610393487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61a77920bef94526816c1a9c95531cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7ce835-f1", "ovs_interfaceid": "9c7ce835-f163-4f4a-bd47-26d5e06ff451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:55:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Releasing lock "refresh_cache-0850bb6c-6e3e-4007-8478-8eba53089158" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:55:49 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Instance network_info: |[{"id": "9c7ce835-f163-4f4a-bd47-26d5e06ff451", "address": "fa:16:3e:38:75:a9", "network": {"id": "9bdd38f5-9734-4c5a-8a1c-5296215e6944", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1610393487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61a77920bef94526816c1a9c95531cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7ce835-f1", "ovs_interfaceid": "9c7ce835-f163-4f4a-bd47-26d5e06ff451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 22:55:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-48c3a382-c3aa-4bdd-bd79-1bded65ee8b3 req-82c1f6ff-2a22-4f8a-bd00-0ded801b8c7b service nova] Acquired lock "refresh_cache-0850bb6c-6e3e-4007-8478-8eba53089158" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:55:49 user nova-compute[72766]: DEBUG nova.network.neutron [req-48c3a382-c3aa-4bdd-bd79-1bded65ee8b3 req-82c1f6ff-2a22-4f8a-bd00-0ded801b8c7b service nova] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Refreshing network info cache for port 9c7ce835-f163-4f4a-bd47-26d5e06ff451 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:55:49 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Start _get_guest_xml network_info=[{"id": "9c7ce835-f163-4f4a-bd47-26d5e06ff451", "address": "fa:16:3e:38:75:a9", "network": {"id": "9bdd38f5-9734-4c5a-8a1c-5296215e6944", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1610393487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61a77920bef94526816c1a9c95531cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7ce835-f1", "ovs_interfaceid": "9c7ce835-f163-4f4a-bd47-26d5e06ff451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd2900d30-2c4c-4d57-9135-d45564c0c596'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 22:55:49 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:55:49 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:55:49 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 22:55:49 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 22:55:49 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 22:55:49 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 22:55:49 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 22:55:49 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 22:55:49 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 22:55:49 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 22:55:49 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 22:55:49 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 22:55:49 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 22:55:49 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 22:55:49 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 22:55:49 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 22:55:49 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 22:55:49 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 22:55:49 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:55:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1199111164',display_name='tempest-VolumesAdminNegativeTest-server-1199111164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1199111164',id=4,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKscx0W5tsfUh4bXGIBtAwBDMFfny4vbkncDw1/ponDrbPfWg+ZWPoWUnztMgmYr+df3EkK7oDm/K4We5xOWgKz+OsVYZgd+z7QnzX3Fejs56HmJrNxo3evVaP8WPz0uew==',key_name='tempest-keypair-1632503232',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61a77920bef94526816c1a9c95531cb2',ramdisk_id='',reservation_id='r-wfudu0yb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1115082797',owner_user_name='tempest-VolumesAdminNegativeTest-1115082797-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:55:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7df5fafd6ca47179dec9cd295c46233',uuid=0850bb6c-6e3e-4007-8478-8eba53089158,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c7ce835-f163-4f4a-bd47-26d5e06ff451", "address": "fa:16:3e:38:75:a9", "network": {"id": "9bdd38f5-9734-4c5a-8a1c-5296215e6944", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1610393487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61a77920bef94526816c1a9c95531cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7ce835-f1", "ovs_interfaceid": "9c7ce835-f163-4f4a-bd47-26d5e06ff451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 22:55:49 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Converting VIF {"id": "9c7ce835-f163-4f4a-bd47-26d5e06ff451", "address": "fa:16:3e:38:75:a9", "network": {"id": "9bdd38f5-9734-4c5a-8a1c-5296215e6944", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1610393487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61a77920bef94526816c1a9c95531cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7ce835-f1", "ovs_interfaceid": "9c7ce835-f163-4f4a-bd47-26d5e06ff451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:55:49 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:75:a9,bridge_name='br-int',has_traffic_filtering=True,id=9c7ce835-f163-4f4a-bd47-26d5e06ff451,network=Network(9bdd38f5-9734-4c5a-8a1c-5296215e6944),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c7ce835-f1') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:55:49 user nova-compute[72766]: DEBUG nova.objects.instance [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lazy-loading 'pci_devices' on Instance uuid 0850bb6c-6e3e-4007-8478-8eba53089158 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:55:49 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] End _get_guest_xml xml=<domain type="kvm">
Aug 14 22:55:49 user nova-compute[72766]:   <uuid>0850bb6c-6e3e-4007-8478-8eba53089158</uuid>
Aug 14 22:55:49 user nova-compute[72766]:   <name>instance-00000004</name>
Aug 14 22:55:49 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 22:55:49 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 22:55:49 user nova-compute[72766]:   <metadata>
Aug 14 22:55:49 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:55:49 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 22:55:49 user nova-compute[72766]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1199111164</nova:name>
Aug 14 22:55:49 user nova-compute[72766]:       <nova:creationTime>2023-08-14 22:55:49</nova:creationTime>
Aug 14 22:55:49 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 22:55:49 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 22:55:49 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 22:55:49 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 22:55:49 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:55:49 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 22:55:49 user nova-compute[72766]:       </nova:flavor>
Aug 14 22:55:49 user nova-compute[72766]:       <nova:owner>
Aug 14 22:55:49 user nova-compute[72766]:         <nova:user uuid="d7df5fafd6ca47179dec9cd295c46233">tempest-VolumesAdminNegativeTest-1115082797-project-member</nova:user>
Aug 14 22:55:49 user nova-compute[72766]:         <nova:project uuid="61a77920bef94526816c1a9c95531cb2">tempest-VolumesAdminNegativeTest-1115082797</nova:project>
Aug 14 22:55:49 user nova-compute[72766]:       </nova:owner>
Aug 14 22:55:49 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 22:55:49 user nova-compute[72766]:       <nova:ports>
Aug 14 22:55:49 user nova-compute[72766]:         <nova:port uuid="9c7ce835-f163-4f4a-bd47-26d5e06ff451">
Aug 14 22:55:49 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 22:55:49 user nova-compute[72766]:         </nova:port>
Aug 14 22:55:49 user nova-compute[72766]:       </nova:ports>
Aug 14 22:55:49 user nova-compute[72766]:     </nova:instance>
Aug 14 22:55:49 user nova-compute[72766]:   </metadata>
Aug 14 22:55:49 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 22:55:49 user nova-compute[72766]:     <system>
Aug 14 22:55:49 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 22:55:49 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 22:55:49 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 22:55:49 user nova-compute[72766]:       <entry name="serial">0850bb6c-6e3e-4007-8478-8eba53089158</entry>
Aug 14 22:55:49 user nova-compute[72766]:       <entry name="uuid">0850bb6c-6e3e-4007-8478-8eba53089158</entry>
Aug 14 22:55:49 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 22:55:49 user nova-compute[72766]:     </system>
Aug 14 22:55:49 user nova-compute[72766]:   </sysinfo>
Aug 14 22:55:49 user nova-compute[72766]:   <os>
Aug 14 22:55:49 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 22:55:49 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 22:55:49 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 22:55:49 user nova-compute[72766]:   </os>
Aug 14 22:55:49 user nova-compute[72766]:   <features>
Aug 14 22:55:49 user nova-compute[72766]:     <acpi/>
Aug 14 22:55:49 user nova-compute[72766]:     <apic/>
Aug 14 22:55:49 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 22:55:49 user nova-compute[72766]:   </features>
Aug 14 22:55:49 user nova-compute[72766]:   <clock offset="utc">
Aug 14 22:55:49 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 22:55:49 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 22:55:49 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 22:55:49 user nova-compute[72766]:   </clock>
Aug 14 22:55:49 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 22:55:49 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 22:55:49 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 22:55:49 user nova-compute[72766]:   </cpu>
Aug 14 22:55:49 user nova-compute[72766]:   <devices>
Aug 14 22:55:49 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 22:55:49 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 22:55:49 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/0850bb6c-6e3e-4007-8478-8eba53089158/disk"/>
Aug 14 22:55:49 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 22:55:49 user nova-compute[72766]:     </disk>
Aug 14 22:55:49 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 22:55:49 user nova-compute[72766]:       <mac address="fa:16:3e:38:75:a9"/>
Aug 14 22:55:49 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 22:55:49 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 22:55:49 user nova-compute[72766]:       <target dev="tap9c7ce835-f1"/>
Aug 14 22:55:49 user nova-compute[72766]:     </interface>
Aug 14 22:55:49 user nova-compute[72766]:     <serial type="pty">
Aug 14 22:55:49 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/0850bb6c-6e3e-4007-8478-8eba53089158/console.log" append="off"/>
Aug 14 22:55:49 user nova-compute[72766]:     </serial>
Aug 14 22:55:49 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 22:55:49 user nova-compute[72766]:     <video>
Aug 14 22:55:49 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 22:55:49 user nova-compute[72766]:     </video>
Aug 14 22:55:49 user nova-compute[72766]:     <rng model="virtio">
Aug 14 22:55:49 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 22:55:49 user nova-compute[72766]:     </rng>
Aug 14 22:55:49 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 22:55:49 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 22:55:49 user nova-compute[72766]:       <stats period="10"/>
Aug 14 22:55:49 user nova-compute[72766]:     </memballoon>
Aug 14 22:55:49 user nova-compute[72766]:   </devices>
Aug 14 22:55:49 user nova-compute[72766]: </domain>
Aug 14 22:55:49 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 22:55:49 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:55:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1199111164',display_name='tempest-VolumesAdminNegativeTest-server-1199111164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1199111164',id=4,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKscx0W5tsfUh4bXGIBtAwBDMFfny4vbkncDw1/ponDrbPfWg+ZWPoWUnztMgmYr+df3EkK7oDm/K4We5xOWgKz+OsVYZgd+z7QnzX3Fejs56HmJrNxo3evVaP8WPz0uew==',key_name='tempest-keypair-1632503232',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61a77920bef94526816c1a9c95531cb2',ramdisk_id='',reservation_id='r-wfudu0yb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1115082797',owner_user_name='tempest-VolumesAdminNegativeTest-1115082797-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:55:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7df5fafd6ca47179dec9cd295c46233',uuid=0850bb6c-6e3e-4007-8478-8eba53089158,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c7ce835-f163-4f4a-bd47-26d5e06ff451", "address": "fa:16:3e:38:75:a9", "network": {"id": "9bdd38f5-9734-4c5a-8a1c-5296215e6944", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1610393487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61a77920bef94526816c1a9c95531cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7ce835-f1", "ovs_interfaceid": "9c7ce835-f163-4f4a-bd47-26d5e06ff451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 22:55:49 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Converting VIF {"id": "9c7ce835-f163-4f4a-bd47-26d5e06ff451", "address": "fa:16:3e:38:75:a9", "network": {"id": "9bdd38f5-9734-4c5a-8a1c-5296215e6944", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1610393487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61a77920bef94526816c1a9c95531cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7ce835-f1", "ovs_interfaceid": "9c7ce835-f163-4f4a-bd47-26d5e06ff451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:55:49 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:75:a9,bridge_name='br-int',has_traffic_filtering=True,id=9c7ce835-f163-4f4a-bd47-26d5e06ff451,network=Network(9bdd38f5-9734-4c5a-8a1c-5296215e6944),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c7ce835-f1') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:55:49 user nova-compute[72766]: DEBUG os_vif [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:75:a9,bridge_name='br-int',has_traffic_filtering=True,id=9c7ce835-f163-4f4a-bd47-26d5e06ff451,network=Network(9bdd38f5-9734-4c5a-8a1c-5296215e6944),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c7ce835-f1') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 22:55:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:55:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 22:55:49 user nova-compute[72766]: DEBUG nova.compute.manager [req-83667c13-ac99-4c05-906a-a3bdde3f5e47 req-aa35c514-ef57-43d8-af74-eed195982b27 service nova] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Received event network-vif-plugged-098d7854-a4f9-4a29-ad8d-552083e4cf23 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:55:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-83667c13-ac99-4c05-906a-a3bdde3f5e47 req-aa35c514-ef57-43d8-af74-eed195982b27 service nova] Acquiring lock "023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-83667c13-ac99-4c05-906a-a3bdde3f5e47 req-aa35c514-ef57-43d8-af74-eed195982b27 service nova] Lock "023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-83667c13-ac99-4c05-906a-a3bdde3f5e47 req-aa35c514-ef57-43d8-af74-eed195982b27 service nova] Lock "023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:55:49 user nova-compute[72766]: DEBUG nova.compute.manager [req-83667c13-ac99-4c05-906a-a3bdde3f5e47 req-aa35c514-ef57-43d8-af74-eed195982b27 service nova] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] No waiting events found dispatching network-vif-plugged-098d7854-a4f9-4a29-ad8d-552083e4cf23 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:55:49 user nova-compute[72766]: WARNING nova.compute.manager [req-83667c13-ac99-4c05-906a-a3bdde3f5e47 req-aa35c514-ef57-43d8-af74-eed195982b27 service nova] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Received unexpected event network-vif-plugged-098d7854-a4f9-4a29-ad8d-552083e4cf23 for instance with vm_state active and task_state None.
Aug 14 22:55:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c7ce835-f1, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:55:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9c7ce835-f1, col_values=(('external_ids', {'iface-id': '9c7ce835-f163-4f4a-bd47-26d5e06ff451', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:75:a9', 'vm-uuid': '0850bb6c-6e3e-4007-8478-8eba53089158'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:55:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:55:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:49 user nova-compute[72766]: INFO os_vif [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:75:a9,bridge_name='br-int',has_traffic_filtering=True,id=9c7ce835-f163-4f4a-bd47-26d5e06ff451,network=Network(9bdd38f5-9734-4c5a-8a1c-5296215e6944),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c7ce835-f1')
Aug 14 22:55:49 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:55:49 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] No VIF found with MAC fa:16:3e:38:75:a9, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:55:50 user nova-compute[72766]: DEBUG nova.network.neutron [req-48c3a382-c3aa-4bdd-bd79-1bded65ee8b3 req-82c1f6ff-2a22-4f8a-bd00-0ded801b8c7b service nova] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Updated VIF entry in instance network info cache for port 9c7ce835-f163-4f4a-bd47-26d5e06ff451. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:55:50 user nova-compute[72766]: DEBUG nova.network.neutron [req-48c3a382-c3aa-4bdd-bd79-1bded65ee8b3 req-82c1f6ff-2a22-4f8a-bd00-0ded801b8c7b service nova] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Updating instance_info_cache with network_info: [{"id": "9c7ce835-f163-4f4a-bd47-26d5e06ff451", "address": "fa:16:3e:38:75:a9", "network": {"id": "9bdd38f5-9734-4c5a-8a1c-5296215e6944", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1610393487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61a77920bef94526816c1a9c95531cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7ce835-f1", "ovs_interfaceid": "9c7ce835-f163-4f4a-bd47-26d5e06ff451", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:55:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-48c3a382-c3aa-4bdd-bd79-1bded65ee8b3 req-82c1f6ff-2a22-4f8a-bd00-0ded801b8c7b service nova] Releasing lock "refresh_cache-0850bb6c-6e3e-4007-8478-8eba53089158" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:55:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Acquiring lock "40cd301a-97f2-4f02-b091-f5a2bb1cd016" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Lock "40cd301a-97f2-4f02-b091-f5a2bb1cd016" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:52 user nova-compute[72766]: DEBUG nova.compute.manager [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 22:55:52 user nova-compute[72766]: DEBUG nova.compute.manager [req-0a2f58da-4f9f-496d-b152-ddfce5991bf2 req-b0bf3e2f-6343-432b-8ab4-916ec6d41c31 service nova] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Received event network-vif-plugged-1663df0b-566c-4588-a5e1-5082de0e3bcf {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:55:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0a2f58da-4f9f-496d-b152-ddfce5991bf2 req-b0bf3e2f-6343-432b-8ab4-916ec6d41c31 service nova] Acquiring lock "b563c62d-d117-4bb5-9157-7387c51ed641-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0a2f58da-4f9f-496d-b152-ddfce5991bf2 req-b0bf3e2f-6343-432b-8ab4-916ec6d41c31 service nova] Lock "b563c62d-d117-4bb5-9157-7387c51ed641-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0a2f58da-4f9f-496d-b152-ddfce5991bf2 req-b0bf3e2f-6343-432b-8ab4-916ec6d41c31 service nova] Lock "b563c62d-d117-4bb5-9157-7387c51ed641-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:55:52 user nova-compute[72766]: DEBUG nova.compute.manager [req-0a2f58da-4f9f-496d-b152-ddfce5991bf2 req-b0bf3e2f-6343-432b-8ab4-916ec6d41c31 service nova] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] No waiting events found dispatching network-vif-plugged-1663df0b-566c-4588-a5e1-5082de0e3bcf {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:55:52 user nova-compute[72766]: WARNING nova.compute.manager [req-0a2f58da-4f9f-496d-b152-ddfce5991bf2 req-b0bf3e2f-6343-432b-8ab4-916ec6d41c31 service nova] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Received unexpected event network-vif-plugged-1663df0b-566c-4588-a5e1-5082de0e3bcf for instance with vm_state active and task_state None.
Aug 14 22:55:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:52 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 22:55:52 user nova-compute[72766]: INFO nova.compute.claims [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Claim successful on node user
Aug 14 22:55:53 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:55:53 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:55:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.517s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:55:53 user nova-compute[72766]: DEBUG nova.compute.manager [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 22:55:53 user nova-compute[72766]: DEBUG nova.compute.manager [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 22:55:53 user nova-compute[72766]: DEBUG nova.network.neutron [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 22:55:53 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 14 22:55:53 user nova-compute[72766]: DEBUG nova.compute.manager [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 22:55:53 user nova-compute[72766]: DEBUG nova.compute.manager [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 22:55:53 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 22:55:53 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Creating image(s)
Aug 14 22:55:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Acquiring lock "/opt/stack/data/nova/instances/40cd301a-97f2-4f02-b091-f5a2bb1cd016/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Lock "/opt/stack/data/nova/instances/40cd301a-97f2-4f02-b091-f5a2bb1cd016/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Lock "/opt/stack/data/nova/instances/40cd301a-97f2-4f02-b091-f5a2bb1cd016/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:55:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Acquiring lock "af38323517183bbf251eed8e619af2df5e4fd250" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Lock "af38323517183bbf251eed8e619af2df5e4fd250" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:53 user nova-compute[72766]: DEBUG nova.policy [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '63b79fe4bc2e4fb68986d0927db750f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85cdad610d1c4f8f9eb3d2677ad62c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 22:55:54 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af38323517183bbf251eed8e619af2df5e4fd250.part --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:55:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:54 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692053754.5003216, 0850bb6c-6e3e-4007-8478-8eba53089158 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:55:54 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] VM Resumed (Lifecycle Event)
Aug 14 22:55:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 22:55:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 22:55:54 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Instance spawned successfully.
Aug 14 22:55:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 22:55:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:55:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:55:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:55:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:55:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:55:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:55:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:55:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:55:54 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:55:54 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692053754.500581, 0850bb6c-6e3e-4007-8478-8eba53089158 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:55:54 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] VM Started (Lifecycle Event)
Aug 14 22:55:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:55:54 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af38323517183bbf251eed8e619af2df5e4fd250.part --force-share --output=json" returned: 0 in 0.277s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:55:54 user nova-compute[72766]: DEBUG nova.virt.images [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] 6965249c-ed43-4d6f-9720-9b9543bc6e36 was qcow2, converting to raw {{(pid=72766) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 22:55:54 user nova-compute[72766]: DEBUG nova.privsep.utils [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72766) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 22:55:54 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/af38323517183bbf251eed8e619af2df5e4fd250.part /opt/stack/data/nova/instances/_base/af38323517183bbf251eed8e619af2df5e4fd250.converted {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:55:54 user nova-compute[72766]: DEBUG nova.compute.manager [req-0b55904e-464d-4b5b-a719-f866c50347d2 req-ab5ab23a-8ba3-4d53-82b8-eca0306db0c6 service nova] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Received event network-vif-plugged-1663df0b-566c-4588-a5e1-5082de0e3bcf {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:55:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0b55904e-464d-4b5b-a719-f866c50347d2 req-ab5ab23a-8ba3-4d53-82b8-eca0306db0c6 service nova] Acquiring lock "b563c62d-d117-4bb5-9157-7387c51ed641-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0b55904e-464d-4b5b-a719-f866c50347d2 req-ab5ab23a-8ba3-4d53-82b8-eca0306db0c6 service nova] Lock "b563c62d-d117-4bb5-9157-7387c51ed641-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0b55904e-464d-4b5b-a719-f866c50347d2 req-ab5ab23a-8ba3-4d53-82b8-eca0306db0c6 service nova] Lock "b563c62d-d117-4bb5-9157-7387c51ed641-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:55:54 user nova-compute[72766]: DEBUG nova.compute.manager [req-0b55904e-464d-4b5b-a719-f866c50347d2 req-ab5ab23a-8ba3-4d53-82b8-eca0306db0c6 service nova] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] No waiting events found dispatching network-vif-plugged-1663df0b-566c-4588-a5e1-5082de0e3bcf {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:55:54 user nova-compute[72766]: WARNING nova.compute.manager [req-0b55904e-464d-4b5b-a719-f866c50347d2 req-ab5ab23a-8ba3-4d53-82b8-eca0306db0c6 service nova] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Received unexpected event network-vif-plugged-1663df0b-566c-4588-a5e1-5082de0e3bcf for instance with vm_state active and task_state None.
Aug 14 22:55:54 user nova-compute[72766]: DEBUG nova.compute.manager [req-0b55904e-464d-4b5b-a719-f866c50347d2 req-ab5ab23a-8ba3-4d53-82b8-eca0306db0c6 service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Received event network-vif-plugged-baa7e0c2-91d4-4077-8405-abb537475df2 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:55:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0b55904e-464d-4b5b-a719-f866c50347d2 req-ab5ab23a-8ba3-4d53-82b8-eca0306db0c6 service nova] Acquiring lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0b55904e-464d-4b5b-a719-f866c50347d2 req-ab5ab23a-8ba3-4d53-82b8-eca0306db0c6 service nova] Lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0b55904e-464d-4b5b-a719-f866c50347d2 req-ab5ab23a-8ba3-4d53-82b8-eca0306db0c6 service nova] Lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:55:54 user nova-compute[72766]: DEBUG nova.compute.manager [req-0b55904e-464d-4b5b-a719-f866c50347d2 req-ab5ab23a-8ba3-4d53-82b8-eca0306db0c6 service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] No waiting events found dispatching network-vif-plugged-baa7e0c2-91d4-4077-8405-abb537475df2 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:55:54 user nova-compute[72766]: WARNING nova.compute.manager [req-0b55904e-464d-4b5b-a719-f866c50347d2 req-ab5ab23a-8ba3-4d53-82b8-eca0306db0c6 service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Received unexpected event network-vif-plugged-baa7e0c2-91d4-4077-8405-abb537475df2 for instance with vm_state active and task_state None.
Aug 14 22:55:54 user nova-compute[72766]: DEBUG nova.compute.manager [req-0b55904e-464d-4b5b-a719-f866c50347d2 req-ab5ab23a-8ba3-4d53-82b8-eca0306db0c6 service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Received event network-vif-plugged-baa7e0c2-91d4-4077-8405-abb537475df2 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:55:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0b55904e-464d-4b5b-a719-f866c50347d2 req-ab5ab23a-8ba3-4d53-82b8-eca0306db0c6 service nova] Acquiring lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0b55904e-464d-4b5b-a719-f866c50347d2 req-ab5ab23a-8ba3-4d53-82b8-eca0306db0c6 service nova] Lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0b55904e-464d-4b5b-a719-f866c50347d2 req-ab5ab23a-8ba3-4d53-82b8-eca0306db0c6 service nova] Lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:55:54 user nova-compute[72766]: DEBUG nova.compute.manager [req-0b55904e-464d-4b5b-a719-f866c50347d2 req-ab5ab23a-8ba3-4d53-82b8-eca0306db0c6 service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] No waiting events found dispatching network-vif-plugged-baa7e0c2-91d4-4077-8405-abb537475df2 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:55:54 user nova-compute[72766]: WARNING nova.compute.manager [req-0b55904e-464d-4b5b-a719-f866c50347d2 req-ab5ab23a-8ba3-4d53-82b8-eca0306db0c6 service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Received unexpected event network-vif-plugged-baa7e0c2-91d4-4077-8405-abb537475df2 for instance with vm_state active and task_state None.
Aug 14 22:55:54 user nova-compute[72766]: INFO nova.compute.manager [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Took 11.33 seconds to spawn the instance on the hypervisor.
Aug 14 22:55:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:55:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:55:55 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:55:55 user nova-compute[72766]: INFO nova.compute.manager [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Took 12.61 seconds to build instance.
Aug 14 22:55:55 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/af38323517183bbf251eed8e619af2df5e4fd250.part /opt/stack/data/nova/instances/_base/af38323517183bbf251eed8e619af2df5e4fd250.converted" returned: 0 in 0.287s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:55:55 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af38323517183bbf251eed8e619af2df5e4fd250.converted --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:55:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c1534405-a399-40bb-8579-6e52c4572785 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lock "0850bb6c-6e3e-4007-8478-8eba53089158" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.935s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:55:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Acquiring lock "90b55775-2f14-4c80-b48a-b1eed2b570dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Lock "90b55775-2f14-4c80-b48a-b1eed2b570dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:55 user nova-compute[72766]: DEBUG nova.compute.manager [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 22:55:55 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af38323517183bbf251eed8e619af2df5e4fd250.converted --force-share --output=json" returned: 0 in 0.225s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:55:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Lock "af38323517183bbf251eed8e619af2df5e4fd250" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.757s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:55:55 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af38323517183bbf251eed8e619af2df5e4fd250 --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:55:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:55 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 22:55:55 user nova-compute[72766]: INFO nova.compute.claims [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Claim successful on node user
Aug 14 22:55:55 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af38323517183bbf251eed8e619af2df5e4fd250 --force-share --output=json" returned: 0 in 0.255s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:55:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Acquiring lock "af38323517183bbf251eed8e619af2df5e4fd250" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Lock "af38323517183bbf251eed8e619af2df5e4fd250" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:55 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af38323517183bbf251eed8e619af2df5e4fd250 --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:55:55 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af38323517183bbf251eed8e619af2df5e4fd250 --force-share --output=json" returned: 0 in 0.278s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:55:55 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af38323517183bbf251eed8e619af2df5e4fd250,backing_fmt=raw /opt/stack/data/nova/instances/40cd301a-97f2-4f02-b091-f5a2bb1cd016/disk 1073741824 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:55:56 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:55:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af38323517183bbf251eed8e619af2df5e4fd250,backing_fmt=raw /opt/stack/data/nova/instances/40cd301a-97f2-4f02-b091-f5a2bb1cd016/disk 1073741824" returned: 0 in 0.093s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:55:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Lock "af38323517183bbf251eed8e619af2df5e4fd250" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.376s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:55:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af38323517183bbf251eed8e619af2df5e4fd250 --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:55:56 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:55:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.706s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:55:56 user nova-compute[72766]: DEBUG nova.compute.manager [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 22:55:56 user nova-compute[72766]: DEBUG nova.compute.manager [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 22:55:56 user nova-compute[72766]: DEBUG nova.network.neutron [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 22:55:56 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 22:55:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af38323517183bbf251eed8e619af2df5e4fd250 --force-share --output=json" returned: 0 in 0.296s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:55:56 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Checking if we can resize image /opt/stack/data/nova/instances/40cd301a-97f2-4f02-b091-f5a2bb1cd016/disk. size=1073741824 {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 22:55:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40cd301a-97f2-4f02-b091-f5a2bb1cd016/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:55:56 user nova-compute[72766]: DEBUG nova.compute.manager [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 22:55:56 user nova-compute[72766]: DEBUG nova.network.neutron [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Successfully created port: 9406f951-b950-463d-9574-104a83b25e7d {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 22:55:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40cd301a-97f2-4f02-b091-f5a2bb1cd016/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:55:56 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Cannot resize image /opt/stack/data/nova/instances/40cd301a-97f2-4f02-b091-f5a2bb1cd016/disk to a smaller size. {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 22:55:56 user nova-compute[72766]: DEBUG nova.objects.instance [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Lazy-loading 'migration_context' on Instance uuid 40cd301a-97f2-4f02-b091-f5a2bb1cd016 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:55:56 user nova-compute[72766]: DEBUG nova.policy [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'adf9d286eb5749e7a5278af949ca1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd841b7f732a743658e035777c8629c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 22:55:56 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 22:55:56 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Ensure instance console log exists: /opt/stack/data/nova/instances/40cd301a-97f2-4f02-b091-f5a2bb1cd016/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 22:55:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:55:56 user nova-compute[72766]: DEBUG nova.compute.manager [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 22:55:56 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 22:55:56 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Creating image(s)
Aug 14 22:55:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Acquiring lock "/opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Lock "/opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Lock "/opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:55:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:55:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.260s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:55:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Acquiring lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:55:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.262s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:55:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc/disk 1073741824 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:55:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc/disk 1073741824" returned: 0 in 0.097s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:55:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.370s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:55:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:55:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Acquiring lock "b55141bc-d426-4d35-8ae5-269ece19a793" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Lock "b55141bc-d426-4d35-8ae5-269ece19a793" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:57 user nova-compute[72766]: DEBUG nova.compute.manager [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 22:55:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.250s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:55:57 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Checking if we can resize image /opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc/disk. size=1073741824 {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 22:55:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:55:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:57 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 22:55:57 user nova-compute[72766]: INFO nova.compute.claims [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Claim successful on node user
Aug 14 22:55:57 user nova-compute[72766]: DEBUG nova.network.neutron [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Successfully created port: 58e0b222-3a0a-40d3-ad60-e92985bd3584 {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 22:55:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Acquiring lock "33e6f8aa-bb0d-478d-b7b5-3334302476fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Lock "33e6f8aa-bb0d-478d-b7b5-3334302476fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:57 user nova-compute[72766]: DEBUG nova.network.neutron [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Successfully updated port: 9406f951-b950-463d-9574-104a83b25e7d {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 22:55:57 user nova-compute[72766]: DEBUG nova.compute.manager [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 22:55:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Acquiring lock "refresh_cache-40cd301a-97f2-4f02-b091-f5a2bb1cd016" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:55:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Acquired lock "refresh_cache-40cd301a-97f2-4f02-b091-f5a2bb1cd016" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:55:57 user nova-compute[72766]: DEBUG nova.network.neutron [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:55:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc/disk --force-share --output=json" returned: 0 in 0.295s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:55:57 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Cannot resize image /opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc/disk to a smaller size. {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 22:55:57 user nova-compute[72766]: DEBUG nova.objects.instance [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Lazy-loading 'migration_context' on Instance uuid 90b55775-2f14-4c80-b48a-b1eed2b570dc {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG nova.compute.manager [req-731bf96c-6967-4b23-9661-5d7e19d7b04f req-c612600c-9d38-423e-a404-2beaeaf05499 service nova] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Received event network-changed-9406f951-b950-463d-9574-104a83b25e7d {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG nova.compute.manager [req-731bf96c-6967-4b23-9661-5d7e19d7b04f req-c612600c-9d38-423e-a404-2beaeaf05499 service nova] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Refreshing instance network info cache due to event network-changed-9406f951-b950-463d-9574-104a83b25e7d. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-731bf96c-6967-4b23-9661-5d7e19d7b04f req-c612600c-9d38-423e-a404-2beaeaf05499 service nova] Acquiring lock "refresh_cache-40cd301a-97f2-4f02-b091-f5a2bb1cd016" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Ensure instance console log exists: /opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG nova.network.neutron [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG nova.network.neutron [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Updating instance_info_cache with network_info: [{"id": "9406f951-b950-463d-9574-104a83b25e7d", "address": "fa:16:3e:97:20:81", "network": {"id": "12035bbc-2507-4317-af8b-a71f420b938e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-280915665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85cdad610d1c4f8f9eb3d2677ad62c5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9406f951-b9", "ovs_interfaceid": "9406f951-b950-463d-9574-104a83b25e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Releasing lock "refresh_cache-40cd301a-97f2-4f02-b091-f5a2bb1cd016" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG nova.compute.manager [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Instance network_info: |[{"id": "9406f951-b950-463d-9574-104a83b25e7d", "address": "fa:16:3e:97:20:81", "network": {"id": "12035bbc-2507-4317-af8b-a71f420b938e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-280915665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85cdad610d1c4f8f9eb3d2677ad62c5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9406f951-b9", "ovs_interfaceid": "9406f951-b950-463d-9574-104a83b25e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-731bf96c-6967-4b23-9661-5d7e19d7b04f req-c612600c-9d38-423e-a404-2beaeaf05499 service nova] Acquired lock "refresh_cache-40cd301a-97f2-4f02-b091-f5a2bb1cd016" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG nova.network.neutron [req-731bf96c-6967-4b23-9661-5d7e19d7b04f req-c612600c-9d38-423e-a404-2beaeaf05499 service nova] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Refreshing network info cache for port 9406f951-b950-463d-9574-104a83b25e7d {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Start _get_guest_xml network_info=[{"id": "9406f951-b950-463d-9574-104a83b25e7d", "address": "fa:16:3e:97:20:81", "network": {"id": "12035bbc-2507-4317-af8b-a71f420b938e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-280915665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85cdad610d1c4f8f9eb3d2677ad62c5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9406f951-b9", "ovs_interfaceid": "9406f951-b950-463d-9574-104a83b25e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:55:43Z,direct_url=<?>,disk_format='qcow2',id=6965249c-ed43-4d6f-9720-9b9543bc6e36,min_disk=0,min_ram=0,name='',owner='faca9b317c8f4a5cac90b075f46397f0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'scsi', 'device_name': '/dev/sda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '6965249c-ed43-4d6f-9720-9b9543bc6e36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 22:55:58 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:55:58 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:55:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:55:43Z,direct_url=<?>,disk_format='qcow2',id=6965249c-ed43-4d6f-9720-9b9543bc6e36,min_disk=0,min_ram=0,name='',owner='faca9b317c8f4a5cac90b075f46397f0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T22:55:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1398839154',display_name='tempest-AttachSCSIVolumeTestJSON-server-1398839154',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1398839154',id=5,image_ref='6965249c-ed43-4d6f-9720-9b9543bc6e36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE07CscbRwiFXt4oowixGelS8cd8+TrGRhQZUTn4sQQh6dYhsSP3vBYNaHrOhsecr9RlWR/To/KqS1yieVJ3+g5dSeUHlJ0CvSgPRzoHoeKuUUkhapDJqVUINSaa/HN5tw==',key_name='tempest-keypair-427507318',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85cdad610d1c4f8f9eb3d2677ad62c5c',ramdisk_id='',reservation_id='r-jfsxlmdg',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6965249c-ed43-4d6f-9720-9b9543bc6e36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-455382250',owner_user_name='tempest-AttachSCSIVolumeTestJSON-455382250-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:55:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63b79fe4bc2e4fb68986d0927db750f9',uuid=40cd301a-97f2-4f02-b091-f5a2bb1cd016,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9406f951-b950-463d-9574-104a83b25e7d", "address": "fa:16:3e:97:20:81", "network": {"id": "12035bbc-2507-4317-af8b-a71f420b938e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-280915665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85cdad610d1c4f8f9eb3d2677ad62c5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9406f951-b9", "ovs_interfaceid": "9406f951-b950-463d-9574-104a83b25e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Converting VIF {"id": "9406f951-b950-463d-9574-104a83b25e7d", "address": "fa:16:3e:97:20:81", "network": {"id": "12035bbc-2507-4317-af8b-a71f420b938e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-280915665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85cdad610d1c4f8f9eb3d2677ad62c5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9406f951-b9", "ovs_interfaceid": "9406f951-b950-463d-9574-104a83b25e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:20:81,bridge_name='br-int',has_traffic_filtering=True,id=9406f951-b950-463d-9574-104a83b25e7d,network=Network(12035bbc-2507-4317-af8b-a71f420b938e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9406f951-b9') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG nova.objects.instance [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Lazy-loading 'pci_devices' on Instance uuid 40cd301a-97f2-4f02-b091-f5a2bb1cd016 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] End _get_guest_xml xml=<domain type="kvm">
Aug 14 22:55:58 user nova-compute[72766]:   <uuid>40cd301a-97f2-4f02-b091-f5a2bb1cd016</uuid>
Aug 14 22:55:58 user nova-compute[72766]:   <name>instance-00000005</name>
Aug 14 22:55:58 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 22:55:58 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 22:55:58 user nova-compute[72766]:   <metadata>
Aug 14 22:55:58 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:55:58 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 22:55:58 user nova-compute[72766]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1398839154</nova:name>
Aug 14 22:55:58 user nova-compute[72766]:       <nova:creationTime>2023-08-14 22:55:58</nova:creationTime>
Aug 14 22:55:58 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 22:55:58 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 22:55:58 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 22:55:58 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 22:55:58 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:55:58 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 22:55:58 user nova-compute[72766]:       </nova:flavor>
Aug 14 22:55:58 user nova-compute[72766]:       <nova:owner>
Aug 14 22:55:58 user nova-compute[72766]:         <nova:user uuid="63b79fe4bc2e4fb68986d0927db750f9">tempest-AttachSCSIVolumeTestJSON-455382250-project-member</nova:user>
Aug 14 22:55:58 user nova-compute[72766]:         <nova:project uuid="85cdad610d1c4f8f9eb3d2677ad62c5c">tempest-AttachSCSIVolumeTestJSON-455382250</nova:project>
Aug 14 22:55:58 user nova-compute[72766]:       </nova:owner>
Aug 14 22:55:58 user nova-compute[72766]:       <nova:root type="image" uuid="6965249c-ed43-4d6f-9720-9b9543bc6e36"/>
Aug 14 22:55:58 user nova-compute[72766]:       <nova:ports>
Aug 14 22:55:58 user nova-compute[72766]:         <nova:port uuid="9406f951-b950-463d-9574-104a83b25e7d">
Aug 14 22:55:58 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 22:55:58 user nova-compute[72766]:         </nova:port>
Aug 14 22:55:58 user nova-compute[72766]:       </nova:ports>
Aug 14 22:55:58 user nova-compute[72766]:     </nova:instance>
Aug 14 22:55:58 user nova-compute[72766]:   </metadata>
Aug 14 22:55:58 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 22:55:58 user nova-compute[72766]:     <system>
Aug 14 22:55:58 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 22:55:58 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 22:55:58 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 22:55:58 user nova-compute[72766]:       <entry name="serial">40cd301a-97f2-4f02-b091-f5a2bb1cd016</entry>
Aug 14 22:55:58 user nova-compute[72766]:       <entry name="uuid">40cd301a-97f2-4f02-b091-f5a2bb1cd016</entry>
Aug 14 22:55:58 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 22:55:58 user nova-compute[72766]:     </system>
Aug 14 22:55:58 user nova-compute[72766]:   </sysinfo>
Aug 14 22:55:58 user nova-compute[72766]:   <os>
Aug 14 22:55:58 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 22:55:58 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 22:55:58 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 22:55:58 user nova-compute[72766]:   </os>
Aug 14 22:55:58 user nova-compute[72766]:   <features>
Aug 14 22:55:58 user nova-compute[72766]:     <acpi/>
Aug 14 22:55:58 user nova-compute[72766]:     <apic/>
Aug 14 22:55:58 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 22:55:58 user nova-compute[72766]:   </features>
Aug 14 22:55:58 user nova-compute[72766]:   <clock offset="utc">
Aug 14 22:55:58 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 22:55:58 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 22:55:58 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 22:55:58 user nova-compute[72766]:   </clock>
Aug 14 22:55:58 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 22:55:58 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 22:55:58 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 22:55:58 user nova-compute[72766]:   </cpu>
Aug 14 22:55:58 user nova-compute[72766]:   <devices>
Aug 14 22:55:58 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 22:55:58 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 22:55:58 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/40cd301a-97f2-4f02-b091-f5a2bb1cd016/disk"/>
Aug 14 22:55:58 user nova-compute[72766]:       <target dev="sda" bus="scsi"/>
Aug 14 22:55:58 user nova-compute[72766]:       <address type="drive" controller="0" unit="0"/>
Aug 14 22:55:58 user nova-compute[72766]:     </disk>
Aug 14 22:55:58 user nova-compute[72766]:     <disk type="file" device="cdrom">
Aug 14 22:55:58 user nova-compute[72766]:       <driver name="qemu" type="raw" cache="none"/>
Aug 14 22:55:58 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/40cd301a-97f2-4f02-b091-f5a2bb1cd016/disk.config"/>
Aug 14 22:55:58 user nova-compute[72766]:       <target dev="sdb" bus="scsi"/>
Aug 14 22:55:58 user nova-compute[72766]:       <address type="drive" controller="0" unit="1"/>
Aug 14 22:55:58 user nova-compute[72766]:     </disk>
Aug 14 22:55:58 user nova-compute[72766]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 14 22:55:58 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 22:55:58 user nova-compute[72766]:       <mac address="fa:16:3e:97:20:81"/>
Aug 14 22:55:58 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 22:55:58 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 22:55:58 user nova-compute[72766]:       <target dev="tap9406f951-b9"/>
Aug 14 22:55:58 user nova-compute[72766]:     </interface>
Aug 14 22:55:58 user nova-compute[72766]:     <serial type="pty">
Aug 14 22:55:58 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/40cd301a-97f2-4f02-b091-f5a2bb1cd016/console.log" append="off"/>
Aug 14 22:55:58 user nova-compute[72766]:     </serial>
Aug 14 22:55:58 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 22:55:58 user nova-compute[72766]:     <video>
Aug 14 22:55:58 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 22:55:58 user nova-compute[72766]:     </video>
Aug 14 22:55:58 user nova-compute[72766]:     <rng model="virtio">
Aug 14 22:55:58 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 22:55:58 user nova-compute[72766]:     </rng>
Aug 14 22:55:58 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 22:55:58 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 22:55:58 user nova-compute[72766]:       <stats period="10"/>
Aug 14 22:55:58 user nova-compute[72766]:     </memballoon>
Aug 14 22:55:58 user nova-compute[72766]:   </devices>
Aug 14 22:55:58 user nova-compute[72766]: </domain>
Aug 14 22:55:58 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T22:55:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1398839154',display_name='tempest-AttachSCSIVolumeTestJSON-server-1398839154',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1398839154',id=5,image_ref='6965249c-ed43-4d6f-9720-9b9543bc6e36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE07CscbRwiFXt4oowixGelS8cd8+TrGRhQZUTn4sQQh6dYhsSP3vBYNaHrOhsecr9RlWR/To/KqS1yieVJ3+g5dSeUHlJ0CvSgPRzoHoeKuUUkhapDJqVUINSaa/HN5tw==',key_name='tempest-keypair-427507318',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85cdad610d1c4f8f9eb3d2677ad62c5c',ramdisk_id='',reservation_id='r-jfsxlmdg',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6965249c-ed43-4d6f-9720-9b9543bc6e36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-455382250',owner_user_name='tempest-AttachSCSIVolumeTestJSON-455382250-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:55:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63b79fe4bc2e4fb68986d0927db750f9',uuid=40cd301a-97f2-4f02-b091-f5a2bb1cd016,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9406f951-b950-463d-9574-104a83b25e7d", "address": "fa:16:3e:97:20:81", "network": {"id": "12035bbc-2507-4317-af8b-a71f420b938e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-280915665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85cdad610d1c4f8f9eb3d2677ad62c5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9406f951-b9", "ovs_interfaceid": "9406f951-b950-463d-9574-104a83b25e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Converting VIF {"id": "9406f951-b950-463d-9574-104a83b25e7d", "address": "fa:16:3e:97:20:81", "network": {"id": "12035bbc-2507-4317-af8b-a71f420b938e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-280915665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85cdad610d1c4f8f9eb3d2677ad62c5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9406f951-b9", "ovs_interfaceid": "9406f951-b950-463d-9574-104a83b25e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:20:81,bridge_name='br-int',has_traffic_filtering=True,id=9406f951-b950-463d-9574-104a83b25e7d,network=Network(12035bbc-2507-4317-af8b-a71f420b938e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9406f951-b9') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG os_vif [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:20:81,bridge_name='br-int',has_traffic_filtering=True,id=9406f951-b950-463d-9574-104a83b25e7d,network=Network(12035bbc-2507-4317-af8b-a71f420b938e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9406f951-b9') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9406f951-b9, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9406f951-b9, col_values=(('external_ids', {'iface-id': '9406f951-b950-463d-9574-104a83b25e7d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:20:81', 'vm-uuid': '40cd301a-97f2-4f02-b091-f5a2bb1cd016'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:58 user nova-compute[72766]: INFO os_vif [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:20:81,bridge_name='br-int',has_traffic_filtering=True,id=9406f951-b950-463d-9574-104a83b25e7d,network=Network(12035bbc-2507-4317-af8b-a71f420b938e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9406f951-b9')
Aug 14 22:55:58 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.905s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG nova.compute.manager [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.602s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 22:55:58 user nova-compute[72766]: INFO nova.compute.claims [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Claim successful on node user
Aug 14 22:55:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] No BDM found with device name sda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] No VIF found with MAC fa:16:3e:97:20:81, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:55:58 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Using config drive
Aug 14 22:55:58 user nova-compute[72766]: DEBUG nova.compute.manager [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 22:55:58 user nova-compute[72766]: DEBUG nova.network.neutron [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 22:55:58 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 22:55:58 user nova-compute[72766]: DEBUG nova.compute.manager [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 22:55:59 user nova-compute[72766]: DEBUG nova.compute.manager [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 22:55:59 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 22:55:59 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Creating image(s)
Aug 14 22:55:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Acquiring lock "/opt/stack/data/nova/instances/b55141bc-d426-4d35-8ae5-269ece19a793/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Lock "/opt/stack/data/nova/instances/b55141bc-d426-4d35-8ae5-269ece19a793/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Lock "/opt/stack/data/nova/instances/b55141bc-d426-4d35-8ae5-269ece19a793/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:55:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:55:59 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Creating config drive at /opt/stack/data/nova/instances/40cd301a-97f2-4f02-b091-f5a2bb1cd016/disk.config
Aug 14 22:55:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/40cd301a-97f2-4f02-b091-f5a2bb1cd016/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp35zul5mp {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:55:59 user nova-compute[72766]: DEBUG nova.network.neutron [req-731bf96c-6967-4b23-9661-5d7e19d7b04f req-c612600c-9d38-423e-a404-2beaeaf05499 service nova] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Updated VIF entry in instance network info cache for port 9406f951-b950-463d-9574-104a83b25e7d. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:55:59 user nova-compute[72766]: DEBUG nova.network.neutron [req-731bf96c-6967-4b23-9661-5d7e19d7b04f req-c612600c-9d38-423e-a404-2beaeaf05499 service nova] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Updating instance_info_cache with network_info: [{"id": "9406f951-b950-463d-9574-104a83b25e7d", "address": "fa:16:3e:97:20:81", "network": {"id": "12035bbc-2507-4317-af8b-a71f420b938e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-280915665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85cdad610d1c4f8f9eb3d2677ad62c5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9406f951-b9", "ovs_interfaceid": "9406f951-b950-463d-9574-104a83b25e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:55:59 user nova-compute[72766]: DEBUG nova.policy [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '22c19a1dd8414aa4bdb57ef938185873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da868713db654a55b759f16167c88297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 22:55:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:55:59 user nova-compute[72766]: DEBUG nova.network.neutron [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Successfully updated port: 58e0b222-3a0a-40d3-ad60-e92985bd3584 {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 22:55:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/40cd301a-97f2-4f02-b091-f5a2bb1cd016/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp35zul5mp" returned: 0 in 0.172s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:55:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-731bf96c-6967-4b23-9661-5d7e19d7b04f req-c612600c-9d38-423e-a404-2beaeaf05499 service nova] Releasing lock "refresh_cache-40cd301a-97f2-4f02-b091-f5a2bb1cd016" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:55:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.318s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:55:59 user nova-compute[72766]: DEBUG nova.compute.manager [req-9f723fc5-7da5-43e8-95db-77ad63a05313 req-9652b4fa-a4dd-4a7d-aa47-466be67fba16 service nova] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Received event network-changed-58e0b222-3a0a-40d3-ad60-e92985bd3584 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:55:59 user nova-compute[72766]: DEBUG nova.compute.manager [req-9f723fc5-7da5-43e8-95db-77ad63a05313 req-9652b4fa-a4dd-4a7d-aa47-466be67fba16 service nova] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Refreshing instance network info cache due to event network-changed-58e0b222-3a0a-40d3-ad60-e92985bd3584. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:55:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9f723fc5-7da5-43e8-95db-77ad63a05313 req-9652b4fa-a4dd-4a7d-aa47-466be67fba16 service nova] Acquiring lock "refresh_cache-90b55775-2f14-4c80-b48a-b1eed2b570dc" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:55:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9f723fc5-7da5-43e8-95db-77ad63a05313 req-9652b4fa-a4dd-4a7d-aa47-466be67fba16 service nova] Acquired lock "refresh_cache-90b55775-2f14-4c80-b48a-b1eed2b570dc" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:55:59 user nova-compute[72766]: DEBUG nova.network.neutron [req-9f723fc5-7da5-43e8-95db-77ad63a05313 req-9652b4fa-a4dd-4a7d-aa47-466be67fba16 service nova] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Refreshing network info cache for port 58e0b222-3a0a-40d3-ad60-e92985bd3584 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:55:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Acquiring lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:55:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Acquiring lock "refresh_cache-90b55775-2f14-4c80-b48a-b1eed2b570dc" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:55:59 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:55:59 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:55:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.806s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:55:59 user nova-compute[72766]: DEBUG nova.compute.manager [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 22:55:59 user nova-compute[72766]: DEBUG nova.network.neutron [req-9f723fc5-7da5-43e8-95db-77ad63a05313 req-9652b4fa-a4dd-4a7d-aa47-466be67fba16 service nova] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 22:55:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.227s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:55:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/b55141bc-d426-4d35-8ae5-269ece19a793/disk 1073741824 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:55:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/b55141bc-d426-4d35-8ae5-269ece19a793/disk 1073741824" returned: 0 in 0.053s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:55:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:55:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:55:59 user nova-compute[72766]: DEBUG nova.compute.manager [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 22:55:59 user nova-compute[72766]: DEBUG nova.network.neutron [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 22:55:59 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 22:55:59 user nova-compute[72766]: DEBUG nova.compute.manager [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 22:55:59 user nova-compute[72766]: DEBUG nova.policy [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '74108c91a9be4bf1b51dc5f7b3f80087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5740ddd945a1401b98aafaa1cbae8c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 22:55:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.230s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:55:59 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b55141bc-d426-4d35-8ae5-269ece19a793/disk. size=1073741824 {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 22:55:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b55141bc-d426-4d35-8ae5-269ece19a793/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:55:59 user nova-compute[72766]: DEBUG nova.compute.manager [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 22:55:59 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 22:55:59 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Creating image(s)
Aug 14 22:55:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Acquiring lock "/opt/stack/data/nova/instances/33e6f8aa-bb0d-478d-b7b5-3334302476fb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:55:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Lock "/opt/stack/data/nova/instances/33e6f8aa-bb0d-478d-b7b5-3334302476fb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:55:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Lock "/opt/stack/data/nova/instances/33e6f8aa-bb0d-478d-b7b5-3334302476fb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:55:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:56:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b55141bc-d426-4d35-8ae5-269ece19a793/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:56:00 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Cannot resize image /opt/stack/data/nova/instances/b55141bc-d426-4d35-8ae5-269ece19a793/disk to a smaller size. {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 22:56:00 user nova-compute[72766]: DEBUG nova.objects.instance [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Lazy-loading 'migration_context' on Instance uuid b55141bc-d426-4d35-8ae5-269ece19a793 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:56:00 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 22:56:00 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Ensure instance console log exists: /opt/stack/data/nova/instances/b55141bc-d426-4d35-8ae5-269ece19a793/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 22:56:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:56:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:56:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:56:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.223s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:56:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Acquiring lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:56:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:56:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:56:00 user nova-compute[72766]: DEBUG nova.network.neutron [req-9f723fc5-7da5-43e8-95db-77ad63a05313 req-9652b4fa-a4dd-4a7d-aa47-466be67fba16 service nova] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:56:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9f723fc5-7da5-43e8-95db-77ad63a05313 req-9652b4fa-a4dd-4a7d-aa47-466be67fba16 service nova] Releasing lock "refresh_cache-90b55775-2f14-4c80-b48a-b1eed2b570dc" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:56:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Acquired lock "refresh_cache-90b55775-2f14-4c80-b48a-b1eed2b570dc" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:56:00 user nova-compute[72766]: DEBUG nova.network.neutron [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:56:00 user nova-compute[72766]: DEBUG nova.network.neutron [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 22:56:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.206s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:56:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/33e6f8aa-bb0d-478d-b7b5-3334302476fb/disk 1073741824 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:56:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/33e6f8aa-bb0d-478d-b7b5-3334302476fb/disk 1073741824" returned: 0 in 0.065s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:56:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:56:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:56:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.235s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:56:00 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Checking if we can resize image /opt/stack/data/nova/instances/33e6f8aa-bb0d-478d-b7b5-3334302476fb/disk. size=1073741824 {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 22:56:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33e6f8aa-bb0d-478d-b7b5-3334302476fb/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:56:00 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:00 user nova-compute[72766]: DEBUG nova.network.neutron [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Successfully created port: 9a214a31-3ef2-4a37-b0fa-c27a86be068c {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 22:56:00 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:00 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:00 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33e6f8aa-bb0d-478d-b7b5-3334302476fb/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:56:00 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Cannot resize image /opt/stack/data/nova/instances/33e6f8aa-bb0d-478d-b7b5-3334302476fb/disk to a smaller size. {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 22:56:00 user nova-compute[72766]: DEBUG nova.objects.instance [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Lazy-loading 'migration_context' on Instance uuid 33e6f8aa-bb0d-478d-b7b5-3334302476fb {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Ensure instance console log exists: /opt/stack/data/nova/instances/33e6f8aa-bb0d-478d-b7b5-3334302476fb/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG nova.network.neutron [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Successfully created port: 3eb61059-fbcd-4dbc-9a10-81aed042e936 {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG nova.network.neutron [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Updating instance_info_cache with network_info: [{"id": "58e0b222-3a0a-40d3-ad60-e92985bd3584", "address": "fa:16:3e:5e:2c:02", "network": {"id": "6f03ef5e-cea3-4538-9f91-e35f756665a1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1408762454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d841b7f732a743658e035777c8629c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e0b222-3a", "ovs_interfaceid": "58e0b222-3a0a-40d3-ad60-e92985bd3584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Releasing lock "refresh_cache-90b55775-2f14-4c80-b48a-b1eed2b570dc" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG nova.compute.manager [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Instance network_info: |[{"id": "58e0b222-3a0a-40d3-ad60-e92985bd3584", "address": "fa:16:3e:5e:2c:02", "network": {"id": "6f03ef5e-cea3-4538-9f91-e35f756665a1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1408762454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d841b7f732a743658e035777c8629c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e0b222-3a", "ovs_interfaceid": "58e0b222-3a0a-40d3-ad60-e92985bd3584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Start _get_guest_xml network_info=[{"id": "58e0b222-3a0a-40d3-ad60-e92985bd3584", "address": "fa:16:3e:5e:2c:02", "network": {"id": "6f03ef5e-cea3-4538-9f91-e35f756665a1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1408762454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d841b7f732a743658e035777c8629c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e0b222-3a", "ovs_interfaceid": "58e0b222-3a0a-40d3-ad60-e92985bd3584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd2900d30-2c4c-4d57-9135-d45564c0c596'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 22:56:01 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:56:01 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:56:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T22:55:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-359420211',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-359420211',id=6,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8cq16Tr/aSGWtJWb/xfeRNJOb+B6LjH5taG4rznYJbzp5KjGb+MpXm0+8Y+Xs3FuiWq9fVeEhIpGtH4iqY05CSFniUjByOF+zxj8vXJaj8j0+QLFR098sJu8pYQ2V7Ow==',key_name='tempest-keypair-975754438',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d841b7f732a743658e035777c8629c50',ramdisk_id='',reservation_id='r-iogn86da',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1079325823',owner_user_name='tempest-TaggedAttachmentsTest-1079325823-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:55:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adf9d286eb5749e7a5278af949ca1a9f',uuid=90b55775-2f14-4c80-b48a-b1eed2b570dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58e0b222-3a0a-40d3-ad60-e92985bd3584", "address": "fa:16:3e:5e:2c:02", "network": {"id": "6f03ef5e-cea3-4538-9f91-e35f756665a1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1408762454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d841b7f732a743658e035777c8629c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e0b222-3a", "ovs_interfaceid": "58e0b222-3a0a-40d3-ad60-e92985bd3584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Converting VIF {"id": "58e0b222-3a0a-40d3-ad60-e92985bd3584", "address": "fa:16:3e:5e:2c:02", "network": {"id": "6f03ef5e-cea3-4538-9f91-e35f756665a1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1408762454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d841b7f732a743658e035777c8629c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e0b222-3a", "ovs_interfaceid": "58e0b222-3a0a-40d3-ad60-e92985bd3584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:2c:02,bridge_name='br-int',has_traffic_filtering=True,id=58e0b222-3a0a-40d3-ad60-e92985bd3584,network=Network(6f03ef5e-cea3-4538-9f91-e35f756665a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58e0b222-3a') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG nova.objects.instance [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Lazy-loading 'pci_devices' on Instance uuid 90b55775-2f14-4c80-b48a-b1eed2b570dc {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG nova.compute.manager [req-8571abc9-d120-4264-9d6f-e6fba90d53cc req-e3a56449-2477-42c9-bf63-87cbdbb586be service nova] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Received event network-vif-plugged-9406f951-b950-463d-9574-104a83b25e7d {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8571abc9-d120-4264-9d6f-e6fba90d53cc req-e3a56449-2477-42c9-bf63-87cbdbb586be service nova] Acquiring lock "40cd301a-97f2-4f02-b091-f5a2bb1cd016-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8571abc9-d120-4264-9d6f-e6fba90d53cc req-e3a56449-2477-42c9-bf63-87cbdbb586be service nova] Lock "40cd301a-97f2-4f02-b091-f5a2bb1cd016-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8571abc9-d120-4264-9d6f-e6fba90d53cc req-e3a56449-2477-42c9-bf63-87cbdbb586be service nova] Lock "40cd301a-97f2-4f02-b091-f5a2bb1cd016-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG nova.compute.manager [req-8571abc9-d120-4264-9d6f-e6fba90d53cc req-e3a56449-2477-42c9-bf63-87cbdbb586be service nova] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] No waiting events found dispatching network-vif-plugged-9406f951-b950-463d-9574-104a83b25e7d {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:56:01 user nova-compute[72766]: WARNING nova.compute.manager [req-8571abc9-d120-4264-9d6f-e6fba90d53cc req-e3a56449-2477-42c9-bf63-87cbdbb586be service nova] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Received unexpected event network-vif-plugged-9406f951-b950-463d-9574-104a83b25e7d for instance with vm_state building and task_state spawning.
Aug 14 22:56:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] End _get_guest_xml xml=<domain type="kvm">
Aug 14 22:56:01 user nova-compute[72766]:   <uuid>90b55775-2f14-4c80-b48a-b1eed2b570dc</uuid>
Aug 14 22:56:01 user nova-compute[72766]:   <name>instance-00000006</name>
Aug 14 22:56:01 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 22:56:01 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 22:56:01 user nova-compute[72766]:   <metadata>
Aug 14 22:56:01 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:56:01 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 22:56:01 user nova-compute[72766]:       <nova:name>tempest-device-tagging-server-359420211</nova:name>
Aug 14 22:56:01 user nova-compute[72766]:       <nova:creationTime>2023-08-14 22:56:01</nova:creationTime>
Aug 14 22:56:01 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 22:56:01 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 22:56:01 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 22:56:01 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 22:56:01 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:56:01 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 22:56:01 user nova-compute[72766]:       </nova:flavor>
Aug 14 22:56:01 user nova-compute[72766]:       <nova:owner>
Aug 14 22:56:01 user nova-compute[72766]:         <nova:user uuid="adf9d286eb5749e7a5278af949ca1a9f">tempest-TaggedAttachmentsTest-1079325823-project-member</nova:user>
Aug 14 22:56:01 user nova-compute[72766]:         <nova:project uuid="d841b7f732a743658e035777c8629c50">tempest-TaggedAttachmentsTest-1079325823</nova:project>
Aug 14 22:56:01 user nova-compute[72766]:       </nova:owner>
Aug 14 22:56:01 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 22:56:01 user nova-compute[72766]:       <nova:ports>
Aug 14 22:56:01 user nova-compute[72766]:         <nova:port uuid="58e0b222-3a0a-40d3-ad60-e92985bd3584">
Aug 14 22:56:01 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 22:56:01 user nova-compute[72766]:         </nova:port>
Aug 14 22:56:01 user nova-compute[72766]:       </nova:ports>
Aug 14 22:56:01 user nova-compute[72766]:     </nova:instance>
Aug 14 22:56:01 user nova-compute[72766]:   </metadata>
Aug 14 22:56:01 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 22:56:01 user nova-compute[72766]:     <system>
Aug 14 22:56:01 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 22:56:01 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 22:56:01 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 22:56:01 user nova-compute[72766]:       <entry name="serial">90b55775-2f14-4c80-b48a-b1eed2b570dc</entry>
Aug 14 22:56:01 user nova-compute[72766]:       <entry name="uuid">90b55775-2f14-4c80-b48a-b1eed2b570dc</entry>
Aug 14 22:56:01 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 22:56:01 user nova-compute[72766]:     </system>
Aug 14 22:56:01 user nova-compute[72766]:   </sysinfo>
Aug 14 22:56:01 user nova-compute[72766]:   <os>
Aug 14 22:56:01 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 22:56:01 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 22:56:01 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 22:56:01 user nova-compute[72766]:   </os>
Aug 14 22:56:01 user nova-compute[72766]:   <features>
Aug 14 22:56:01 user nova-compute[72766]:     <acpi/>
Aug 14 22:56:01 user nova-compute[72766]:     <apic/>
Aug 14 22:56:01 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 22:56:01 user nova-compute[72766]:   </features>
Aug 14 22:56:01 user nova-compute[72766]:   <clock offset="utc">
Aug 14 22:56:01 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 22:56:01 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 22:56:01 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 22:56:01 user nova-compute[72766]:   </clock>
Aug 14 22:56:01 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 22:56:01 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 22:56:01 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 22:56:01 user nova-compute[72766]:   </cpu>
Aug 14 22:56:01 user nova-compute[72766]:   <devices>
Aug 14 22:56:01 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 22:56:01 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 22:56:01 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc/disk"/>
Aug 14 22:56:01 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 22:56:01 user nova-compute[72766]:     </disk>
Aug 14 22:56:01 user nova-compute[72766]:     <disk type="file" device="cdrom">
Aug 14 22:56:01 user nova-compute[72766]:       <driver name="qemu" type="raw" cache="none"/>
Aug 14 22:56:01 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc/disk.config"/>
Aug 14 22:56:01 user nova-compute[72766]:       <target dev="hda" bus="ide"/>
Aug 14 22:56:01 user nova-compute[72766]:     </disk>
Aug 14 22:56:01 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 22:56:01 user nova-compute[72766]:       <mac address="fa:16:3e:5e:2c:02"/>
Aug 14 22:56:01 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 22:56:01 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 22:56:01 user nova-compute[72766]:       <target dev="tap58e0b222-3a"/>
Aug 14 22:56:01 user nova-compute[72766]:     </interface>
Aug 14 22:56:01 user nova-compute[72766]:     <serial type="pty">
Aug 14 22:56:01 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc/console.log" append="off"/>
Aug 14 22:56:01 user nova-compute[72766]:     </serial>
Aug 14 22:56:01 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 22:56:01 user nova-compute[72766]:     <video>
Aug 14 22:56:01 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 22:56:01 user nova-compute[72766]:     </video>
Aug 14 22:56:01 user nova-compute[72766]:     <rng model="virtio">
Aug 14 22:56:01 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 22:56:01 user nova-compute[72766]:     </rng>
Aug 14 22:56:01 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 22:56:01 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 22:56:01 user nova-compute[72766]:       <stats period="10"/>
Aug 14 22:56:01 user nova-compute[72766]:     </memballoon>
Aug 14 22:56:01 user nova-compute[72766]:   </devices>
Aug 14 22:56:01 user nova-compute[72766]: </domain>
Aug 14 22:56:01 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T22:55:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-359420211',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-359420211',id=6,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8cq16Tr/aSGWtJWb/xfeRNJOb+B6LjH5taG4rznYJbzp5KjGb+MpXm0+8Y+Xs3FuiWq9fVeEhIpGtH4iqY05CSFniUjByOF+zxj8vXJaj8j0+QLFR098sJu8pYQ2V7Ow==',key_name='tempest-keypair-975754438',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d841b7f732a743658e035777c8629c50',ramdisk_id='',reservation_id='r-iogn86da',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1079325823',owner_user_name='tempest-TaggedAttachmentsTest-1079325823-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:55:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adf9d286eb5749e7a5278af949ca1a9f',uuid=90b55775-2f14-4c80-b48a-b1eed2b570dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58e0b222-3a0a-40d3-ad60-e92985bd3584", "address": "fa:16:3e:5e:2c:02", "network": {"id": "6f03ef5e-cea3-4538-9f91-e35f756665a1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1408762454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d841b7f732a743658e035777c8629c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e0b222-3a", "ovs_interfaceid": "58e0b222-3a0a-40d3-ad60-e92985bd3584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Converting VIF {"id": "58e0b222-3a0a-40d3-ad60-e92985bd3584", "address": "fa:16:3e:5e:2c:02", "network": {"id": "6f03ef5e-cea3-4538-9f91-e35f756665a1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1408762454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d841b7f732a743658e035777c8629c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e0b222-3a", "ovs_interfaceid": "58e0b222-3a0a-40d3-ad60-e92985bd3584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:2c:02,bridge_name='br-int',has_traffic_filtering=True,id=58e0b222-3a0a-40d3-ad60-e92985bd3584,network=Network(6f03ef5e-cea3-4538-9f91-e35f756665a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58e0b222-3a') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG os_vif [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:2c:02,bridge_name='br-int',has_traffic_filtering=True,id=58e0b222-3a0a-40d3-ad60-e92985bd3584,network=Network(6f03ef5e-cea3-4538-9f91-e35f756665a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58e0b222-3a') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap58e0b222-3a, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap58e0b222-3a, col_values=(('external_ids', {'iface-id': '58e0b222-3a0a-40d3-ad60-e92985bd3584', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:2c:02', 'vm-uuid': '90b55775-2f14-4c80-b48a-b1eed2b570dc'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:01 user nova-compute[72766]: INFO os_vif [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:2c:02,bridge_name='br-int',has_traffic_filtering=True,id=58e0b222-3a0a-40d3-ad60-e92985bd3584,network=Network(6f03ef5e-cea3-4538-9f91-e35f756665a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58e0b222-3a')
Aug 14 22:56:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] No BDM found with device name hda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] No VIF found with MAC fa:16:3e:5e:2c:02, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:56:01 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Using config drive
Aug 14 22:56:01 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Creating config drive at /opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc/disk.config
Aug 14 22:56:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdi5zcxtp {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdi5zcxtp" returned: 0 in 0.070s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:02 user nova-compute[72766]: DEBUG nova.network.neutron [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Successfully updated port: 3eb61059-fbcd-4dbc-9a10-81aed042e936 {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 22:56:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Acquiring lock "refresh_cache-b55141bc-d426-4d35-8ae5-269ece19a793" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:56:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Acquired lock "refresh_cache-b55141bc-d426-4d35-8ae5-269ece19a793" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:56:02 user nova-compute[72766]: DEBUG nova.network.neutron [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:56:02 user nova-compute[72766]: DEBUG nova.compute.manager [req-e99cd3de-38ea-4cae-9710-5c7816c77539 req-5230842f-f04c-4b5f-a17f-a5e612b3cb81 service nova] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Received event network-changed-3eb61059-fbcd-4dbc-9a10-81aed042e936 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:56:02 user nova-compute[72766]: DEBUG nova.compute.manager [req-e99cd3de-38ea-4cae-9710-5c7816c77539 req-5230842f-f04c-4b5f-a17f-a5e612b3cb81 service nova] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Refreshing instance network info cache due to event network-changed-3eb61059-fbcd-4dbc-9a10-81aed042e936. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:56:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e99cd3de-38ea-4cae-9710-5c7816c77539 req-5230842f-f04c-4b5f-a17f-a5e612b3cb81 service nova] Acquiring lock "refresh_cache-b55141bc-d426-4d35-8ae5-269ece19a793" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:56:02 user nova-compute[72766]: DEBUG nova.network.neutron [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 22:56:02 user nova-compute[72766]: DEBUG nova.network.neutron [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Updating instance_info_cache with network_info: [{"id": "3eb61059-fbcd-4dbc-9a10-81aed042e936", "address": "fa:16:3e:b5:ed:a3", "network": {"id": "0ebb9d77-2a5a-4ef1-923e-bd683ccc798c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-8258803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da868713db654a55b759f16167c88297", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb61059-fb", "ovs_interfaceid": "3eb61059-fbcd-4dbc-9a10-81aed042e936", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:56:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Releasing lock "refresh_cache-b55141bc-d426-4d35-8ae5-269ece19a793" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:56:02 user nova-compute[72766]: DEBUG nova.compute.manager [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Instance network_info: |[{"id": "3eb61059-fbcd-4dbc-9a10-81aed042e936", "address": "fa:16:3e:b5:ed:a3", "network": {"id": "0ebb9d77-2a5a-4ef1-923e-bd683ccc798c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-8258803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da868713db654a55b759f16167c88297", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb61059-fb", "ovs_interfaceid": "3eb61059-fbcd-4dbc-9a10-81aed042e936", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 22:56:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e99cd3de-38ea-4cae-9710-5c7816c77539 req-5230842f-f04c-4b5f-a17f-a5e612b3cb81 service nova] Acquired lock "refresh_cache-b55141bc-d426-4d35-8ae5-269ece19a793" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:56:02 user nova-compute[72766]: DEBUG nova.network.neutron [req-e99cd3de-38ea-4cae-9710-5c7816c77539 req-5230842f-f04c-4b5f-a17f-a5e612b3cb81 service nova] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Refreshing network info cache for port 3eb61059-fbcd-4dbc-9a10-81aed042e936 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:56:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Start _get_guest_xml network_info=[{"id": "3eb61059-fbcd-4dbc-9a10-81aed042e936", "address": "fa:16:3e:b5:ed:a3", "network": {"id": "0ebb9d77-2a5a-4ef1-923e-bd683ccc798c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-8258803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da868713db654a55b759f16167c88297", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb61059-fb", "ovs_interfaceid": "3eb61059-fbcd-4dbc-9a10-81aed042e936", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd2900d30-2c4c-4d57-9135-d45564c0c596'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 22:56:02 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:56:02 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:56:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 22:56:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 22:56:02 user nova-compute[72766]: DEBUG nova.network.neutron [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Successfully updated port: 9a214a31-3ef2-4a37-b0fa-c27a86be068c {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 22:56:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 22:56:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 22:56:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 22:56:02 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 22:56:02 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 22:56:02 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 22:56:02 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 22:56:02 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 22:56:02 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 22:56:02 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 22:56:02 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 22:56:02 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 22:56:02 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 22:56:02 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:55:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1447188578',display_name='tempest-VolumesAssistedSnapshotsTest-server-1447188578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1447188578',id=7,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEIgCLOQgouALAtgNT17letDNZPJ9xLFFnymZzS2ccKSk7R31HiuQIYQogsLkqcRPyRXFu22ZkVFiX8t8a7t2JieZMfz2vc1u6hCWa4M8g+nNouh2YDMv/HLPReSWBDlA==',key_name='tempest-keypair-722593446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da868713db654a55b759f16167c88297',ramdisk_id='',reservation_id='r-9g5ubyz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-720458683',owner_user_name='tempest-VolumesAssistedSnapshotsTest-720458683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:55:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22c19a1dd8414aa4bdb57ef938185873',uuid=b55141bc-d426-4d35-8ae5-269ece19a793,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3eb61059-fbcd-4dbc-9a10-81aed042e936", "address": "fa:16:3e:b5:ed:a3", "network": {"id": "0ebb9d77-2a5a-4ef1-923e-bd683ccc798c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-8258803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da868713db654a55b759f16167c88297", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb61059-fb", "ovs_interfaceid": "3eb61059-fbcd-4dbc-9a10-81aed042e936", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Converting VIF {"id": "3eb61059-fbcd-4dbc-9a10-81aed042e936", "address": "fa:16:3e:b5:ed:a3", "network": {"id": "0ebb9d77-2a5a-4ef1-923e-bd683ccc798c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-8258803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da868713db654a55b759f16167c88297", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb61059-fb", "ovs_interfaceid": "3eb61059-fbcd-4dbc-9a10-81aed042e936", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:ed:a3,bridge_name='br-int',has_traffic_filtering=True,id=3eb61059-fbcd-4dbc-9a10-81aed042e936,network=Network(0ebb9d77-2a5a-4ef1-923e-bd683ccc798c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eb61059-fb') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.objects.instance [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Lazy-loading 'pci_devices' on Instance uuid b55141bc-d426-4d35-8ae5-269ece19a793 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Acquiring lock "refresh_cache-33e6f8aa-bb0d-478d-b7b5-3334302476fb" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Acquired lock "refresh_cache-33e6f8aa-bb0d-478d-b7b5-3334302476fb" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.network.neutron [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.compute.manager [req-f8997c0a-1f37-447f-96f2-012fa2121805 req-d28580da-9cd0-45b2-bdbe-a8d221119f52 service nova] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Received event network-changed-9a214a31-3ef2-4a37-b0fa-c27a86be068c {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.compute.manager [req-f8997c0a-1f37-447f-96f2-012fa2121805 req-d28580da-9cd0-45b2-bdbe-a8d221119f52 service nova] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Refreshing instance network info cache due to event network-changed-9a214a31-3ef2-4a37-b0fa-c27a86be068c. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f8997c0a-1f37-447f-96f2-012fa2121805 req-d28580da-9cd0-45b2-bdbe-a8d221119f52 service nova] Acquiring lock "refresh_cache-33e6f8aa-bb0d-478d-b7b5-3334302476fb" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] End _get_guest_xml xml=<domain type="kvm">
Aug 14 22:56:03 user nova-compute[72766]:   <uuid>b55141bc-d426-4d35-8ae5-269ece19a793</uuid>
Aug 14 22:56:03 user nova-compute[72766]:   <name>instance-00000007</name>
Aug 14 22:56:03 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 22:56:03 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 22:56:03 user nova-compute[72766]:   <metadata>
Aug 14 22:56:03 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:56:03 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 22:56:03 user nova-compute[72766]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1447188578</nova:name>
Aug 14 22:56:03 user nova-compute[72766]:       <nova:creationTime>2023-08-14 22:56:02</nova:creationTime>
Aug 14 22:56:03 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 22:56:03 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 22:56:03 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 22:56:03 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 22:56:03 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:56:03 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 22:56:03 user nova-compute[72766]:       </nova:flavor>
Aug 14 22:56:03 user nova-compute[72766]:       <nova:owner>
Aug 14 22:56:03 user nova-compute[72766]:         <nova:user uuid="22c19a1dd8414aa4bdb57ef938185873">tempest-VolumesAssistedSnapshotsTest-720458683-project-member</nova:user>
Aug 14 22:56:03 user nova-compute[72766]:         <nova:project uuid="da868713db654a55b759f16167c88297">tempest-VolumesAssistedSnapshotsTest-720458683</nova:project>
Aug 14 22:56:03 user nova-compute[72766]:       </nova:owner>
Aug 14 22:56:03 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 22:56:03 user nova-compute[72766]:       <nova:ports>
Aug 14 22:56:03 user nova-compute[72766]:         <nova:port uuid="3eb61059-fbcd-4dbc-9a10-81aed042e936">
Aug 14 22:56:03 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 22:56:03 user nova-compute[72766]:         </nova:port>
Aug 14 22:56:03 user nova-compute[72766]:       </nova:ports>
Aug 14 22:56:03 user nova-compute[72766]:     </nova:instance>
Aug 14 22:56:03 user nova-compute[72766]:   </metadata>
Aug 14 22:56:03 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 22:56:03 user nova-compute[72766]:     <system>
Aug 14 22:56:03 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 22:56:03 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 22:56:03 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 22:56:03 user nova-compute[72766]:       <entry name="serial">b55141bc-d426-4d35-8ae5-269ece19a793</entry>
Aug 14 22:56:03 user nova-compute[72766]:       <entry name="uuid">b55141bc-d426-4d35-8ae5-269ece19a793</entry>
Aug 14 22:56:03 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 22:56:03 user nova-compute[72766]:     </system>
Aug 14 22:56:03 user nova-compute[72766]:   </sysinfo>
Aug 14 22:56:03 user nova-compute[72766]:   <os>
Aug 14 22:56:03 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 22:56:03 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 22:56:03 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 22:56:03 user nova-compute[72766]:   </os>
Aug 14 22:56:03 user nova-compute[72766]:   <features>
Aug 14 22:56:03 user nova-compute[72766]:     <acpi/>
Aug 14 22:56:03 user nova-compute[72766]:     <apic/>
Aug 14 22:56:03 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 22:56:03 user nova-compute[72766]:   </features>
Aug 14 22:56:03 user nova-compute[72766]:   <clock offset="utc">
Aug 14 22:56:03 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 22:56:03 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 22:56:03 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 22:56:03 user nova-compute[72766]:   </clock>
Aug 14 22:56:03 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 22:56:03 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 22:56:03 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 22:56:03 user nova-compute[72766]:   </cpu>
Aug 14 22:56:03 user nova-compute[72766]:   <devices>
Aug 14 22:56:03 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 22:56:03 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 22:56:03 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/b55141bc-d426-4d35-8ae5-269ece19a793/disk"/>
Aug 14 22:56:03 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 22:56:03 user nova-compute[72766]:     </disk>
Aug 14 22:56:03 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 22:56:03 user nova-compute[72766]:       <mac address="fa:16:3e:b5:ed:a3"/>
Aug 14 22:56:03 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 22:56:03 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 22:56:03 user nova-compute[72766]:       <target dev="tap3eb61059-fb"/>
Aug 14 22:56:03 user nova-compute[72766]:     </interface>
Aug 14 22:56:03 user nova-compute[72766]:     <serial type="pty">
Aug 14 22:56:03 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/b55141bc-d426-4d35-8ae5-269ece19a793/console.log" append="off"/>
Aug 14 22:56:03 user nova-compute[72766]:     </serial>
Aug 14 22:56:03 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 22:56:03 user nova-compute[72766]:     <video>
Aug 14 22:56:03 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 22:56:03 user nova-compute[72766]:     </video>
Aug 14 22:56:03 user nova-compute[72766]:     <rng model="virtio">
Aug 14 22:56:03 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 22:56:03 user nova-compute[72766]:     </rng>
Aug 14 22:56:03 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 22:56:03 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 22:56:03 user nova-compute[72766]:       <stats period="10"/>
Aug 14 22:56:03 user nova-compute[72766]:     </memballoon>
Aug 14 22:56:03 user nova-compute[72766]:   </devices>
Aug 14 22:56:03 user nova-compute[72766]: </domain>
Aug 14 22:56:03 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:55:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1447188578',display_name='tempest-VolumesAssistedSnapshotsTest-server-1447188578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1447188578',id=7,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEIgCLOQgouALAtgNT17letDNZPJ9xLFFnymZzS2ccKSk7R31HiuQIYQogsLkqcRPyRXFu22ZkVFiX8t8a7t2JieZMfz2vc1u6hCWa4M8g+nNouh2YDMv/HLPReSWBDlA==',key_name='tempest-keypair-722593446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da868713db654a55b759f16167c88297',ramdisk_id='',reservation_id='r-9g5ubyz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-720458683',owner_user_name='tempest-VolumesAssistedSnapshotsTest-720458683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:55:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22c19a1dd8414aa4bdb57ef938185873',uuid=b55141bc-d426-4d35-8ae5-269ece19a793,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3eb61059-fbcd-4dbc-9a10-81aed042e936", "address": "fa:16:3e:b5:ed:a3", "network": {"id": "0ebb9d77-2a5a-4ef1-923e-bd683ccc798c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-8258803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da868713db654a55b759f16167c88297", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb61059-fb", "ovs_interfaceid": "3eb61059-fbcd-4dbc-9a10-81aed042e936", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Converting VIF {"id": "3eb61059-fbcd-4dbc-9a10-81aed042e936", "address": "fa:16:3e:b5:ed:a3", "network": {"id": "0ebb9d77-2a5a-4ef1-923e-bd683ccc798c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-8258803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da868713db654a55b759f16167c88297", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb61059-fb", "ovs_interfaceid": "3eb61059-fbcd-4dbc-9a10-81aed042e936", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:ed:a3,bridge_name='br-int',has_traffic_filtering=True,id=3eb61059-fbcd-4dbc-9a10-81aed042e936,network=Network(0ebb9d77-2a5a-4ef1-923e-bd683ccc798c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eb61059-fb') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG os_vif [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:ed:a3,bridge_name='br-int',has_traffic_filtering=True,id=3eb61059-fbcd-4dbc-9a10-81aed042e936,network=Network(0ebb9d77-2a5a-4ef1-923e-bd683ccc798c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eb61059-fb') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3eb61059-fb, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3eb61059-fb, col_values=(('external_ids', {'iface-id': '3eb61059-fbcd-4dbc-9a10-81aed042e936', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:ed:a3', 'vm-uuid': 'b55141bc-d426-4d35-8ae5-269ece19a793'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:03 user nova-compute[72766]: INFO os_vif [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:ed:a3,bridge_name='br-int',has_traffic_filtering=True,id=3eb61059-fbcd-4dbc-9a10-81aed042e936,network=Network(0ebb9d77-2a5a-4ef1-923e-bd683ccc798c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eb61059-fb')
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.network.neutron [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] No VIF found with MAC fa:16:3e:b5:ed:a3, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.compute.manager [req-f5e9eada-28dc-4cc6-a030-51ec77e6eb35 req-41d77a4d-02f0-495a-9a0a-5728d6706fff service nova] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Received event network-vif-plugged-9406f951-b950-463d-9574-104a83b25e7d {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f5e9eada-28dc-4cc6-a030-51ec77e6eb35 req-41d77a4d-02f0-495a-9a0a-5728d6706fff service nova] Acquiring lock "40cd301a-97f2-4f02-b091-f5a2bb1cd016-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f5e9eada-28dc-4cc6-a030-51ec77e6eb35 req-41d77a4d-02f0-495a-9a0a-5728d6706fff service nova] Lock "40cd301a-97f2-4f02-b091-f5a2bb1cd016-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f5e9eada-28dc-4cc6-a030-51ec77e6eb35 req-41d77a4d-02f0-495a-9a0a-5728d6706fff service nova] Lock "40cd301a-97f2-4f02-b091-f5a2bb1cd016-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.compute.manager [req-f5e9eada-28dc-4cc6-a030-51ec77e6eb35 req-41d77a4d-02f0-495a-9a0a-5728d6706fff service nova] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] No waiting events found dispatching network-vif-plugged-9406f951-b950-463d-9574-104a83b25e7d {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:56:03 user nova-compute[72766]: WARNING nova.compute.manager [req-f5e9eada-28dc-4cc6-a030-51ec77e6eb35 req-41d77a4d-02f0-495a-9a0a-5728d6706fff service nova] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Received unexpected event network-vif-plugged-9406f951-b950-463d-9574-104a83b25e7d for instance with vm_state building and task_state spawning.
Aug 14 22:56:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.network.neutron [req-e99cd3de-38ea-4cae-9710-5c7816c77539 req-5230842f-f04c-4b5f-a17f-a5e612b3cb81 service nova] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Updated VIF entry in instance network info cache for port 3eb61059-fbcd-4dbc-9a10-81aed042e936. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.network.neutron [req-e99cd3de-38ea-4cae-9710-5c7816c77539 req-5230842f-f04c-4b5f-a17f-a5e612b3cb81 service nova] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Updating instance_info_cache with network_info: [{"id": "3eb61059-fbcd-4dbc-9a10-81aed042e936", "address": "fa:16:3e:b5:ed:a3", "network": {"id": "0ebb9d77-2a5a-4ef1-923e-bd683ccc798c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-8258803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da868713db654a55b759f16167c88297", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb61059-fb", "ovs_interfaceid": "3eb61059-fbcd-4dbc-9a10-81aed042e936", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e99cd3de-38ea-4cae-9710-5c7816c77539 req-5230842f-f04c-4b5f-a17f-a5e612b3cb81 service nova] Releasing lock "refresh_cache-b55141bc-d426-4d35-8ae5-269ece19a793" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.compute.manager [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692053763.630418, 40cd301a-97f2-4f02-b091-f5a2bb1cd016 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:56:03 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] VM Resumed (Lifecycle Event)
Aug 14 22:56:03 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Instance spawned successfully.
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:56:03 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692053763.6306667, 40cd301a-97f2-4f02-b091-f5a2bb1cd016 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:56:03 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] VM Started (Lifecycle Event)
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.network.neutron [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Updating instance_info_cache with network_info: [{"id": "9a214a31-3ef2-4a37-b0fa-c27a86be068c", "address": "fa:16:3e:bb:06:dd", "network": {"id": "411e3c7b-1261-4661-91a6-12630b932df7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-230148116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5740ddd945a1401b98aafaa1cbae8c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a214a31-3e", "ovs_interfaceid": "9a214a31-3ef2-4a37-b0fa-c27a86be068c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:56:03 user nova-compute[72766]: INFO nova.compute.manager [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Took 10.21 seconds to spawn the instance on the hypervisor.
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.compute.manager [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Releasing lock "refresh_cache-33e6f8aa-bb0d-478d-b7b5-3334302476fb" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.compute.manager [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Instance network_info: |[{"id": "9a214a31-3ef2-4a37-b0fa-c27a86be068c", "address": "fa:16:3e:bb:06:dd", "network": {"id": "411e3c7b-1261-4661-91a6-12630b932df7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-230148116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5740ddd945a1401b98aafaa1cbae8c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a214a31-3e", "ovs_interfaceid": "9a214a31-3ef2-4a37-b0fa-c27a86be068c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 22:56:03 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:56:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f8997c0a-1f37-447f-96f2-012fa2121805 req-d28580da-9cd0-45b2-bdbe-a8d221119f52 service nova] Acquired lock "refresh_cache-33e6f8aa-bb0d-478d-b7b5-3334302476fb" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.network.neutron [req-f8997c0a-1f37-447f-96f2-012fa2121805 req-d28580da-9cd0-45b2-bdbe-a8d221119f52 service nova] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Refreshing network info cache for port 9a214a31-3ef2-4a37-b0fa-c27a86be068c {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Start _get_guest_xml network_info=[{"id": "9a214a31-3ef2-4a37-b0fa-c27a86be068c", "address": "fa:16:3e:bb:06:dd", "network": {"id": "411e3c7b-1261-4661-91a6-12630b932df7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-230148116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5740ddd945a1401b98aafaa1cbae8c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a214a31-3e", "ovs_interfaceid": "9a214a31-3ef2-4a37-b0fa-c27a86be068c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd2900d30-2c4c-4d57-9135-d45564c0c596'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 22:56:03 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:56:03 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:55:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2066569469',display_name='tempest-TestVolumeSwap-server-2066569469',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2066569469',id=8,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKDecC6LOCTIDSHf+bGtHd82oVY7YTZ/rwmghiUc+dvaQaBUj59VHwqfdpQWbNdeqp2hsPtXJvYRgsJQVnD6PI53tjwd1U2uDPvcdF6uSDJffvmt1+bk3Opv0aNzfAvyw==',key_name='tempest-keypair-1372605118',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5740ddd945a1401b98aafaa1cbae8c13',ramdisk_id='',reservation_id='r-8km08n7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-826809882',owner_user_name='tempest-TestVolumeSwap-826809882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:56:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74108c91a9be4bf1b51dc5f7b3f80087',uuid=33e6f8aa-bb0d-478d-b7b5-3334302476fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a214a31-3ef2-4a37-b0fa-c27a86be068c", "address": "fa:16:3e:bb:06:dd", "network": {"id": "411e3c7b-1261-4661-91a6-12630b932df7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-230148116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5740ddd945a1401b98aafaa1cbae8c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a214a31-3e", "ovs_interfaceid": "9a214a31-3ef2-4a37-b0fa-c27a86be068c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Converting VIF {"id": "9a214a31-3ef2-4a37-b0fa-c27a86be068c", "address": "fa:16:3e:bb:06:dd", "network": {"id": "411e3c7b-1261-4661-91a6-12630b932df7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-230148116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5740ddd945a1401b98aafaa1cbae8c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a214a31-3e", "ovs_interfaceid": "9a214a31-3ef2-4a37-b0fa-c27a86be068c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:06:dd,bridge_name='br-int',has_traffic_filtering=True,id=9a214a31-3ef2-4a37-b0fa-c27a86be068c,network=Network(411e3c7b-1261-4661-91a6-12630b932df7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a214a31-3e') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.objects.instance [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Lazy-loading 'pci_devices' on Instance uuid 33e6f8aa-bb0d-478d-b7b5-3334302476fb {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] End _get_guest_xml xml=<domain type="kvm">
Aug 14 22:56:03 user nova-compute[72766]:   <uuid>33e6f8aa-bb0d-478d-b7b5-3334302476fb</uuid>
Aug 14 22:56:03 user nova-compute[72766]:   <name>instance-00000008</name>
Aug 14 22:56:03 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 22:56:03 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 22:56:03 user nova-compute[72766]:   <metadata>
Aug 14 22:56:03 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:56:03 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 22:56:03 user nova-compute[72766]:       <nova:name>tempest-TestVolumeSwap-server-2066569469</nova:name>
Aug 14 22:56:03 user nova-compute[72766]:       <nova:creationTime>2023-08-14 22:56:03</nova:creationTime>
Aug 14 22:56:03 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 22:56:03 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 22:56:03 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 22:56:03 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 22:56:03 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:56:03 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 22:56:03 user nova-compute[72766]:       </nova:flavor>
Aug 14 22:56:03 user nova-compute[72766]:       <nova:owner>
Aug 14 22:56:03 user nova-compute[72766]:         <nova:user uuid="74108c91a9be4bf1b51dc5f7b3f80087">tempest-TestVolumeSwap-826809882-project-member</nova:user>
Aug 14 22:56:03 user nova-compute[72766]:         <nova:project uuid="5740ddd945a1401b98aafaa1cbae8c13">tempest-TestVolumeSwap-826809882</nova:project>
Aug 14 22:56:03 user nova-compute[72766]:       </nova:owner>
Aug 14 22:56:03 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 22:56:03 user nova-compute[72766]:       <nova:ports>
Aug 14 22:56:03 user nova-compute[72766]:         <nova:port uuid="9a214a31-3ef2-4a37-b0fa-c27a86be068c">
Aug 14 22:56:03 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 14 22:56:03 user nova-compute[72766]:         </nova:port>
Aug 14 22:56:03 user nova-compute[72766]:       </nova:ports>
Aug 14 22:56:03 user nova-compute[72766]:     </nova:instance>
Aug 14 22:56:03 user nova-compute[72766]:   </metadata>
Aug 14 22:56:03 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 22:56:03 user nova-compute[72766]:     <system>
Aug 14 22:56:03 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 22:56:03 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 22:56:03 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 22:56:03 user nova-compute[72766]:       <entry name="serial">33e6f8aa-bb0d-478d-b7b5-3334302476fb</entry>
Aug 14 22:56:03 user nova-compute[72766]:       <entry name="uuid">33e6f8aa-bb0d-478d-b7b5-3334302476fb</entry>
Aug 14 22:56:03 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 22:56:03 user nova-compute[72766]:     </system>
Aug 14 22:56:03 user nova-compute[72766]:   </sysinfo>
Aug 14 22:56:03 user nova-compute[72766]:   <os>
Aug 14 22:56:03 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 22:56:03 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 22:56:03 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 22:56:03 user nova-compute[72766]:   </os>
Aug 14 22:56:03 user nova-compute[72766]:   <features>
Aug 14 22:56:03 user nova-compute[72766]:     <acpi/>
Aug 14 22:56:03 user nova-compute[72766]:     <apic/>
Aug 14 22:56:03 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 22:56:03 user nova-compute[72766]:   </features>
Aug 14 22:56:03 user nova-compute[72766]:   <clock offset="utc">
Aug 14 22:56:03 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 22:56:03 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 22:56:03 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 22:56:03 user nova-compute[72766]:   </clock>
Aug 14 22:56:03 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 22:56:03 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 22:56:03 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 22:56:03 user nova-compute[72766]:   </cpu>
Aug 14 22:56:03 user nova-compute[72766]:   <devices>
Aug 14 22:56:03 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 22:56:03 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 22:56:03 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/33e6f8aa-bb0d-478d-b7b5-3334302476fb/disk"/>
Aug 14 22:56:03 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 22:56:03 user nova-compute[72766]:     </disk>
Aug 14 22:56:03 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 22:56:03 user nova-compute[72766]:       <mac address="fa:16:3e:bb:06:dd"/>
Aug 14 22:56:03 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 22:56:03 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 22:56:03 user nova-compute[72766]:       <target dev="tap9a214a31-3e"/>
Aug 14 22:56:03 user nova-compute[72766]:     </interface>
Aug 14 22:56:03 user nova-compute[72766]:     <serial type="pty">
Aug 14 22:56:03 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/33e6f8aa-bb0d-478d-b7b5-3334302476fb/console.log" append="off"/>
Aug 14 22:56:03 user nova-compute[72766]:     </serial>
Aug 14 22:56:03 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 22:56:03 user nova-compute[72766]:     <video>
Aug 14 22:56:03 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 22:56:03 user nova-compute[72766]:     </video>
Aug 14 22:56:03 user nova-compute[72766]:     <rng model="virtio">
Aug 14 22:56:03 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 22:56:03 user nova-compute[72766]:     </rng>
Aug 14 22:56:03 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 22:56:03 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 22:56:03 user nova-compute[72766]:       <stats period="10"/>
Aug 14 22:56:03 user nova-compute[72766]:     </memballoon>
Aug 14 22:56:03 user nova-compute[72766]:   </devices>
Aug 14 22:56:03 user nova-compute[72766]: </domain>
Aug 14 22:56:03 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:55:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2066569469',display_name='tempest-TestVolumeSwap-server-2066569469',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2066569469',id=8,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKDecC6LOCTIDSHf+bGtHd82oVY7YTZ/rwmghiUc+dvaQaBUj59VHwqfdpQWbNdeqp2hsPtXJvYRgsJQVnD6PI53tjwd1U2uDPvcdF6uSDJffvmt1+bk3Opv0aNzfAvyw==',key_name='tempest-keypair-1372605118',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5740ddd945a1401b98aafaa1cbae8c13',ramdisk_id='',reservation_id='r-8km08n7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-826809882',owner_user_name='tempest-TestVolumeSwap-826809882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:56:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74108c91a9be4bf1b51dc5f7b3f80087',uuid=33e6f8aa-bb0d-478d-b7b5-3334302476fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a214a31-3ef2-4a37-b0fa-c27a86be068c", "address": "fa:16:3e:bb:06:dd", "network": {"id": "411e3c7b-1261-4661-91a6-12630b932df7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-230148116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5740ddd945a1401b98aafaa1cbae8c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a214a31-3e", "ovs_interfaceid": "9a214a31-3ef2-4a37-b0fa-c27a86be068c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Converting VIF {"id": "9a214a31-3ef2-4a37-b0fa-c27a86be068c", "address": "fa:16:3e:bb:06:dd", "network": {"id": "411e3c7b-1261-4661-91a6-12630b932df7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-230148116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5740ddd945a1401b98aafaa1cbae8c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a214a31-3e", "ovs_interfaceid": "9a214a31-3ef2-4a37-b0fa-c27a86be068c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:06:dd,bridge_name='br-int',has_traffic_filtering=True,id=9a214a31-3ef2-4a37-b0fa-c27a86be068c,network=Network(411e3c7b-1261-4661-91a6-12630b932df7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a214a31-3e') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG os_vif [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:06:dd,bridge_name='br-int',has_traffic_filtering=True,id=9a214a31-3ef2-4a37-b0fa-c27a86be068c,network=Network(411e3c7b-1261-4661-91a6-12630b932df7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a214a31-3e') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a214a31-3e, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9a214a31-3e, col_values=(('external_ids', {'iface-id': '9a214a31-3ef2-4a37-b0fa-c27a86be068c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:06:dd', 'vm-uuid': '33e6f8aa-bb0d-478d-b7b5-3334302476fb'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:56:03 user nova-compute[72766]: INFO nova.compute.manager [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Took 11.30 seconds to build instance.
Aug 14 22:56:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:56:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-62b1383a-d12a-4741-9c45-1f86c12fd6c7 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Lock "40cd301a-97f2-4f02-b091-f5a2bb1cd016" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.500s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:56:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:04 user nova-compute[72766]: INFO os_vif [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:06:dd,bridge_name='br-int',has_traffic_filtering=True,id=9a214a31-3ef2-4a37-b0fa-c27a86be068c,network=Network(411e3c7b-1261-4661-91a6-12630b932df7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a214a31-3e')
Aug 14 22:56:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:04 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:56:04 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] No VIF found with MAC fa:16:3e:bb:06:dd, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:56:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:04 user nova-compute[72766]: DEBUG nova.network.neutron [req-f8997c0a-1f37-447f-96f2-012fa2121805 req-d28580da-9cd0-45b2-bdbe-a8d221119f52 service nova] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Updated VIF entry in instance network info cache for port 9a214a31-3ef2-4a37-b0fa-c27a86be068c. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:56:04 user nova-compute[72766]: DEBUG nova.network.neutron [req-f8997c0a-1f37-447f-96f2-012fa2121805 req-d28580da-9cd0-45b2-bdbe-a8d221119f52 service nova] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Updating instance_info_cache with network_info: [{"id": "9a214a31-3ef2-4a37-b0fa-c27a86be068c", "address": "fa:16:3e:bb:06:dd", "network": {"id": "411e3c7b-1261-4661-91a6-12630b932df7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-230148116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5740ddd945a1401b98aafaa1cbae8c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a214a31-3e", "ovs_interfaceid": "9a214a31-3ef2-4a37-b0fa-c27a86be068c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:56:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f8997c0a-1f37-447f-96f2-012fa2121805 req-d28580da-9cd0-45b2-bdbe-a8d221119f52 service nova] Releasing lock "refresh_cache-33e6f8aa-bb0d-478d-b7b5-3334302476fb" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:56:05 user nova-compute[72766]: DEBUG nova.compute.manager [req-39b96a17-9189-4c20-a21d-42120fc270b7 req-5827da66-9586-42c6-a48d-f53f243532ab service nova] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Received event network-vif-plugged-58e0b222-3a0a-40d3-ad60-e92985bd3584 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:56:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-39b96a17-9189-4c20-a21d-42120fc270b7 req-5827da66-9586-42c6-a48d-f53f243532ab service nova] Acquiring lock "90b55775-2f14-4c80-b48a-b1eed2b570dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:56:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-39b96a17-9189-4c20-a21d-42120fc270b7 req-5827da66-9586-42c6-a48d-f53f243532ab service nova] Lock "90b55775-2f14-4c80-b48a-b1eed2b570dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:56:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-39b96a17-9189-4c20-a21d-42120fc270b7 req-5827da66-9586-42c6-a48d-f53f243532ab service nova] Lock "90b55775-2f14-4c80-b48a-b1eed2b570dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:56:05 user nova-compute[72766]: DEBUG nova.compute.manager [req-39b96a17-9189-4c20-a21d-42120fc270b7 req-5827da66-9586-42c6-a48d-f53f243532ab service nova] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] No waiting events found dispatching network-vif-plugged-58e0b222-3a0a-40d3-ad60-e92985bd3584 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:56:05 user nova-compute[72766]: WARNING nova.compute.manager [req-39b96a17-9189-4c20-a21d-42120fc270b7 req-5827da66-9586-42c6-a48d-f53f243532ab service nova] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Received unexpected event network-vif-plugged-58e0b222-3a0a-40d3-ad60-e92985bd3584 for instance with vm_state building and task_state spawning.
Aug 14 22:56:05 user nova-compute[72766]: DEBUG nova.compute.manager [req-39b96a17-9189-4c20-a21d-42120fc270b7 req-5827da66-9586-42c6-a48d-f53f243532ab service nova] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Received event network-vif-plugged-58e0b222-3a0a-40d3-ad60-e92985bd3584 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:56:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-39b96a17-9189-4c20-a21d-42120fc270b7 req-5827da66-9586-42c6-a48d-f53f243532ab service nova] Acquiring lock "90b55775-2f14-4c80-b48a-b1eed2b570dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:56:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-39b96a17-9189-4c20-a21d-42120fc270b7 req-5827da66-9586-42c6-a48d-f53f243532ab service nova] Lock "90b55775-2f14-4c80-b48a-b1eed2b570dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:56:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-39b96a17-9189-4c20-a21d-42120fc270b7 req-5827da66-9586-42c6-a48d-f53f243532ab service nova] Lock "90b55775-2f14-4c80-b48a-b1eed2b570dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:56:05 user nova-compute[72766]: DEBUG nova.compute.manager [req-39b96a17-9189-4c20-a21d-42120fc270b7 req-5827da66-9586-42c6-a48d-f53f243532ab service nova] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] No waiting events found dispatching network-vif-plugged-58e0b222-3a0a-40d3-ad60-e92985bd3584 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:56:05 user nova-compute[72766]: WARNING nova.compute.manager [req-39b96a17-9189-4c20-a21d-42120fc270b7 req-5827da66-9586-42c6-a48d-f53f243532ab service nova] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Received unexpected event network-vif-plugged-58e0b222-3a0a-40d3-ad60-e92985bd3584 for instance with vm_state building and task_state spawning.
Aug 14 22:56:06 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:06 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:06 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:06 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:06 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:06 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:06 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:07 user nova-compute[72766]: DEBUG nova.compute.manager [req-53fafd6b-9a56-4ceb-ac96-0dc01304cb24 req-651b204d-ab21-4cad-8c50-040b36dbcecf service nova] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Received event network-vif-plugged-9a214a31-3ef2-4a37-b0fa-c27a86be068c {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:56:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-53fafd6b-9a56-4ceb-ac96-0dc01304cb24 req-651b204d-ab21-4cad-8c50-040b36dbcecf service nova] Acquiring lock "33e6f8aa-bb0d-478d-b7b5-3334302476fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:56:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-53fafd6b-9a56-4ceb-ac96-0dc01304cb24 req-651b204d-ab21-4cad-8c50-040b36dbcecf service nova] Lock "33e6f8aa-bb0d-478d-b7b5-3334302476fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:56:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-53fafd6b-9a56-4ceb-ac96-0dc01304cb24 req-651b204d-ab21-4cad-8c50-040b36dbcecf service nova] Lock "33e6f8aa-bb0d-478d-b7b5-3334302476fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:56:07 user nova-compute[72766]: DEBUG nova.compute.manager [req-53fafd6b-9a56-4ceb-ac96-0dc01304cb24 req-651b204d-ab21-4cad-8c50-040b36dbcecf service nova] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] No waiting events found dispatching network-vif-plugged-9a214a31-3ef2-4a37-b0fa-c27a86be068c {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:56:07 user nova-compute[72766]: WARNING nova.compute.manager [req-53fafd6b-9a56-4ceb-ac96-0dc01304cb24 req-651b204d-ab21-4cad-8c50-040b36dbcecf service nova] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Received unexpected event network-vif-plugged-9a214a31-3ef2-4a37-b0fa-c27a86be068c for instance with vm_state building and task_state spawning.
Aug 14 22:56:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:07 user nova-compute[72766]: DEBUG nova.compute.manager [req-cef5279a-5a89-4344-ae68-0814718a77b0 req-4f11a89d-8065-4d39-9fc4-9c76434fdc53 service nova] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Received event network-vif-plugged-9c7ce835-f163-4f4a-bd47-26d5e06ff451 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:56:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-cef5279a-5a89-4344-ae68-0814718a77b0 req-4f11a89d-8065-4d39-9fc4-9c76434fdc53 service nova] Acquiring lock "0850bb6c-6e3e-4007-8478-8eba53089158-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:56:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-cef5279a-5a89-4344-ae68-0814718a77b0 req-4f11a89d-8065-4d39-9fc4-9c76434fdc53 service nova] Lock "0850bb6c-6e3e-4007-8478-8eba53089158-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:56:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-cef5279a-5a89-4344-ae68-0814718a77b0 req-4f11a89d-8065-4d39-9fc4-9c76434fdc53 service nova] Lock "0850bb6c-6e3e-4007-8478-8eba53089158-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:56:07 user nova-compute[72766]: DEBUG nova.compute.manager [req-cef5279a-5a89-4344-ae68-0814718a77b0 req-4f11a89d-8065-4d39-9fc4-9c76434fdc53 service nova] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] No waiting events found dispatching network-vif-plugged-9c7ce835-f163-4f4a-bd47-26d5e06ff451 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:56:07 user nova-compute[72766]: WARNING nova.compute.manager [req-cef5279a-5a89-4344-ae68-0814718a77b0 req-4f11a89d-8065-4d39-9fc4-9c76434fdc53 service nova] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Received unexpected event network-vif-plugged-9c7ce835-f163-4f4a-bd47-26d5e06ff451 for instance with vm_state active and task_state None.
Aug 14 22:56:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Acquiring lock "a9d6011c-da14-4fcc-8e31-3063db57b2a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:56:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Lock "a9d6011c-da14-4fcc-8e31-3063db57b2a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:56:08 user nova-compute[72766]: DEBUG nova.compute.manager [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 22:56:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:56:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:56:08 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 22:56:08 user nova-compute[72766]: INFO nova.compute.claims [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Claim successful on node user
Aug 14 22:56:08 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692053768.9288058, 90b55775-2f14-4c80-b48a-b1eed2b570dc => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:56:08 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] VM Resumed (Lifecycle Event)
Aug 14 22:56:08 user nova-compute[72766]: DEBUG nova.compute.manager [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 22:56:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 22:56:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:08 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Instance spawned successfully.
Aug 14 22:56:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 22:56:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:08 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:56:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:08 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:56:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:09 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:56:09 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692053768.9294167, 90b55775-2f14-4c80-b48a-b1eed2b570dc => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:56:09 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] VM Started (Lifecycle Event)
Aug 14 22:56:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:56:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:56:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:56:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:56:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:56:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:56:09 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:56:09 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:56:09 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:56:09 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:56:09 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:56:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.835s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:56:09 user nova-compute[72766]: DEBUG nova.compute.manager [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 22:56:09 user nova-compute[72766]: INFO nova.compute.manager [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Took 12.51 seconds to spawn the instance on the hypervisor.
Aug 14 22:56:09 user nova-compute[72766]: DEBUG nova.compute.manager [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:56:09 user nova-compute[72766]: DEBUG nova.compute.manager [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 22:56:09 user nova-compute[72766]: DEBUG nova.network.neutron [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 22:56:09 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 22:56:09 user nova-compute[72766]: INFO nova.compute.manager [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Took 14.05 seconds to build instance.
Aug 14 22:56:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eac2d261-0a95-4ad1-9fd4-313ebc79a364 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Lock "90b55775-2f14-4c80-b48a-b1eed2b570dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.222s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:56:09 user nova-compute[72766]: DEBUG nova.compute.manager [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 22:56:09 user nova-compute[72766]: DEBUG nova.policy [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e0c74f355e34ec6b175e136f6401b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2299692e42b74c9c85a255f80990e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 22:56:09 user nova-compute[72766]: INFO nova.virt.block_device [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Booting with volume bdfde062-9b2c-45a4-be3a-eccc18e9cef9 at /dev/vda
Aug 14 22:56:09 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:56:09 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Cleaning up deleted instances {{(pid=72766) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 22:56:09 user nova-compute[72766]: DEBUG nova.compute.manager [req-bb9350dd-d626-46ae-af5c-6f2a34d7fd84 req-52c58c0b-e18c-44c3-a3ed-6d4c1e2db95e service nova] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Received event network-vif-plugged-9a214a31-3ef2-4a37-b0fa-c27a86be068c {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:56:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-bb9350dd-d626-46ae-af5c-6f2a34d7fd84 req-52c58c0b-e18c-44c3-a3ed-6d4c1e2db95e service nova] Acquiring lock "33e6f8aa-bb0d-478d-b7b5-3334302476fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:56:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-bb9350dd-d626-46ae-af5c-6f2a34d7fd84 req-52c58c0b-e18c-44c3-a3ed-6d4c1e2db95e service nova] Lock "33e6f8aa-bb0d-478d-b7b5-3334302476fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:56:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-bb9350dd-d626-46ae-af5c-6f2a34d7fd84 req-52c58c0b-e18c-44c3-a3ed-6d4c1e2db95e service nova] Lock "33e6f8aa-bb0d-478d-b7b5-3334302476fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:56:09 user nova-compute[72766]: DEBUG nova.compute.manager [req-bb9350dd-d626-46ae-af5c-6f2a34d7fd84 req-52c58c0b-e18c-44c3-a3ed-6d4c1e2db95e service nova] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] No waiting events found dispatching network-vif-plugged-9a214a31-3ef2-4a37-b0fa-c27a86be068c {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:56:09 user nova-compute[72766]: WARNING nova.compute.manager [req-bb9350dd-d626-46ae-af5c-6f2a34d7fd84 req-52c58c0b-e18c-44c3-a3ed-6d4c1e2db95e service nova] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Received unexpected event network-vif-plugged-9a214a31-3ef2-4a37-b0fa-c27a86be068c for instance with vm_state building and task_state spawning.
Aug 14 22:56:09 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] There are 0 instances to clean {{(pid=72766) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 22:56:09 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:56:09 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72766) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 22:56:09 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:56:09 user nova-compute[72766]: DEBUG os_brick.utils [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:56:09 user nova-compute[72766]: INFO oslo.privsep.daemon [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp00v9o9gt/privsep.sock']
Aug 14 22:56:09 user sudo[83585]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp00v9o9gt/privsep.sock
Aug 14 22:56:09 user sudo[83585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 14 22:56:10 user nova-compute[72766]: DEBUG nova.compute.manager [req-219ba97e-622e-4e2b-8e06-01b9ef9b5049 req-d3abb69b-49c5-488d-9369-f8f46276597c service nova] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Received event network-vif-plugged-9c7ce835-f163-4f4a-bd47-26d5e06ff451 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:56:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-219ba97e-622e-4e2b-8e06-01b9ef9b5049 req-d3abb69b-49c5-488d-9369-f8f46276597c service nova] Acquiring lock "0850bb6c-6e3e-4007-8478-8eba53089158-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:56:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-219ba97e-622e-4e2b-8e06-01b9ef9b5049 req-d3abb69b-49c5-488d-9369-f8f46276597c service nova] Lock "0850bb6c-6e3e-4007-8478-8eba53089158-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:56:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-219ba97e-622e-4e2b-8e06-01b9ef9b5049 req-d3abb69b-49c5-488d-9369-f8f46276597c service nova] Lock "0850bb6c-6e3e-4007-8478-8eba53089158-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:56:10 user nova-compute[72766]: DEBUG nova.compute.manager [req-219ba97e-622e-4e2b-8e06-01b9ef9b5049 req-d3abb69b-49c5-488d-9369-f8f46276597c service nova] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] No waiting events found dispatching network-vif-plugged-9c7ce835-f163-4f4a-bd47-26d5e06ff451 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:56:10 user nova-compute[72766]: WARNING nova.compute.manager [req-219ba97e-622e-4e2b-8e06-01b9ef9b5049 req-d3abb69b-49c5-488d-9369-f8f46276597c service nova] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Received unexpected event network-vif-plugged-9c7ce835-f163-4f4a-bd47-26d5e06ff451 for instance with vm_state active and task_state None.
Aug 14 22:56:10 user nova-compute[72766]: DEBUG nova.compute.manager [req-219ba97e-622e-4e2b-8e06-01b9ef9b5049 req-d3abb69b-49c5-488d-9369-f8f46276597c service nova] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Received event network-vif-plugged-3eb61059-fbcd-4dbc-9a10-81aed042e936 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:56:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-219ba97e-622e-4e2b-8e06-01b9ef9b5049 req-d3abb69b-49c5-488d-9369-f8f46276597c service nova] Acquiring lock "b55141bc-d426-4d35-8ae5-269ece19a793-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:56:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-219ba97e-622e-4e2b-8e06-01b9ef9b5049 req-d3abb69b-49c5-488d-9369-f8f46276597c service nova] Lock "b55141bc-d426-4d35-8ae5-269ece19a793-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:56:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-219ba97e-622e-4e2b-8e06-01b9ef9b5049 req-d3abb69b-49c5-488d-9369-f8f46276597c service nova] Lock "b55141bc-d426-4d35-8ae5-269ece19a793-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:56:10 user nova-compute[72766]: DEBUG nova.compute.manager [req-219ba97e-622e-4e2b-8e06-01b9ef9b5049 req-d3abb69b-49c5-488d-9369-f8f46276597c service nova] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] No waiting events found dispatching network-vif-plugged-3eb61059-fbcd-4dbc-9a10-81aed042e936 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:56:10 user nova-compute[72766]: WARNING nova.compute.manager [req-219ba97e-622e-4e2b-8e06-01b9ef9b5049 req-d3abb69b-49c5-488d-9369-f8f46276597c service nova] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Received unexpected event network-vif-plugged-3eb61059-fbcd-4dbc-9a10-81aed042e936 for instance with vm_state building and task_state spawning.
Aug 14 22:56:10 user nova-compute[72766]: DEBUG nova.compute.manager [req-219ba97e-622e-4e2b-8e06-01b9ef9b5049 req-d3abb69b-49c5-488d-9369-f8f46276597c service nova] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Received event network-vif-plugged-3eb61059-fbcd-4dbc-9a10-81aed042e936 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:56:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-219ba97e-622e-4e2b-8e06-01b9ef9b5049 req-d3abb69b-49c5-488d-9369-f8f46276597c service nova] Acquiring lock "b55141bc-d426-4d35-8ae5-269ece19a793-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:56:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-219ba97e-622e-4e2b-8e06-01b9ef9b5049 req-d3abb69b-49c5-488d-9369-f8f46276597c service nova] Lock "b55141bc-d426-4d35-8ae5-269ece19a793-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:56:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-219ba97e-622e-4e2b-8e06-01b9ef9b5049 req-d3abb69b-49c5-488d-9369-f8f46276597c service nova] Lock "b55141bc-d426-4d35-8ae5-269ece19a793-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:56:10 user nova-compute[72766]: DEBUG nova.compute.manager [req-219ba97e-622e-4e2b-8e06-01b9ef9b5049 req-d3abb69b-49c5-488d-9369-f8f46276597c service nova] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] No waiting events found dispatching network-vif-plugged-3eb61059-fbcd-4dbc-9a10-81aed042e936 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:56:10 user nova-compute[72766]: WARNING nova.compute.manager [req-219ba97e-622e-4e2b-8e06-01b9ef9b5049 req-d3abb69b-49c5-488d-9369-f8f46276597c service nova] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Received unexpected event network-vif-plugged-3eb61059-fbcd-4dbc-9a10-81aed042e936 for instance with vm_state building and task_state spawning.
Aug 14 22:56:10 user nova-compute[72766]: DEBUG nova.network.neutron [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Successfully created port: abead9ae-b0f3-474a-b77a-91733d6d3543 {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 22:56:10 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692053770.8591485, 33e6f8aa-bb0d-478d-b7b5-3334302476fb => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:56:10 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] VM Resumed (Lifecycle Event)
Aug 14 22:56:10 user nova-compute[72766]: DEBUG nova.compute.manager [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 22:56:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 22:56:10 user nova-compute[72766]: DEBUG nova.compute.manager [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 22:56:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 22:56:10 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Instance spawned successfully.
Aug 14 22:56:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 22:56:10 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Instance spawned successfully.
Aug 14 22:56:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 22:56:10 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:56:10 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:56:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:56:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:56:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:56:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:56:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:56:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:56:10 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:56:10 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692053770.8610227, 33e6f8aa-bb0d-478d-b7b5-3334302476fb => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:56:10 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] VM Started (Lifecycle Event)
Aug 14 22:56:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:56:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:56:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:56:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:56:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:56:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:56:10 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:56:10 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:56:11 user nova-compute[72766]: INFO nova.compute.manager [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Took 12.02 seconds to spawn the instance on the hypervisor.
Aug 14 22:56:11 user nova-compute[72766]: DEBUG nova.compute.manager [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:56:11 user nova-compute[72766]: INFO nova.compute.manager [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Took 11.11 seconds to spawn the instance on the hypervisor.
Aug 14 22:56:11 user nova-compute[72766]: DEBUG nova.compute.manager [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:56:11 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:56:11 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692053770.8660898, b55141bc-d426-4d35-8ae5-269ece19a793 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:56:11 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] VM Resumed (Lifecycle Event)
Aug 14 22:56:11 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:56:11 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:56:11 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:56:11 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692053770.8663008, b55141bc-d426-4d35-8ae5-269ece19a793 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:56:11 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] VM Started (Lifecycle Event)
Aug 14 22:56:11 user nova-compute[72766]: INFO nova.compute.manager [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Took 13.48 seconds to build instance.
Aug 14 22:56:11 user nova-compute[72766]: INFO nova.compute.manager [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Took 13.18 seconds to build instance.
Aug 14 22:56:11 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:56:11 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:56:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-29c9ce0d-a8f8-4673-b0a5-56a141593e2e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Lock "33e6f8aa-bb0d-478d-b7b5-3334302476fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.383s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:56:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-73b3d34b-5f9b-4b67-94f9-0e654678782e tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Lock "b55141bc-d426-4d35-8ae5-269ece19a793" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.771s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:56:11 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:56:12 user nova-compute[72766]: DEBUG nova.network.neutron [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Successfully updated port: abead9ae-b0f3-474a-b77a-91733d6d3543 {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 22:56:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Acquiring lock "refresh_cache-a9d6011c-da14-4fcc-8e31-3063db57b2a6" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:56:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Acquired lock "refresh_cache-a9d6011c-da14-4fcc-8e31-3063db57b2a6" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:56:12 user nova-compute[72766]: DEBUG nova.network.neutron [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:56:12 user nova-compute[72766]: DEBUG nova.compute.manager [req-783920af-ebae-4199-acec-f12ed02d8155 req-5e580f14-9ec0-471d-ac28-d5229ff8a281 service nova] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Received event network-changed-abead9ae-b0f3-474a-b77a-91733d6d3543 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:56:12 user nova-compute[72766]: DEBUG nova.compute.manager [req-783920af-ebae-4199-acec-f12ed02d8155 req-5e580f14-9ec0-471d-ac28-d5229ff8a281 service nova] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Refreshing instance network info cache due to event network-changed-abead9ae-b0f3-474a-b77a-91733d6d3543. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:56:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-783920af-ebae-4199-acec-f12ed02d8155 req-5e580f14-9ec0-471d-ac28-d5229ff8a281 service nova] Acquiring lock "refresh_cache-a9d6011c-da14-4fcc-8e31-3063db57b2a6" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:56:12 user sudo[83585]: pam_unix(sudo:session): session closed for user root
Aug 14 22:56:12 user nova-compute[72766]: DEBUG nova.network.neutron [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 22:56:12 user nova-compute[72766]: INFO oslo.privsep.daemon [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Spawned new privsep daemon via rootwrap
Aug 14 22:56:12 user nova-compute[72766]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 14 22:56:12 user nova-compute[72766]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 14 22:56:12 user nova-compute[72766]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 14 22:56:12 user nova-compute[72766]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83651
Aug 14 22:56:12 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5efb75-9e66-4268-be9c-4015800d4e91]: (2,) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:56:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:56:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.026s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:56:12 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d10ccd-8884-4cd9-b2b1-b1e5176de771]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:56:12 user nova-compute[72766]: WARNING os_brick.initiator.connectors.nvmeof [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 14 22:56:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:56:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.026s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:56:12 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67720f0-4330-476d-9035-efedc79f291d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:56:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:56:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:56:12 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f2d5f1-22f4-46e7-9fc0-bcc41db8e524]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:56:12 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ed383a-e545-4242-bb81-2c7da0c58194]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:56:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:56:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:56:12 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 22:56:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:56:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:56:12 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 22:56:12 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e39ce0-c3b7-41e3-bba1-1f5702d351af]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:56:12 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 22:56:12 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 22:56:12 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 22:56:12 user nova-compute[72766]: DEBUG os_brick.utils [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] <== get_connector_properties: return (2823ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:56:12 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Updating existing volume attachment record: ec796364-0b0b-441e-940a-2e135f383853 {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 22:56:12 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:56:12 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 22:56:12 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Rebuilding the list of instances to heal {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 22:56:12 user nova-compute[72766]: DEBUG nova.network.neutron [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Updating instance_info_cache with network_info: [{"id": "abead9ae-b0f3-474a-b77a-91733d6d3543", "address": "fa:16:3e:c8:a4:ce", "network": {"id": "58367c0d-d2f6-441c-8a2f-310e045b9cf0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-296205787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2299692e42b74c9c85a255f80990e870", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabead9ae-b0", "ovs_interfaceid": "abead9ae-b0f3-474a-b77a-91733d6d3543", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:56:12 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Skipping network cache update for instance because it is Building. {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 14 22:56:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Releasing lock "refresh_cache-a9d6011c-da14-4fcc-8e31-3063db57b2a6" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:56:12 user nova-compute[72766]: DEBUG nova.compute.manager [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Instance network_info: |[{"id": "abead9ae-b0f3-474a-b77a-91733d6d3543", "address": "fa:16:3e:c8:a4:ce", "network": {"id": "58367c0d-d2f6-441c-8a2f-310e045b9cf0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-296205787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2299692e42b74c9c85a255f80990e870", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabead9ae-b0", "ovs_interfaceid": "abead9ae-b0f3-474a-b77a-91733d6d3543", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 22:56:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-783920af-ebae-4199-acec-f12ed02d8155 req-5e580f14-9ec0-471d-ac28-d5229ff8a281 service nova] Acquired lock "refresh_cache-a9d6011c-da14-4fcc-8e31-3063db57b2a6" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:56:12 user nova-compute[72766]: DEBUG nova.network.neutron [req-783920af-ebae-4199-acec-f12ed02d8155 req-5e580f14-9ec0-471d-ac28-d5229ff8a281 service nova] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Refreshing network info cache for port abead9ae-b0f3-474a-b77a-91733d6d3543 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:56:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:56:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:56:12 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 22:56:12 user nova-compute[72766]: DEBUG nova.objects.instance [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lazy-loading 'info_cache' on Instance uuid 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:56:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:13 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Updating instance_info_cache with network_info: [{"id": "098d7854-a4f9-4a29-ad8d-552083e4cf23", "address": "fa:16:3e:50:0b:52", "network": {"id": "aedbfcc5-5c6c-4eba-9533-aa5e618d1f4c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1720375606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c9d8bf74b94b4c9d82ec1308a7036e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap098d7854-a4", "ovs_interfaceid": "098d7854-a4f9-4a29-ad8d-552083e4cf23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:56:13 user nova-compute[72766]: DEBUG nova.network.neutron [req-783920af-ebae-4199-acec-f12ed02d8155 req-5e580f14-9ec0-471d-ac28-d5229ff8a281 service nova] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Updated VIF entry in instance network info cache for port abead9ae-b0f3-474a-b77a-91733d6d3543. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:56:13 user nova-compute[72766]: DEBUG nova.network.neutron [req-783920af-ebae-4199-acec-f12ed02d8155 req-5e580f14-9ec0-471d-ac28-d5229ff8a281 service nova] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Updating instance_info_cache with network_info: [{"id": "abead9ae-b0f3-474a-b77a-91733d6d3543", "address": "fa:16:3e:c8:a4:ce", "network": {"id": "58367c0d-d2f6-441c-8a2f-310e045b9cf0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-296205787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2299692e42b74c9c85a255f80990e870", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabead9ae-b0", "ovs_interfaceid": "abead9ae-b0f3-474a-b77a-91733d6d3543", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:56:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:56:13 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 22:56:13 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:56:13 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:56:13 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:56:13 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:56:13 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 22:56:13 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:56:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-783920af-ebae-4199-acec-f12ed02d8155 req-5e580f14-9ec0-471d-ac28-d5229ff8a281 service nova] Releasing lock "refresh_cache-a9d6011c-da14-4fcc-8e31-3063db57b2a6" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:56:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:56:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:56:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:56:14 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 22:56:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33e6f8aa-bb0d-478d-b7b5-3334302476fb/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:56:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33e6f8aa-bb0d-478d-b7b5-3334302476fb/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:56:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33e6f8aa-bb0d-478d-b7b5-3334302476fb/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:56:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33e6f8aa-bb0d-478d-b7b5-3334302476fb/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:56:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:56:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:56:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:56:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:56:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0850bb6c-6e3e-4007-8478-8eba53089158/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:56:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0850bb6c-6e3e-4007-8478-8eba53089158/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:56:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0850bb6c-6e3e-4007-8478-8eba53089158/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:56:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0850bb6c-6e3e-4007-8478-8eba53089158/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:56:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:56:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:56:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:56:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:56:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:56:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa/disk --force-share --output=json" returned: 0 in 0.304s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:56:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:56:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:56:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:56:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:56:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:56:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:56:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40cd301a-97f2-4f02-b091-f5a2bb1cd016/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:56:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40cd301a-97f2-4f02-b091-f5a2bb1cd016/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:56:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40cd301a-97f2-4f02-b091-f5a2bb1cd016/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:56:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40cd301a-97f2-4f02-b091-f5a2bb1cd016/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:56:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b55141bc-d426-4d35-8ae5-269ece19a793/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:56:18 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b55141bc-d426-4d35-8ae5-269ece19a793/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:56:18 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b55141bc-d426-4d35-8ae5-269ece19a793/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:56:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:18 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b55141bc-d426-4d35-8ae5-269ece19a793/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:56:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:19 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:56:19 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:56:19 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=7695MB free_disk=25.89084243774414GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 22:56:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:56:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:56:19 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:56:19 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance b563c62d-d117-4bb5-9157-7387c51ed641 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:56:19 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:56:19 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 0850bb6c-6e3e-4007-8478-8eba53089158 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:56:19 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 40cd301a-97f2-4f02-b091-f5a2bb1cd016 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:56:19 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 90b55775-2f14-4c80-b48a-b1eed2b570dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:56:19 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance b55141bc-d426-4d35-8ae5-269ece19a793 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:56:19 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 33e6f8aa-bb0d-478d-b7b5-3334302476fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:56:19 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance a9d6011c-da14-4fcc-8e31-3063db57b2a6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:56:19 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 22:56:19 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 22:56:19 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Refreshing inventories for resource provider 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 22:56:19 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Updating ProviderTree inventory for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 22:56:19 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Updating inventory in ProviderTree for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 22:56:19 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Refreshing aggregate associations for resource provider 45c8ff08-bf31-4ab6-8452-2e293102f899, aggregates: None {{(pid=72766) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 22:56:19 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Refreshing trait associations for resource provider 45c8ff08-bf31-4ab6-8452-2e293102f899, traits: COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=72766) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 22:56:20 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:56:20 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:56:20 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 22:56:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.075s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:56:21 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:56:21 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:56:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG nova.compute.manager [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 22:56:24 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Creating image(s)
Aug 14 22:56:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Did not create local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Ensure instance console log exists: /opt/stack/data/nova/instances/a9d6011c-da14-4fcc-8e31-3063db57b2a6/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Start _get_guest_xml network_info=[{"id": "abead9ae-b0f3-474a-b77a-91733d6d3543", "address": "fa:16:3e:c8:a4:ce", "network": {"id": "58367c0d-d2f6-441c-8a2f-310e045b9cf0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-296205787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2299692e42b74c9c85a255f80990e870", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabead9ae-b0", "ovs_interfaceid": "abead9ae-b0f3-474a-b77a-91733d6d3543", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': 'ec796364-0b0b-441e-940a-2e135f383853', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wjbIlVOW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a9d6011c-da14-4fcc-8e31-3063db57b2a6', 'attached_at': '', 'detached_at': '', 'volume_id': 'bdfde062-9b2c-45a4-be3a-eccc18e9cef9', 'serial': 'bdfde062-9b2c-45a4-be3a-eccc18e9cef9'}, 'volume_type': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 22:56:24 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:56:24 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:56:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG os_brick.initiator.connector [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Factory for ISCSI on None {{(pid=72766) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.007s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wjbIlVOW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:56:24 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:56:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:56:24 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:56:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:56:24 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 22:56:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cf2bdf-de62-4ff0-ba0c-5420e46d1ca4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 22:56:24 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2252d53-2ff0-4a8f-8533-7e940dabf17b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9] added
Aug 14 22:56:24 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[7672e3aa-3c0d-4ee8-b861-23479ad6ab1b]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c039d5-6442-41f4-890c-9b833c15a802]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wjbIlVOW {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wjbIlVOW" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[5166b0ee-f49c-454d-90f5-0b91316d313d]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wjbIlVOW'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d949975f-2bea-450e-997e-253ba30d11fd]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1074f2-f47e-40d7-a8cb-941d5bf680e9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 22:56:24 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 22:56:24 user nova-compute[72766]:  {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:56:24 user nova-compute[72766]: WARNING os_brick.initiator.connectors.iscsi [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 22:56:24 user nova-compute[72766]: 
Aug 14 22:56:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[34284f4e-4052-4724-96e1-c11e9718548b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9, portal: 172.16.0.220,3260]
Aug 14 22:56:24 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9, portal: 172.16.0.220,3260] successful.
Aug 14 22:56:24 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9b6815-ae57-4591-a08a-13bcf7cbb3a5]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[52427fbd-f383-4a5e-abd0-12707d83e8fc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 22:56:24 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 22:56:24 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed1f020-8c36-4883-a4f5-20a702b90d91]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:56:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wjbIlVOW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 22:56:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:56:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23265626139646563', 'path': '/dev/sdb'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:56:25 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265626139646563', 'path': '/dev/sdb'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 22:56:25 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-273402320',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-273402320',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPaXy9hxXbMdshWzbQLXVvz7nDESavIOLXia9W/DDo7wSvfhX1RXq42V2N0aLa9Nl7IVLmCAYxoggrECsnBwocK7ffwayiXoTZ4mdKpIHRx8EnNL76GFfNmkvMKW2r7fg==',key_name='tempest-keypair-855485889',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2299692e42b74c9c85a255f80990e870',ramdisk_id='',reservation_id='r-f401gegj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1913842238',owner_user_name='tempest-ServerActionsV293TestJSON-1913842238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:56:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e0c74f355e34ec6b175e136f6401b20',uuid=a9d6011c-da14-4fcc-8e31-3063db57b2a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abead9ae-b0f3-474a-b77a-91733d6d3543", "address": "fa:16:3e:c8:a4:ce", "network": {"id": "58367c0d-d2f6-441c-8a2f-310e045b9cf0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-296205787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2299692e42b74c9c85a255f80990e870", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabead9ae-b0", "ovs_interfaceid": "abead9ae-b0f3-474a-b77a-91733d6d3543", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 22:56:25 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Converting VIF {"id": "abead9ae-b0f3-474a-b77a-91733d6d3543", "address": "fa:16:3e:c8:a4:ce", "network": {"id": "58367c0d-d2f6-441c-8a2f-310e045b9cf0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-296205787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2299692e42b74c9c85a255f80990e870", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabead9ae-b0", "ovs_interfaceid": "abead9ae-b0f3-474a-b77a-91733d6d3543", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:56:25 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:a4:ce,bridge_name='br-int',has_traffic_filtering=True,id=abead9ae-b0f3-474a-b77a-91733d6d3543,network=Network(58367c0d-d2f6-441c-8a2f-310e045b9cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabead9ae-b0') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:56:25 user nova-compute[72766]: DEBUG nova.objects.instance [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Lazy-loading 'pci_devices' on Instance uuid a9d6011c-da14-4fcc-8e31-3063db57b2a6 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:56:25 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] End _get_guest_xml xml=<domain type="kvm">
Aug 14 22:56:25 user nova-compute[72766]:   <uuid>a9d6011c-da14-4fcc-8e31-3063db57b2a6</uuid>
Aug 14 22:56:25 user nova-compute[72766]:   <name>instance-00000009</name>
Aug 14 22:56:25 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 22:56:25 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 22:56:25 user nova-compute[72766]:   <metadata>
Aug 14 22:56:25 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:56:25 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 22:56:25 user nova-compute[72766]:       <nova:name>tempest-ServerActionsV293TestJSON-server-273402320</nova:name>
Aug 14 22:56:25 user nova-compute[72766]:       <nova:creationTime>2023-08-14 22:56:24</nova:creationTime>
Aug 14 22:56:25 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 22:56:25 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 22:56:25 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 22:56:25 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 22:56:25 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:56:25 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 22:56:25 user nova-compute[72766]:       </nova:flavor>
Aug 14 22:56:25 user nova-compute[72766]:       <nova:owner>
Aug 14 22:56:25 user nova-compute[72766]:         <nova:user uuid="7e0c74f355e34ec6b175e136f6401b20">tempest-ServerActionsV293TestJSON-1913842238-project-member</nova:user>
Aug 14 22:56:25 user nova-compute[72766]:         <nova:project uuid="2299692e42b74c9c85a255f80990e870">tempest-ServerActionsV293TestJSON-1913842238</nova:project>
Aug 14 22:56:25 user nova-compute[72766]:       </nova:owner>
Aug 14 22:56:25 user nova-compute[72766]:       <nova:ports>
Aug 14 22:56:25 user nova-compute[72766]:         <nova:port uuid="abead9ae-b0f3-474a-b77a-91733d6d3543">
Aug 14 22:56:25 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 22:56:25 user nova-compute[72766]:         </nova:port>
Aug 14 22:56:25 user nova-compute[72766]:       </nova:ports>
Aug 14 22:56:25 user nova-compute[72766]:     </nova:instance>
Aug 14 22:56:25 user nova-compute[72766]:   </metadata>
Aug 14 22:56:25 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 22:56:25 user nova-compute[72766]:     <system>
Aug 14 22:56:25 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 22:56:25 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 22:56:25 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 22:56:25 user nova-compute[72766]:       <entry name="serial">a9d6011c-da14-4fcc-8e31-3063db57b2a6</entry>
Aug 14 22:56:25 user nova-compute[72766]:       <entry name="uuid">a9d6011c-da14-4fcc-8e31-3063db57b2a6</entry>
Aug 14 22:56:25 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 22:56:25 user nova-compute[72766]:     </system>
Aug 14 22:56:25 user nova-compute[72766]:   </sysinfo>
Aug 14 22:56:25 user nova-compute[72766]:   <os>
Aug 14 22:56:25 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 22:56:25 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 22:56:25 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 22:56:25 user nova-compute[72766]:   </os>
Aug 14 22:56:25 user nova-compute[72766]:   <features>
Aug 14 22:56:25 user nova-compute[72766]:     <acpi/>
Aug 14 22:56:25 user nova-compute[72766]:     <apic/>
Aug 14 22:56:25 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 22:56:25 user nova-compute[72766]:   </features>
Aug 14 22:56:25 user nova-compute[72766]:   <clock offset="utc">
Aug 14 22:56:25 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 22:56:25 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 22:56:25 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 22:56:25 user nova-compute[72766]:   </clock>
Aug 14 22:56:25 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 22:56:25 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 22:56:25 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 22:56:25 user nova-compute[72766]:   </cpu>
Aug 14 22:56:25 user nova-compute[72766]:   <devices>
Aug 14 22:56:25 user nova-compute[72766]:     <disk type="block" device="disk">
Aug 14 22:56:25 user nova-compute[72766]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:56:25 user nova-compute[72766]:       <source dev="/dev/sdb"/>
Aug 14 22:56:25 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 22:56:25 user nova-compute[72766]:       <serial>bdfde062-9b2c-45a4-be3a-eccc18e9cef9</serial>
Aug 14 22:56:25 user nova-compute[72766]:     </disk>
Aug 14 22:56:25 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 22:56:25 user nova-compute[72766]:       <mac address="fa:16:3e:c8:a4:ce"/>
Aug 14 22:56:25 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 22:56:25 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 22:56:25 user nova-compute[72766]:       <target dev="tapabead9ae-b0"/>
Aug 14 22:56:25 user nova-compute[72766]:     </interface>
Aug 14 22:56:25 user nova-compute[72766]:     <serial type="pty">
Aug 14 22:56:25 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/a9d6011c-da14-4fcc-8e31-3063db57b2a6/console.log" append="off"/>
Aug 14 22:56:25 user nova-compute[72766]:     </serial>
Aug 14 22:56:25 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 22:56:25 user nova-compute[72766]:     <video>
Aug 14 22:56:25 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 22:56:25 user nova-compute[72766]:     </video>
Aug 14 22:56:25 user nova-compute[72766]:     <rng model="virtio">
Aug 14 22:56:25 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 22:56:25 user nova-compute[72766]:     </rng>
Aug 14 22:56:25 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 22:56:25 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 22:56:25 user nova-compute[72766]:       <stats period="10"/>
Aug 14 22:56:25 user nova-compute[72766]:     </memballoon>
Aug 14 22:56:25 user nova-compute[72766]:   </devices>
Aug 14 22:56:25 user nova-compute[72766]: </domain>
Aug 14 22:56:25 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 22:56:25 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-273402320',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-273402320',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPaXy9hxXbMdshWzbQLXVvz7nDESavIOLXia9W/DDo7wSvfhX1RXq42V2N0aLa9Nl7IVLmCAYxoggrECsnBwocK7ffwayiXoTZ4mdKpIHRx8EnNL76GFfNmkvMKW2r7fg==',key_name='tempest-keypair-855485889',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2299692e42b74c9c85a255f80990e870',ramdisk_id='',reservation_id='r-f401gegj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1913842238',owner_user_name='tempest-ServerActionsV293TestJSON-1913842238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:56:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e0c74f355e34ec6b175e136f6401b20',uuid=a9d6011c-da14-4fcc-8e31-3063db57b2a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abead9ae-b0f3-474a-b77a-91733d6d3543", "address": "fa:16:3e:c8:a4:ce", "network": {"id": "58367c0d-d2f6-441c-8a2f-310e045b9cf0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-296205787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2299692e42b74c9c85a255f80990e870", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabead9ae-b0", "ovs_interfaceid": "abead9ae-b0f3-474a-b77a-91733d6d3543", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 22:56:25 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Converting VIF {"id": "abead9ae-b0f3-474a-b77a-91733d6d3543", "address": "fa:16:3e:c8:a4:ce", "network": {"id": "58367c0d-d2f6-441c-8a2f-310e045b9cf0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-296205787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2299692e42b74c9c85a255f80990e870", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabead9ae-b0", "ovs_interfaceid": "abead9ae-b0f3-474a-b77a-91733d6d3543", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:56:25 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:a4:ce,bridge_name='br-int',has_traffic_filtering=True,id=abead9ae-b0f3-474a-b77a-91733d6d3543,network=Network(58367c0d-d2f6-441c-8a2f-310e045b9cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabead9ae-b0') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:56:25 user nova-compute[72766]: DEBUG os_vif [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:a4:ce,bridge_name='br-int',has_traffic_filtering=True,id=abead9ae-b0f3-474a-b77a-91733d6d3543,network=Network(58367c0d-d2f6-441c-8a2f-310e045b9cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabead9ae-b0') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 22:56:25 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:25 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:56:25 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 22:56:25 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:25 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapabead9ae-b0, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:56:25 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapabead9ae-b0, col_values=(('external_ids', {'iface-id': 'abead9ae-b0f3-474a-b77a-91733d6d3543', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:a4:ce', 'vm-uuid': 'a9d6011c-da14-4fcc-8e31-3063db57b2a6'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:56:25 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:25 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:56:25 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:25 user nova-compute[72766]: INFO os_vif [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:a4:ce,bridge_name='br-int',has_traffic_filtering=True,id=abead9ae-b0f3-474a-b77a-91733d6d3543,network=Network(58367c0d-d2f6-441c-8a2f-310e045b9cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabead9ae-b0')
Aug 14 22:56:25 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:56:25 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] No VIF found with MAC fa:16:3e:c8:a4:ce, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:56:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:27 user nova-compute[72766]: DEBUG nova.compute.manager [req-1449312a-fe19-42b4-bedb-8491c7a5974f req-555c18d0-be60-45b9-ad5d-1f6fcd093cca service nova] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Received event network-vif-plugged-abead9ae-b0f3-474a-b77a-91733d6d3543 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:56:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-1449312a-fe19-42b4-bedb-8491c7a5974f req-555c18d0-be60-45b9-ad5d-1f6fcd093cca service nova] Acquiring lock "a9d6011c-da14-4fcc-8e31-3063db57b2a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:56:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-1449312a-fe19-42b4-bedb-8491c7a5974f req-555c18d0-be60-45b9-ad5d-1f6fcd093cca service nova] Lock "a9d6011c-da14-4fcc-8e31-3063db57b2a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:56:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-1449312a-fe19-42b4-bedb-8491c7a5974f req-555c18d0-be60-45b9-ad5d-1f6fcd093cca service nova] Lock "a9d6011c-da14-4fcc-8e31-3063db57b2a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:56:27 user nova-compute[72766]: DEBUG nova.compute.manager [req-1449312a-fe19-42b4-bedb-8491c7a5974f req-555c18d0-be60-45b9-ad5d-1f6fcd093cca service nova] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] No waiting events found dispatching network-vif-plugged-abead9ae-b0f3-474a-b77a-91733d6d3543 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:56:27 user nova-compute[72766]: WARNING nova.compute.manager [req-1449312a-fe19-42b4-bedb-8491c7a5974f req-555c18d0-be60-45b9-ad5d-1f6fcd093cca service nova] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Received unexpected event network-vif-plugged-abead9ae-b0f3-474a-b77a-91733d6d3543 for instance with vm_state building and task_state spawning.
Aug 14 22:56:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:29 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692053789.3526785, a9d6011c-da14-4fcc-8e31-3063db57b2a6 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:56:29 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] VM Resumed (Lifecycle Event)
Aug 14 22:56:29 user nova-compute[72766]: DEBUG nova.compute.manager [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 22:56:29 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 22:56:29 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Instance spawned successfully.
Aug 14 22:56:29 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 22:56:29 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:56:29 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:56:29 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:56:29 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:56:29 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:56:29 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:56:29 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:56:29 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:56:29 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:56:29 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692053789.354563, a9d6011c-da14-4fcc-8e31-3063db57b2a6 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:56:29 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] VM Started (Lifecycle Event)
Aug 14 22:56:29 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:56:29 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:56:29 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:56:29 user nova-compute[72766]: DEBUG nova.compute.manager [req-63a65f38-c3f7-4642-aed5-88f225c6999c req-75965145-b0a7-4c2b-b3e6-75ec19efdeaa service nova] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Received event network-vif-plugged-abead9ae-b0f3-474a-b77a-91733d6d3543 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:56:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-63a65f38-c3f7-4642-aed5-88f225c6999c req-75965145-b0a7-4c2b-b3e6-75ec19efdeaa service nova] Acquiring lock "a9d6011c-da14-4fcc-8e31-3063db57b2a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:56:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-63a65f38-c3f7-4642-aed5-88f225c6999c req-75965145-b0a7-4c2b-b3e6-75ec19efdeaa service nova] Lock "a9d6011c-da14-4fcc-8e31-3063db57b2a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:56:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-63a65f38-c3f7-4642-aed5-88f225c6999c req-75965145-b0a7-4c2b-b3e6-75ec19efdeaa service nova] Lock "a9d6011c-da14-4fcc-8e31-3063db57b2a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:56:29 user nova-compute[72766]: DEBUG nova.compute.manager [req-63a65f38-c3f7-4642-aed5-88f225c6999c req-75965145-b0a7-4c2b-b3e6-75ec19efdeaa service nova] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] No waiting events found dispatching network-vif-plugged-abead9ae-b0f3-474a-b77a-91733d6d3543 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:56:29 user nova-compute[72766]: WARNING nova.compute.manager [req-63a65f38-c3f7-4642-aed5-88f225c6999c req-75965145-b0a7-4c2b-b3e6-75ec19efdeaa service nova] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Received unexpected event network-vif-plugged-abead9ae-b0f3-474a-b77a-91733d6d3543 for instance with vm_state building and task_state spawning.
Aug 14 22:56:29 user nova-compute[72766]: INFO nova.compute.manager [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Took 5.46 seconds to spawn the instance on the hypervisor.
Aug 14 22:56:29 user nova-compute[72766]: DEBUG nova.compute.manager [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:56:29 user nova-compute[72766]: INFO nova.compute.manager [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Took 21.37 seconds to build instance.
Aug 14 22:56:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d2ec58cc-f2fc-42d4-99b8-e557dd1734a8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Lock "a9d6011c-da14-4fcc-8e31-3063db57b2a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.642s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:56:30 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:40 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:55 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:55 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:56:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Acquiring lock "c3c0a004-8d70-4253-bf17-b83088e30031" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:56:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "c3c0a004-8d70-4253-bf17-b83088e30031" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:56:59 user nova-compute[72766]: DEBUG nova.compute.manager [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 22:56:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:56:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:56:59 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 22:56:59 user nova-compute[72766]: INFO nova.compute.claims [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Claim successful on node user
Aug 14 22:57:00 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:57:00 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:57:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.443s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:57:00 user nova-compute[72766]: DEBUG nova.compute.manager [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 22:57:00 user nova-compute[72766]: DEBUG nova.compute.manager [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 22:57:00 user nova-compute[72766]: DEBUG nova.network.neutron [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 22:57:00 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 22:57:00 user nova-compute[72766]: DEBUG nova.compute.manager [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 22:57:00 user nova-compute[72766]: DEBUG nova.policy [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ea644936a5024e47b68fcdd88aef0977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2811d70e7d640739c6f7bf792ec33a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 22:57:00 user nova-compute[72766]: DEBUG nova.compute.manager [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 22:57:00 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 22:57:00 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Creating image(s)
Aug 14 22:57:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Acquiring lock "/opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:57:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "/opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:57:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "/opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:57:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.200s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Acquiring lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:57:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:57:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:00 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.192s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031/disk 1073741824 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031/disk 1073741824" returned: 0 in 0.059s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:57:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.217s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:01 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031/disk. size=1073741824 {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 22:57:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:01 user nova-compute[72766]: DEBUG nova.network.neutron [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Successfully created port: 26e28590-b9de-41c5-809d-06e3458eca3f {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 22:57:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:01 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Cannot resize image /opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031/disk to a smaller size. {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 22:57:01 user nova-compute[72766]: DEBUG nova.objects.instance [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lazy-loading 'migration_context' on Instance uuid c3c0a004-8d70-4253-bf17-b83088e30031 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:57:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 22:57:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Ensure instance console log exists: /opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 22:57:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:57:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:57:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG nova.network.neutron [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Successfully updated port: 26e28590-b9de-41c5-809d-06e3458eca3f {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Acquiring lock "refresh_cache-c3c0a004-8d70-4253-bf17-b83088e30031" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Acquired lock "refresh_cache-c3c0a004-8d70-4253-bf17-b83088e30031" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG nova.network.neutron [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG nova.compute.manager [req-8f1bc629-3e4f-4082-952f-87a12f7448a8 req-39a563d8-8633-4873-8e8d-61b29ec4eb0e service nova] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Received event network-changed-26e28590-b9de-41c5-809d-06e3458eca3f {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG nova.compute.manager [req-8f1bc629-3e4f-4082-952f-87a12f7448a8 req-39a563d8-8633-4873-8e8d-61b29ec4eb0e service nova] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Refreshing instance network info cache due to event network-changed-26e28590-b9de-41c5-809d-06e3458eca3f. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8f1bc629-3e4f-4082-952f-87a12f7448a8 req-39a563d8-8633-4873-8e8d-61b29ec4eb0e service nova] Acquiring lock "refresh_cache-c3c0a004-8d70-4253-bf17-b83088e30031" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG nova.network.neutron [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG nova.network.neutron [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Updating instance_info_cache with network_info: [{"id": "26e28590-b9de-41c5-809d-06e3458eca3f", "address": "fa:16:3e:96:85:b3", "network": {"id": "b74740ac-2ac1-45f5-8997-0e22050362e8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1094074502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2811d70e7d640739c6f7bf792ec33a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e28590-b9", "ovs_interfaceid": "26e28590-b9de-41c5-809d-06e3458eca3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Releasing lock "refresh_cache-c3c0a004-8d70-4253-bf17-b83088e30031" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG nova.compute.manager [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Instance network_info: |[{"id": "26e28590-b9de-41c5-809d-06e3458eca3f", "address": "fa:16:3e:96:85:b3", "network": {"id": "b74740ac-2ac1-45f5-8997-0e22050362e8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1094074502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2811d70e7d640739c6f7bf792ec33a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e28590-b9", "ovs_interfaceid": "26e28590-b9de-41c5-809d-06e3458eca3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8f1bc629-3e4f-4082-952f-87a12f7448a8 req-39a563d8-8633-4873-8e8d-61b29ec4eb0e service nova] Acquired lock "refresh_cache-c3c0a004-8d70-4253-bf17-b83088e30031" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG nova.network.neutron [req-8f1bc629-3e4f-4082-952f-87a12f7448a8 req-39a563d8-8633-4873-8e8d-61b29ec4eb0e service nova] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Refreshing network info cache for port 26e28590-b9de-41c5-809d-06e3458eca3f {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Start _get_guest_xml network_info=[{"id": "26e28590-b9de-41c5-809d-06e3458eca3f", "address": "fa:16:3e:96:85:b3", "network": {"id": "b74740ac-2ac1-45f5-8997-0e22050362e8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1094074502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2811d70e7d640739c6f7bf792ec33a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e28590-b9", "ovs_interfaceid": "26e28590-b9de-41c5-809d-06e3458eca3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd2900d30-2c4c-4d57-9135-d45564c0c596'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 22:57:02 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:57:02 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:57:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1538328844',display_name='tempest-SnapshotDataIntegrityTests-server-1538328844',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1538328844',id=10,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1uk5EnkwBt23yCM+521zuC9oUNaMu0R5NvzZ2Z7LJw0HSX2NLAEx6ixFqAZyR0W5oNU7V9NdTJRIKUF9xsgmNT2rgRS2gwfdRHkZCgjlCnbwaaDhT3X3SOxDi/IFAXZw==',key_name='tempest-keypair-1246698965',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2811d70e7d640739c6f7bf792ec33a4',ramdisk_id='',reservation_id='r-074wiyp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1743181261',owner_user_name='tempest-SnapshotDataIntegrityTests-1743181261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:57:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea644936a5024e47b68fcdd88aef0977',uuid=c3c0a004-8d70-4253-bf17-b83088e30031,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26e28590-b9de-41c5-809d-06e3458eca3f", "address": "fa:16:3e:96:85:b3", "network": {"id": "b74740ac-2ac1-45f5-8997-0e22050362e8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1094074502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2811d70e7d640739c6f7bf792ec33a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e28590-b9", "ovs_interfaceid": "26e28590-b9de-41c5-809d-06e3458eca3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Converting VIF {"id": "26e28590-b9de-41c5-809d-06e3458eca3f", "address": "fa:16:3e:96:85:b3", "network": {"id": "b74740ac-2ac1-45f5-8997-0e22050362e8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1094074502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2811d70e7d640739c6f7bf792ec33a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e28590-b9", "ovs_interfaceid": "26e28590-b9de-41c5-809d-06e3458eca3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:85:b3,bridge_name='br-int',has_traffic_filtering=True,id=26e28590-b9de-41c5-809d-06e3458eca3f,network=Network(b74740ac-2ac1-45f5-8997-0e22050362e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26e28590-b9') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG nova.objects.instance [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lazy-loading 'pci_devices' on Instance uuid c3c0a004-8d70-4253-bf17-b83088e30031 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] End _get_guest_xml xml=<domain type="kvm">
Aug 14 22:57:02 user nova-compute[72766]:   <uuid>c3c0a004-8d70-4253-bf17-b83088e30031</uuid>
Aug 14 22:57:02 user nova-compute[72766]:   <name>instance-0000000a</name>
Aug 14 22:57:02 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 22:57:02 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 22:57:02 user nova-compute[72766]:   <metadata>
Aug 14 22:57:02 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:57:02 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 22:57:02 user nova-compute[72766]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1538328844</nova:name>
Aug 14 22:57:02 user nova-compute[72766]:       <nova:creationTime>2023-08-14 22:57:02</nova:creationTime>
Aug 14 22:57:02 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 22:57:02 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 22:57:02 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 22:57:02 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 22:57:02 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:57:02 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 22:57:02 user nova-compute[72766]:       </nova:flavor>
Aug 14 22:57:02 user nova-compute[72766]:       <nova:owner>
Aug 14 22:57:02 user nova-compute[72766]:         <nova:user uuid="ea644936a5024e47b68fcdd88aef0977">tempest-SnapshotDataIntegrityTests-1743181261-project-member</nova:user>
Aug 14 22:57:02 user nova-compute[72766]:         <nova:project uuid="a2811d70e7d640739c6f7bf792ec33a4">tempest-SnapshotDataIntegrityTests-1743181261</nova:project>
Aug 14 22:57:02 user nova-compute[72766]:       </nova:owner>
Aug 14 22:57:02 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 22:57:02 user nova-compute[72766]:       <nova:ports>
Aug 14 22:57:02 user nova-compute[72766]:         <nova:port uuid="26e28590-b9de-41c5-809d-06e3458eca3f">
Aug 14 22:57:02 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 22:57:02 user nova-compute[72766]:         </nova:port>
Aug 14 22:57:02 user nova-compute[72766]:       </nova:ports>
Aug 14 22:57:02 user nova-compute[72766]:     </nova:instance>
Aug 14 22:57:02 user nova-compute[72766]:   </metadata>
Aug 14 22:57:02 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 22:57:02 user nova-compute[72766]:     <system>
Aug 14 22:57:02 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 22:57:02 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 22:57:02 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 22:57:02 user nova-compute[72766]:       <entry name="serial">c3c0a004-8d70-4253-bf17-b83088e30031</entry>
Aug 14 22:57:02 user nova-compute[72766]:       <entry name="uuid">c3c0a004-8d70-4253-bf17-b83088e30031</entry>
Aug 14 22:57:02 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 22:57:02 user nova-compute[72766]:     </system>
Aug 14 22:57:02 user nova-compute[72766]:   </sysinfo>
Aug 14 22:57:02 user nova-compute[72766]:   <os>
Aug 14 22:57:02 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 22:57:02 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 22:57:02 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 22:57:02 user nova-compute[72766]:   </os>
Aug 14 22:57:02 user nova-compute[72766]:   <features>
Aug 14 22:57:02 user nova-compute[72766]:     <acpi/>
Aug 14 22:57:02 user nova-compute[72766]:     <apic/>
Aug 14 22:57:02 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 22:57:02 user nova-compute[72766]:   </features>
Aug 14 22:57:02 user nova-compute[72766]:   <clock offset="utc">
Aug 14 22:57:02 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 22:57:02 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 22:57:02 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 22:57:02 user nova-compute[72766]:   </clock>
Aug 14 22:57:02 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 22:57:02 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 22:57:02 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 22:57:02 user nova-compute[72766]:   </cpu>
Aug 14 22:57:02 user nova-compute[72766]:   <devices>
Aug 14 22:57:02 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 22:57:02 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 22:57:02 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031/disk"/>
Aug 14 22:57:02 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 22:57:02 user nova-compute[72766]:     </disk>
Aug 14 22:57:02 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 22:57:02 user nova-compute[72766]:       <mac address="fa:16:3e:96:85:b3"/>
Aug 14 22:57:02 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 22:57:02 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 22:57:02 user nova-compute[72766]:       <target dev="tap26e28590-b9"/>
Aug 14 22:57:02 user nova-compute[72766]:     </interface>
Aug 14 22:57:02 user nova-compute[72766]:     <serial type="pty">
Aug 14 22:57:02 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031/console.log" append="off"/>
Aug 14 22:57:02 user nova-compute[72766]:     </serial>
Aug 14 22:57:02 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 22:57:02 user nova-compute[72766]:     <video>
Aug 14 22:57:02 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 22:57:02 user nova-compute[72766]:     </video>
Aug 14 22:57:02 user nova-compute[72766]:     <rng model="virtio">
Aug 14 22:57:02 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 22:57:02 user nova-compute[72766]:     </rng>
Aug 14 22:57:02 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 22:57:02 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 22:57:02 user nova-compute[72766]:       <stats period="10"/>
Aug 14 22:57:02 user nova-compute[72766]:     </memballoon>
Aug 14 22:57:02 user nova-compute[72766]:   </devices>
Aug 14 22:57:02 user nova-compute[72766]: </domain>
Aug 14 22:57:02 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1538328844',display_name='tempest-SnapshotDataIntegrityTests-server-1538328844',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1538328844',id=10,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1uk5EnkwBt23yCM+521zuC9oUNaMu0R5NvzZ2Z7LJw0HSX2NLAEx6ixFqAZyR0W5oNU7V9NdTJRIKUF9xsgmNT2rgRS2gwfdRHkZCgjlCnbwaaDhT3X3SOxDi/IFAXZw==',key_name='tempest-keypair-1246698965',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2811d70e7d640739c6f7bf792ec33a4',ramdisk_id='',reservation_id='r-074wiyp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1743181261',owner_user_name='tempest-SnapshotDataIntegrityTests-1743181261-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:57:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea644936a5024e47b68fcdd88aef0977',uuid=c3c0a004-8d70-4253-bf17-b83088e30031,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26e28590-b9de-41c5-809d-06e3458eca3f", "address": "fa:16:3e:96:85:b3", "network": {"id": "b74740ac-2ac1-45f5-8997-0e22050362e8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1094074502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2811d70e7d640739c6f7bf792ec33a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e28590-b9", "ovs_interfaceid": "26e28590-b9de-41c5-809d-06e3458eca3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Converting VIF {"id": "26e28590-b9de-41c5-809d-06e3458eca3f", "address": "fa:16:3e:96:85:b3", "network": {"id": "b74740ac-2ac1-45f5-8997-0e22050362e8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1094074502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2811d70e7d640739c6f7bf792ec33a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e28590-b9", "ovs_interfaceid": "26e28590-b9de-41c5-809d-06e3458eca3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:85:b3,bridge_name='br-int',has_traffic_filtering=True,id=26e28590-b9de-41c5-809d-06e3458eca3f,network=Network(b74740ac-2ac1-45f5-8997-0e22050362e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26e28590-b9') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG os_vif [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:85:b3,bridge_name='br-int',has_traffic_filtering=True,id=26e28590-b9de-41c5-809d-06e3458eca3f,network=Network(b74740ac-2ac1-45f5-8997-0e22050362e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26e28590-b9') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26e28590-b9, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap26e28590-b9, col_values=(('external_ids', {'iface-id': '26e28590-b9de-41c5-809d-06e3458eca3f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:85:b3', 'vm-uuid': 'c3c0a004-8d70-4253-bf17-b83088e30031'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:02 user nova-compute[72766]: INFO os_vif [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:85:b3,bridge_name='br-int',has_traffic_filtering=True,id=26e28590-b9de-41c5-809d-06e3458eca3f,network=Network(b74740ac-2ac1-45f5-8997-0e22050362e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26e28590-b9')
Aug 14 22:57:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:57:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] No VIF found with MAC fa:16:3e:96:85:b3, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:57:03 user nova-compute[72766]: DEBUG nova.network.neutron [req-8f1bc629-3e4f-4082-952f-87a12f7448a8 req-39a563d8-8633-4873-8e8d-61b29ec4eb0e service nova] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Updated VIF entry in instance network info cache for port 26e28590-b9de-41c5-809d-06e3458eca3f. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:57:03 user nova-compute[72766]: DEBUG nova.network.neutron [req-8f1bc629-3e4f-4082-952f-87a12f7448a8 req-39a563d8-8633-4873-8e8d-61b29ec4eb0e service nova] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Updating instance_info_cache with network_info: [{"id": "26e28590-b9de-41c5-809d-06e3458eca3f", "address": "fa:16:3e:96:85:b3", "network": {"id": "b74740ac-2ac1-45f5-8997-0e22050362e8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1094074502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2811d70e7d640739c6f7bf792ec33a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e28590-b9", "ovs_interfaceid": "26e28590-b9de-41c5-809d-06e3458eca3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:57:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8f1bc629-3e4f-4082-952f-87a12f7448a8 req-39a563d8-8633-4873-8e8d-61b29ec4eb0e service nova] Releasing lock "refresh_cache-c3c0a004-8d70-4253-bf17-b83088e30031" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:57:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:04 user nova-compute[72766]: DEBUG nova.compute.manager [req-938f2bbb-2e74-4d43-bce6-8533d41d6f6f req-58c4eb86-6be0-4d8c-956a-4b28faf81acd service nova] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Received event network-vif-plugged-26e28590-b9de-41c5-809d-06e3458eca3f {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:57:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-938f2bbb-2e74-4d43-bce6-8533d41d6f6f req-58c4eb86-6be0-4d8c-956a-4b28faf81acd service nova] Acquiring lock "c3c0a004-8d70-4253-bf17-b83088e30031-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:57:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-938f2bbb-2e74-4d43-bce6-8533d41d6f6f req-58c4eb86-6be0-4d8c-956a-4b28faf81acd service nova] Lock "c3c0a004-8d70-4253-bf17-b83088e30031-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:57:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-938f2bbb-2e74-4d43-bce6-8533d41d6f6f req-58c4eb86-6be0-4d8c-956a-4b28faf81acd service nova] Lock "c3c0a004-8d70-4253-bf17-b83088e30031-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:57:04 user nova-compute[72766]: DEBUG nova.compute.manager [req-938f2bbb-2e74-4d43-bce6-8533d41d6f6f req-58c4eb86-6be0-4d8c-956a-4b28faf81acd service nova] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] No waiting events found dispatching network-vif-plugged-26e28590-b9de-41c5-809d-06e3458eca3f {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:57:04 user nova-compute[72766]: WARNING nova.compute.manager [req-938f2bbb-2e74-4d43-bce6-8533d41d6f6f req-58c4eb86-6be0-4d8c-956a-4b28faf81acd service nova] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Received unexpected event network-vif-plugged-26e28590-b9de-41c5-809d-06e3458eca3f for instance with vm_state building and task_state spawning.
Aug 14 22:57:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:06 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692053826.5408459, c3c0a004-8d70-4253-bf17-b83088e30031 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:57:06 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] VM Resumed (Lifecycle Event)
Aug 14 22:57:06 user nova-compute[72766]: DEBUG nova.compute.manager [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 22:57:06 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 22:57:06 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Instance spawned successfully.
Aug 14 22:57:06 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 22:57:06 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:57:06 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:57:06 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:57:06 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:57:06 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:57:06 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:57:06 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:57:06 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:57:06 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:57:06 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692053826.5460584, c3c0a004-8d70-4253-bf17-b83088e30031 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:57:06 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] VM Started (Lifecycle Event)
Aug 14 22:57:06 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:57:06 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:57:06 user nova-compute[72766]: DEBUG nova.compute.manager [req-67b7215d-ac2b-4563-a774-0442eb6eb478 req-55a5a4c7-9bde-458b-a172-fd0fc17f7c88 service nova] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Received event network-vif-plugged-26e28590-b9de-41c5-809d-06e3458eca3f {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:57:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-67b7215d-ac2b-4563-a774-0442eb6eb478 req-55a5a4c7-9bde-458b-a172-fd0fc17f7c88 service nova] Acquiring lock "c3c0a004-8d70-4253-bf17-b83088e30031-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:57:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-67b7215d-ac2b-4563-a774-0442eb6eb478 req-55a5a4c7-9bde-458b-a172-fd0fc17f7c88 service nova] Lock "c3c0a004-8d70-4253-bf17-b83088e30031-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:57:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-67b7215d-ac2b-4563-a774-0442eb6eb478 req-55a5a4c7-9bde-458b-a172-fd0fc17f7c88 service nova] Lock "c3c0a004-8d70-4253-bf17-b83088e30031-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:57:06 user nova-compute[72766]: DEBUG nova.compute.manager [req-67b7215d-ac2b-4563-a774-0442eb6eb478 req-55a5a4c7-9bde-458b-a172-fd0fc17f7c88 service nova] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] No waiting events found dispatching network-vif-plugged-26e28590-b9de-41c5-809d-06e3458eca3f {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:57:06 user nova-compute[72766]: WARNING nova.compute.manager [req-67b7215d-ac2b-4563-a774-0442eb6eb478 req-55a5a4c7-9bde-458b-a172-fd0fc17f7c88 service nova] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Received unexpected event network-vif-plugged-26e28590-b9de-41c5-809d-06e3458eca3f for instance with vm_state building and task_state spawning.
Aug 14 22:57:06 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:57:06 user nova-compute[72766]: INFO nova.compute.manager [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Took 6.24 seconds to spawn the instance on the hypervisor.
Aug 14 22:57:06 user nova-compute[72766]: DEBUG nova.compute.manager [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:57:06 user nova-compute[72766]: INFO nova.compute.manager [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Took 7.05 seconds to build instance.
Aug 14 22:57:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6233c706-fb39-498b-9bbf-46db0317b145 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "c3c0a004-8d70-4253-bf17-b83088e30031" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.178s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:57:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:09 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:57:11 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:57:12 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:57:12 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 22:57:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-b563c62d-d117-4bb5-9157-7387c51ed641" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:57:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-b563c62d-d117-4bb5-9157-7387c51ed641" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:57:12 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 22:57:12 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:13 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Updating instance_info_cache with network_info: [{"id": "1663df0b-566c-4588-a5e1-5082de0e3bcf", "address": "fa:16:3e:b7:97:01", "network": {"id": "5464d98e-0483-4d6d-895b-b51c50c0cfd9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-581355694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142137ab929f4e5289b06319af10751b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1663df0b-56", "ovs_interfaceid": "1663df0b-566c-4588-a5e1-5082de0e3bcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:57:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-b563c62d-d117-4bb5-9157-7387c51ed641" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:57:13 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 22:57:13 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:57:13 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:57:13 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 22:57:13 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:57:13 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:57:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:57:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:57:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:57:13 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 22:57:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33e6f8aa-bb0d-478d-b7b5-3334302476fb/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33e6f8aa-bb0d-478d-b7b5-3334302476fb/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33e6f8aa-bb0d-478d-b7b5-3334302476fb/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33e6f8aa-bb0d-478d-b7b5-3334302476fb/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0850bb6c-6e3e-4007-8478-8eba53089158/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0850bb6c-6e3e-4007-8478-8eba53089158/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0850bb6c-6e3e-4007-8478-8eba53089158/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0850bb6c-6e3e-4007-8478-8eba53089158/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:15 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:57:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Acquiring lock "bde3ff44-cdf8-4ef7-bb7d-50865129268f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:57:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Lock "bde3ff44-cdf8-4ef7-bb7d-50865129268f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:57:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:15 user nova-compute[72766]: DEBUG nova.compute.manager [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 22:57:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:57:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:57:15 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 22:57:15 user nova-compute[72766]: INFO nova.compute.claims [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Claim successful on node user
Aug 14 22:57:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:15 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:57:15 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:57:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.601s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:57:15 user nova-compute[72766]: DEBUG nova.compute.manager [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 22:57:15 user nova-compute[72766]: DEBUG nova.compute.manager [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 22:57:15 user nova-compute[72766]: DEBUG nova.network.neutron [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 22:57:15 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 22:57:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:15 user nova-compute[72766]: DEBUG nova.compute.manager [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 22:57:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:16 user nova-compute[72766]: DEBUG nova.policy [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4701a1ef84d94ce99ec55e44c1df9032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142137ab929f4e5289b06319af10751b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 22:57:16 user nova-compute[72766]: DEBUG nova.compute.manager [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 22:57:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 22:57:16 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Creating image(s)
Aug 14 22:57:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Acquiring lock "/opt/stack/data/nova/instances/bde3ff44-cdf8-4ef7-bb7d-50865129268f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:57:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Lock "/opt/stack/data/nova/instances/bde3ff44-cdf8-4ef7-bb7d-50865129268f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:57:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Lock "/opt/stack/data/nova/instances/bde3ff44-cdf8-4ef7-bb7d-50865129268f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:57:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.231s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Acquiring lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:57:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:57:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Acquiring lock "023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:57:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Lock "023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:57:16 user nova-compute[72766]: DEBUG nova.objects.instance [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Lazy-loading 'flavor' on Instance uuid 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:57:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40cd301a-97f2-4f02-b091-f5a2bb1cd016/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Lock "023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.107s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:57:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.201s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/bde3ff44-cdf8-4ef7-bb7d-50865129268f/disk 1073741824 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/bde3ff44-cdf8-4ef7-bb7d-50865129268f/disk 1073741824" returned: 0 in 0.063s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:57:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40cd301a-97f2-4f02-b091-f5a2bb1cd016/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40cd301a-97f2-4f02-b091-f5a2bb1cd016/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.173s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:16 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bde3ff44-cdf8-4ef7-bb7d-50865129268f/disk. size=1073741824 {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 22:57:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bde3ff44-cdf8-4ef7-bb7d-50865129268f/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40cd301a-97f2-4f02-b091-f5a2bb1cd016/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Acquiring lock "023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:57:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Lock "023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:57:16 user nova-compute[72766]: INFO nova.compute.manager [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Attaching volume 97ef64c8-96bb-4701-b352-f1e0ed350369 to /dev/vdb
Aug 14 22:57:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b55141bc-d426-4d35-8ae5-269ece19a793/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bde3ff44-cdf8-4ef7-bb7d-50865129268f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:17 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Cannot resize image /opt/stack/data/nova/instances/bde3ff44-cdf8-4ef7-bb7d-50865129268f/disk to a smaller size. {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 22:57:17 user nova-compute[72766]: DEBUG nova.objects.instance [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Lazy-loading 'migration_context' on Instance uuid bde3ff44-cdf8-4ef7-bb7d-50865129268f {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:57:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 22:57:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Ensure instance console log exists: /opt/stack/data/nova/instances/bde3ff44-cdf8-4ef7-bb7d-50865129268f/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 22:57:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:57:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:57:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:57:17 user nova-compute[72766]: DEBUG os_brick.utils [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:57:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:17 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a92966-98f4-4331-b5d8-449a6567f6c7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:17 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ee7dc3-2089-4535-9969-9e298e55dc0c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:17 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead16417-9c83-4d6c-ac9e-17daf4c30304]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:17 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[84059f24-217e-479a-8255-f5f2785411e6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:17 user nova-compute[72766]: DEBUG nova.network.neutron [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Successfully created port: bcaf8075-d371-4fcb-a6af-88b9a81dfeb8 {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 22:57:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:57:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b55141bc-d426-4d35-8ae5-269ece19a793/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:17 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 22:57:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b55141bc-d426-4d35-8ae5-269ece19a793/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:57:17 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 22:57:17 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ffe529-3405-48b2-a180-ff1d2a50bfbe]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:17 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 22:57:17 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 22:57:17 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 22:57:17 user nova-compute[72766]: DEBUG os_brick.utils [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:57:17 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Updating existing volume attachment record: 34e7b7d3-25d0-4b1d-ad36-7c638727d90f {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 22:57:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b55141bc-d426-4d35-8ae5-269ece19a793/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:18 user nova-compute[72766]: DEBUG nova.network.neutron [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Successfully updated port: bcaf8075-d371-4fcb-a6af-88b9a81dfeb8 {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 22:57:18 user nova-compute[72766]: DEBUG nova.compute.manager [req-ad299cf5-be92-4663-847d-c89f5ae72768 req-4d335910-fa98-4938-9a27-211ec2f6b875 service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Received event network-changed-baa7e0c2-91d4-4077-8405-abb537475df2 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:57:18 user nova-compute[72766]: DEBUG nova.compute.manager [req-ad299cf5-be92-4663-847d-c89f5ae72768 req-4d335910-fa98-4938-9a27-211ec2f6b875 service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Refreshing instance network info cache due to event network-changed-baa7e0c2-91d4-4077-8405-abb537475df2. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:57:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ad299cf5-be92-4663-847d-c89f5ae72768 req-4d335910-fa98-4938-9a27-211ec2f6b875 service nova] Acquiring lock "refresh_cache-87712dfd-d67b-4e5e-a75d-ca2dd7c764b1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:57:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ad299cf5-be92-4663-847d-c89f5ae72768 req-4d335910-fa98-4938-9a27-211ec2f6b875 service nova] Acquired lock "refresh_cache-87712dfd-d67b-4e5e-a75d-ca2dd7c764b1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:57:18 user nova-compute[72766]: DEBUG nova.network.neutron [req-ad299cf5-be92-4663-847d-c89f5ae72768 req-4d335910-fa98-4938-9a27-211ec2f6b875 service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Refreshing network info cache for port baa7e0c2-91d4-4077-8405-abb537475df2 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:57:18 user nova-compute[72766]: DEBUG nova.compute.manager [req-0555e5d0-f0e2-493f-91a2-1db9f1ffdcc8 req-0e8c941e-4ab1-4a2e-9a84-fb7afef5e9a6 service nova] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Received event network-changed-bcaf8075-d371-4fcb-a6af-88b9a81dfeb8 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:57:18 user nova-compute[72766]: DEBUG nova.compute.manager [req-0555e5d0-f0e2-493f-91a2-1db9f1ffdcc8 req-0e8c941e-4ab1-4a2e-9a84-fb7afef5e9a6 service nova] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Refreshing instance network info cache due to event network-changed-bcaf8075-d371-4fcb-a6af-88b9a81dfeb8. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:57:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0555e5d0-f0e2-493f-91a2-1db9f1ffdcc8 req-0e8c941e-4ab1-4a2e-9a84-fb7afef5e9a6 service nova] Acquiring lock "refresh_cache-bde3ff44-cdf8-4ef7-bb7d-50865129268f" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:57:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0555e5d0-f0e2-493f-91a2-1db9f1ffdcc8 req-0e8c941e-4ab1-4a2e-9a84-fb7afef5e9a6 service nova] Acquired lock "refresh_cache-bde3ff44-cdf8-4ef7-bb7d-50865129268f" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:57:18 user nova-compute[72766]: DEBUG nova.network.neutron [req-0555e5d0-f0e2-493f-91a2-1db9f1ffdcc8 req-0e8c941e-4ab1-4a2e-9a84-fb7afef5e9a6 service nova] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Refreshing network info cache for port bcaf8075-d371-4fcb-a6af-88b9a81dfeb8 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:57:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Acquiring lock "refresh_cache-bde3ff44-cdf8-4ef7-bb7d-50865129268f" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:57:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:57:18 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:57:18 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:57:18 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=6841MB free_disk=25.76260757446289GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 22:57:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:57:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:57:18 user nova-compute[72766]: DEBUG nova.network.neutron [req-0555e5d0-f0e2-493f-91a2-1db9f1ffdcc8 req-0e8c941e-4ab1-4a2e-9a84-fb7afef5e9a6 service nova] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 22:57:18 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:57:18 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance b563c62d-d117-4bb5-9157-7387c51ed641 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:57:18 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:57:18 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 0850bb6c-6e3e-4007-8478-8eba53089158 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:57:18 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 40cd301a-97f2-4f02-b091-f5a2bb1cd016 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:57:18 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 90b55775-2f14-4c80-b48a-b1eed2b570dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:57:18 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance b55141bc-d426-4d35-8ae5-269ece19a793 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:57:18 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 33e6f8aa-bb0d-478d-b7b5-3334302476fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:57:18 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance a9d6011c-da14-4fcc-8e31-3063db57b2a6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:57:18 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance c3c0a004-8d70-4253-bf17-b83088e30031 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:57:18 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance bde3ff44-cdf8-4ef7-bb7d-50865129268f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:57:18 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 22:57:18 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 22:57:18 user nova-compute[72766]: DEBUG nova.network.neutron [req-ad299cf5-be92-4663-847d-c89f5ae72768 req-4d335910-fa98-4938-9a27-211ec2f6b875 service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Updated VIF entry in instance network info cache for port baa7e0c2-91d4-4077-8405-abb537475df2. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:57:18 user nova-compute[72766]: DEBUG nova.network.neutron [req-ad299cf5-be92-4663-847d-c89f5ae72768 req-4d335910-fa98-4938-9a27-211ec2f6b875 service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Updating instance_info_cache with network_info: [{"id": "baa7e0c2-91d4-4077-8405-abb537475df2", "address": "fa:16:3e:88:35:14", "network": {"id": "aff4f146-97db-4102-abf1-6528e74cad55", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1894452367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6942d31258304de68c9f7f8bb9304acb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa7e0c2-91", "ovs_interfaceid": "baa7e0c2-91d4-4077-8405-abb537475df2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:57:18 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:57:18 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:57:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ad299cf5-be92-4663-847d-c89f5ae72768 req-4d335910-fa98-4938-9a27-211ec2f6b875 service nova] Releasing lock "refresh_cache-87712dfd-d67b-4e5e-a75d-ca2dd7c764b1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:57:18 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 22:57:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.604s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG nova.network.neutron [req-0555e5d0-f0e2-493f-91a2-1db9f1ffdcc8 req-0e8c941e-4ab1-4a2e-9a84-fb7afef5e9a6 service nova] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0555e5d0-f0e2-493f-91a2-1db9f1ffdcc8 req-0e8c941e-4ab1-4a2e-9a84-fb7afef5e9a6 service nova] Releasing lock "refresh_cache-bde3ff44-cdf8-4ef7-bb7d-50865129268f" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Acquired lock "refresh_cache-bde3ff44-cdf8-4ef7-bb7d-50865129268f" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG nova.network.neutron [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG nova.compute.manager [None req-88027493-31c3-439c-979b-898141ba05f4 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG nova.network.neutron [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 22:57:19 user nova-compute[72766]: INFO nova.compute.manager [None req-88027493-31c3-439c-979b-898141ba05f4 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] instance snapshotting
Aug 14 22:57:19 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-88027493-31c3-439c-979b-898141ba05f4 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Beginning live snapshot process
Aug 14 22:57:19 user nova-compute[72766]: DEBUG nova.network.neutron [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Updating instance_info_cache with network_info: [{"id": "bcaf8075-d371-4fcb-a6af-88b9a81dfeb8", "address": "fa:16:3e:6f:52:c5", "network": {"id": "5464d98e-0483-4d6d-895b-b51c50c0cfd9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-581355694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142137ab929f4e5289b06319af10751b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcaf8075-d3", "ovs_interfaceid": "bcaf8075-d371-4fcb-a6af-88b9a81dfeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-88027493-31c3-439c-979b-898141ba05f4 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk --force-share --output=json -f qcow2 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Releasing lock "refresh_cache-bde3ff44-cdf8-4ef7-bb7d-50865129268f" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG nova.compute.manager [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Instance network_info: |[{"id": "bcaf8075-d371-4fcb-a6af-88b9a81dfeb8", "address": "fa:16:3e:6f:52:c5", "network": {"id": "5464d98e-0483-4d6d-895b-b51c50c0cfd9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-581355694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142137ab929f4e5289b06319af10751b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcaf8075-d3", "ovs_interfaceid": "bcaf8075-d371-4fcb-a6af-88b9a81dfeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Start _get_guest_xml network_info=[{"id": "bcaf8075-d371-4fcb-a6af-88b9a81dfeb8", "address": "fa:16:3e:6f:52:c5", "network": {"id": "5464d98e-0483-4d6d-895b-b51c50c0cfd9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-581355694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142137ab929f4e5289b06319af10751b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcaf8075-d3", "ovs_interfaceid": "bcaf8075-d371-4fcb-a6af-88b9a81dfeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd2900d30-2c4c-4d57-9135-d45564c0c596'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 22:57:19 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:57:19 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:57:19 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:57:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1192671324',display_name='tempest-ServersNegativeTestJSON-server-1192671324',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1192671324',id=11,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='142137ab929f4e5289b06319af10751b',ramdisk_id='',reservation_id='r-hgl817p6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-968182857',owner_user_name='tempest-ServersNegativeTestJSON-968182857-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:57:16Z,user_data=None,user_id='4701a1ef84d94ce99ec55e44c1df9032',uuid=bde3ff44-cdf8-4ef7-bb7d-50865129268f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcaf8075-d371-4fcb-a6af-88b9a81dfeb8", "address": "fa:16:3e:6f:52:c5", "network": {"id": "5464d98e-0483-4d6d-895b-b51c50c0cfd9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-581355694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142137ab929f4e5289b06319af10751b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcaf8075-d3", "ovs_interfaceid": "bcaf8075-d371-4fcb-a6af-88b9a81dfeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Converting VIF {"id": "bcaf8075-d371-4fcb-a6af-88b9a81dfeb8", "address": "fa:16:3e:6f:52:c5", "network": {"id": "5464d98e-0483-4d6d-895b-b51c50c0cfd9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-581355694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142137ab929f4e5289b06319af10751b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcaf8075-d3", "ovs_interfaceid": "bcaf8075-d371-4fcb-a6af-88b9a81dfeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:52:c5,bridge_name='br-int',has_traffic_filtering=True,id=bcaf8075-d371-4fcb-a6af-88b9a81dfeb8,network=Network(5464d98e-0483-4d6d-895b-b51c50c0cfd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcaf8075-d3') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG nova.objects.instance [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Lazy-loading 'pci_devices' on Instance uuid bde3ff44-cdf8-4ef7-bb7d-50865129268f {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] End _get_guest_xml xml=<domain type="kvm">
Aug 14 22:57:19 user nova-compute[72766]:   <uuid>bde3ff44-cdf8-4ef7-bb7d-50865129268f</uuid>
Aug 14 22:57:19 user nova-compute[72766]:   <name>instance-0000000b</name>
Aug 14 22:57:19 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 22:57:19 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 22:57:19 user nova-compute[72766]:   <metadata>
Aug 14 22:57:19 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:57:19 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 22:57:19 user nova-compute[72766]:       <nova:name>tempest-ServersNegativeTestJSON-server-1192671324</nova:name>
Aug 14 22:57:19 user nova-compute[72766]:       <nova:creationTime>2023-08-14 22:57:19</nova:creationTime>
Aug 14 22:57:19 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 22:57:19 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 22:57:19 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 22:57:19 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 22:57:19 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:57:19 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 22:57:19 user nova-compute[72766]:       </nova:flavor>
Aug 14 22:57:19 user nova-compute[72766]:       <nova:owner>
Aug 14 22:57:19 user nova-compute[72766]:         <nova:user uuid="4701a1ef84d94ce99ec55e44c1df9032">tempest-ServersNegativeTestJSON-968182857-project-member</nova:user>
Aug 14 22:57:19 user nova-compute[72766]:         <nova:project uuid="142137ab929f4e5289b06319af10751b">tempest-ServersNegativeTestJSON-968182857</nova:project>
Aug 14 22:57:19 user nova-compute[72766]:       </nova:owner>
Aug 14 22:57:19 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 22:57:19 user nova-compute[72766]:       <nova:ports>
Aug 14 22:57:19 user nova-compute[72766]:         <nova:port uuid="bcaf8075-d371-4fcb-a6af-88b9a81dfeb8">
Aug 14 22:57:19 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 22:57:19 user nova-compute[72766]:         </nova:port>
Aug 14 22:57:19 user nova-compute[72766]:       </nova:ports>
Aug 14 22:57:19 user nova-compute[72766]:     </nova:instance>
Aug 14 22:57:19 user nova-compute[72766]:   </metadata>
Aug 14 22:57:19 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 22:57:19 user nova-compute[72766]:     <system>
Aug 14 22:57:19 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 22:57:19 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 22:57:19 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 22:57:19 user nova-compute[72766]:       <entry name="serial">bde3ff44-cdf8-4ef7-bb7d-50865129268f</entry>
Aug 14 22:57:19 user nova-compute[72766]:       <entry name="uuid">bde3ff44-cdf8-4ef7-bb7d-50865129268f</entry>
Aug 14 22:57:19 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 22:57:19 user nova-compute[72766]:     </system>
Aug 14 22:57:19 user nova-compute[72766]:   </sysinfo>
Aug 14 22:57:19 user nova-compute[72766]:   <os>
Aug 14 22:57:19 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 22:57:19 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 22:57:19 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 22:57:19 user nova-compute[72766]:   </os>
Aug 14 22:57:19 user nova-compute[72766]:   <features>
Aug 14 22:57:19 user nova-compute[72766]:     <acpi/>
Aug 14 22:57:19 user nova-compute[72766]:     <apic/>
Aug 14 22:57:19 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 22:57:19 user nova-compute[72766]:   </features>
Aug 14 22:57:19 user nova-compute[72766]:   <clock offset="utc">
Aug 14 22:57:19 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 22:57:19 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 22:57:19 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 22:57:19 user nova-compute[72766]:   </clock>
Aug 14 22:57:19 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 22:57:19 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 22:57:19 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 22:57:19 user nova-compute[72766]:   </cpu>
Aug 14 22:57:19 user nova-compute[72766]:   <devices>
Aug 14 22:57:19 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 22:57:19 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 22:57:19 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/bde3ff44-cdf8-4ef7-bb7d-50865129268f/disk"/>
Aug 14 22:57:19 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 22:57:19 user nova-compute[72766]:     </disk>
Aug 14 22:57:19 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 22:57:19 user nova-compute[72766]:       <mac address="fa:16:3e:6f:52:c5"/>
Aug 14 22:57:19 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 22:57:19 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 22:57:19 user nova-compute[72766]:       <target dev="tapbcaf8075-d3"/>
Aug 14 22:57:19 user nova-compute[72766]:     </interface>
Aug 14 22:57:19 user nova-compute[72766]:     <serial type="pty">
Aug 14 22:57:19 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/bde3ff44-cdf8-4ef7-bb7d-50865129268f/console.log" append="off"/>
Aug 14 22:57:19 user nova-compute[72766]:     </serial>
Aug 14 22:57:19 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 22:57:19 user nova-compute[72766]:     <video>
Aug 14 22:57:19 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 22:57:19 user nova-compute[72766]:     </video>
Aug 14 22:57:19 user nova-compute[72766]:     <rng model="virtio">
Aug 14 22:57:19 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 22:57:19 user nova-compute[72766]:     </rng>
Aug 14 22:57:19 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 22:57:19 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 22:57:19 user nova-compute[72766]:       <stats period="10"/>
Aug 14 22:57:19 user nova-compute[72766]:     </memballoon>
Aug 14 22:57:19 user nova-compute[72766]:   </devices>
Aug 14 22:57:19 user nova-compute[72766]: </domain>
Aug 14 22:57:19 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:57:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1192671324',display_name='tempest-ServersNegativeTestJSON-server-1192671324',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1192671324',id=11,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='142137ab929f4e5289b06319af10751b',ramdisk_id='',reservation_id='r-hgl817p6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-968182857',owner_user_name='tempest-ServersNegativeTestJSON-968182857-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:57:16Z,user_data=None,user_id='4701a1ef84d94ce99ec55e44c1df9032',uuid=bde3ff44-cdf8-4ef7-bb7d-50865129268f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcaf8075-d371-4fcb-a6af-88b9a81dfeb8", "address": "fa:16:3e:6f:52:c5", "network": {"id": "5464d98e-0483-4d6d-895b-b51c50c0cfd9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-581355694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142137ab929f4e5289b06319af10751b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcaf8075-d3", "ovs_interfaceid": "bcaf8075-d371-4fcb-a6af-88b9a81dfeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Converting VIF {"id": "bcaf8075-d371-4fcb-a6af-88b9a81dfeb8", "address": "fa:16:3e:6f:52:c5", "network": {"id": "5464d98e-0483-4d6d-895b-b51c50c0cfd9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-581355694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142137ab929f4e5289b06319af10751b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcaf8075-d3", "ovs_interfaceid": "bcaf8075-d371-4fcb-a6af-88b9a81dfeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:52:c5,bridge_name='br-int',has_traffic_filtering=True,id=bcaf8075-d371-4fcb-a6af-88b9a81dfeb8,network=Network(5464d98e-0483-4d6d-895b-b51c50c0cfd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcaf8075-d3') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG os_vif [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:52:c5,bridge_name='br-int',has_traffic_filtering=True,id=bcaf8075-d371-4fcb-a6af-88b9a81dfeb8,network=Network(5464d98e-0483-4d6d-895b-b51c50c0cfd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcaf8075-d3') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbcaf8075-d3, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbcaf8075-d3, col_values=(('external_ids', {'iface-id': 'bcaf8075-d371-4fcb-a6af-88b9a81dfeb8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:52:c5', 'vm-uuid': 'bde3ff44-cdf8-4ef7-bb7d-50865129268f'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:19 user nova-compute[72766]: INFO os_vif [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:52:c5,bridge_name='br-int',has_traffic_filtering=True,id=bcaf8075-d371-4fcb-a6af-88b9a81dfeb8,network=Network(5464d98e-0483-4d6d-895b-b51c50c0cfd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcaf8075-d3')
Aug 14 22:57:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-88027493-31c3-439c-979b-898141ba05f4 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk --force-share --output=json -f qcow2" returned: 0 in 0.187s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-88027493-31c3-439c-979b-898141ba05f4 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk --force-share --output=json -f qcow2 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:57:19 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:57:20 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:57:20 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] No VIF found with MAC fa:16:3e:6f:52:c5, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:57:20 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-88027493-31c3-439c-979b-898141ba05f4 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:20 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-88027493-31c3-439c-979b-898141ba05f4 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:20 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-88027493-31c3-439c-979b-898141ba05f4 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.189s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:20 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-88027493-31c3-439c-979b-898141ba05f4 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2awm5qk6/02753edee82940a2b1df8a663901d589.delta 1073741824 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:20 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-88027493-31c3-439c-979b-898141ba05f4 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2awm5qk6/02753edee82940a2b1df8a663901d589.delta 1073741824" returned: 0 in 0.049s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:20 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-88027493-31c3-439c-979b-898141ba05f4 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 14 22:57:20 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-88027493-31c3-439c-979b-898141ba05f4 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Checking UEFI support for host arch (x86_64) {{(pid=72766) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 14 22:57:20 user nova-compute[72766]: INFO nova.virt.libvirt.host [None req-88027493-31c3-439c-979b-898141ba05f4 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] UEFI support detected
Aug 14 22:57:21 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-88027493-31c3-439c-979b-898141ba05f4 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=72766) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 22:57:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:22 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-88027493-31c3-439c-979b-898141ba05f4 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72766) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 22:57:22 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-88027493-31c3-439c-979b-898141ba05f4 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 14 22:57:22 user nova-compute[72766]: DEBUG nova.compute.manager [req-244795fd-7c8f-40ad-9501-25800edd122d req-72cae66f-27d8-438b-ad37-65aa7b3150fd service nova] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Received event network-vif-plugged-bcaf8075-d371-4fcb-a6af-88b9a81dfeb8 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:57:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-244795fd-7c8f-40ad-9501-25800edd122d req-72cae66f-27d8-438b-ad37-65aa7b3150fd service nova] Acquiring lock "bde3ff44-cdf8-4ef7-bb7d-50865129268f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:57:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-244795fd-7c8f-40ad-9501-25800edd122d req-72cae66f-27d8-438b-ad37-65aa7b3150fd service nova] Lock "bde3ff44-cdf8-4ef7-bb7d-50865129268f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:57:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-244795fd-7c8f-40ad-9501-25800edd122d req-72cae66f-27d8-438b-ad37-65aa7b3150fd service nova] Lock "bde3ff44-cdf8-4ef7-bb7d-50865129268f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:57:22 user nova-compute[72766]: DEBUG nova.compute.manager [req-244795fd-7c8f-40ad-9501-25800edd122d req-72cae66f-27d8-438b-ad37-65aa7b3150fd service nova] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] No waiting events found dispatching network-vif-plugged-bcaf8075-d371-4fcb-a6af-88b9a81dfeb8 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:57:22 user nova-compute[72766]: WARNING nova.compute.manager [req-244795fd-7c8f-40ad-9501-25800edd122d req-72cae66f-27d8-438b-ad37-65aa7b3150fd service nova] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Received unexpected event network-vif-plugged-bcaf8075-d371-4fcb-a6af-88b9a81dfeb8 for instance with vm_state building and task_state spawning.
Aug 14 22:57:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:22 user nova-compute[72766]: DEBUG nova.privsep.utils [None req-88027493-31c3-439c-979b-898141ba05f4 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72766) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 22:57:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-88027493-31c3-439c-979b-898141ba05f4 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2awm5qk6/02753edee82940a2b1df8a663901d589.delta /opt/stack/data/nova/instances/snapshots/tmp2awm5qk6/02753edee82940a2b1df8a663901d589 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-88027493-31c3-439c-979b-898141ba05f4 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2awm5qk6/02753edee82940a2b1df8a663901d589.delta /opt/stack/data/nova/instances/snapshots/tmp2awm5qk6/02753edee82940a2b1df8a663901d589" returned: 0 in 0.557s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:22 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-88027493-31c3-439c-979b-898141ba05f4 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Snapshot extracted, beginning image upload
Aug 14 22:57:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:24 user nova-compute[72766]: DEBUG nova.compute.manager [req-e5531a83-0cb3-440d-8ba8-6eca1aa61817 req-df1d93fd-87f6-49eb-a329-790919940f05 service nova] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Received event network-vif-plugged-bcaf8075-d371-4fcb-a6af-88b9a81dfeb8 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:57:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e5531a83-0cb3-440d-8ba8-6eca1aa61817 req-df1d93fd-87f6-49eb-a329-790919940f05 service nova] Acquiring lock "bde3ff44-cdf8-4ef7-bb7d-50865129268f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:57:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e5531a83-0cb3-440d-8ba8-6eca1aa61817 req-df1d93fd-87f6-49eb-a329-790919940f05 service nova] Lock "bde3ff44-cdf8-4ef7-bb7d-50865129268f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:57:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e5531a83-0cb3-440d-8ba8-6eca1aa61817 req-df1d93fd-87f6-49eb-a329-790919940f05 service nova] Lock "bde3ff44-cdf8-4ef7-bb7d-50865129268f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:57:24 user nova-compute[72766]: DEBUG nova.compute.manager [req-e5531a83-0cb3-440d-8ba8-6eca1aa61817 req-df1d93fd-87f6-49eb-a329-790919940f05 service nova] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] No waiting events found dispatching network-vif-plugged-bcaf8075-d371-4fcb-a6af-88b9a81dfeb8 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:57:24 user nova-compute[72766]: WARNING nova.compute.manager [req-e5531a83-0cb3-440d-8ba8-6eca1aa61817 req-df1d93fd-87f6-49eb-a329-790919940f05 service nova] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Received unexpected event network-vif-plugged-bcaf8075-d371-4fcb-a6af-88b9a81dfeb8 for instance with vm_state building and task_state spawning.
Aug 14 22:57:24 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692053844.572614, bde3ff44-cdf8-4ef7-bb7d-50865129268f => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:57:24 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] VM Resumed (Lifecycle Event)
Aug 14 22:57:24 user nova-compute[72766]: DEBUG nova.compute.manager [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 22:57:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 22:57:24 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Instance spawned successfully.
Aug 14 22:57:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 22:57:24 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:57:24 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:57:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:57:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:57:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:57:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:57:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:57:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:57:24 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:57:24 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692053844.5738075, bde3ff44-cdf8-4ef7-bb7d-50865129268f => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:57:24 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] VM Started (Lifecycle Event)
Aug 14 22:57:24 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:57:24 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:57:24 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:57:24 user nova-compute[72766]: INFO nova.compute.manager [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Took 8.65 seconds to spawn the instance on the hypervisor.
Aug 14 22:57:24 user nova-compute[72766]: DEBUG nova.compute.manager [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:57:24 user nova-compute[72766]: INFO nova.compute.manager [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Took 9.61 seconds to build instance.
Aug 14 22:57:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-3588590c-f67f-4fd9-b2f9-571bdd33c6fe tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Lock "bde3ff44-cdf8-4ef7-bb7d-50865129268f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.752s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:57:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:25 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-88027493-31c3-439c-979b-898141ba05f4 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Snapshot image upload complete
Aug 14 22:57:25 user nova-compute[72766]: INFO nova.compute.manager [None req-88027493-31c3-439c-979b-898141ba05f4 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Took 6.42 seconds to snapshot the instance on the hypervisor.
Aug 14 22:57:27 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LehwYGUB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:57:27 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:57:27 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:57:27 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:57:27 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:57:27 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 22:57:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369 -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83cbb70-57d2-4cdf-ac2b-26f4e555eacd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 22:57:27 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369 -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[13801ff6-081b-4a9a-9495-daa1f4f73d71]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369] added
Aug 14 22:57:27 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8522cd19-170d-41b8-a084-628906acb84a]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[036630b8-d625-4064-95de-e2879c5b80a0]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LehwYGUB {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LehwYGUB" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[98fbd009-2f17-40ca-bdba-421b1356a356]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LehwYGUB'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f2a810-0827-49d8-a8d9-650aa7563e71]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9cc9a80-4f36-418e-b88f-c31315ef3ffd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 22:57:27 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 22:57:27 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369 -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[09dcc032-2a3f-49cb-9a88-037aa3e6c6b6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369, portal: 172.16.0.220,3260]
Aug 14 22:57:27 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369, portal: 172.16.0.220,3260] successful.
Aug 14 22:57:27 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c93bab-8540-41c8-b0aa-0c9beeb46d1d]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55ede29-24e2-4cad-9243-eef42a7cc6df]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 22:57:27 user nova-compute[72766]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369 (non-flash)
Aug 14 22:57:27 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 22:57:27 user nova-compute[72766]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369 (non-flash)
Aug 14 22:57:27 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecef83f0-0f10-45a9-84e1-39e7c63691ba]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:57:27 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LehwYGUB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 22:57:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:28 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:57:28 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23066353266653563', 'path': '/dev/sdc'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:57:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066353266653563', 'path': '/dev/sdc'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 22:57:28 user nova-compute[72766]: DEBUG nova.objects.instance [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Lazy-loading 'flavor' on Instance uuid 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:57:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 22:57:28 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:57:28 user nova-compute[72766]:   <source dev="/dev/sdc"/>
Aug 14 22:57:28 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:57:28 user nova-compute[72766]:   <serial>97ef64c8-96bb-4701-b352-f1e0ed350369</serial>
Aug 14 22:57:28 user nova-compute[72766]: </disk>
Aug 14 22:57:28 user nova-compute[72766]:  {{(pid=72766) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 22:57:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:57:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:57:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] No VIF found with MAC fa:16:3e:50:0b:52, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:57:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-e5cbf2c2-1f0d-494e-90f0-389942c903c7 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Lock "023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.109s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:57:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Acquiring lock "023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:57:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Lock "023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:57:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Acquiring lock "023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:57:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Lock "023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:57:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Lock "023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:57:30 user nova-compute[72766]: INFO nova.compute.manager [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Terminating instance
Aug 14 22:57:30 user nova-compute[72766]: DEBUG nova.compute.manager [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 22:57:30 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:30 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:30 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:30 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:30 user nova-compute[72766]: DEBUG nova.compute.manager [req-53aac4ae-48f6-4980-8d1e-fcbda9da9d0a req-8c6c8147-4b8c-4680-8843-15677e6f707c service nova] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Received event network-vif-unplugged-098d7854-a4f9-4a29-ad8d-552083e4cf23 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:57:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-53aac4ae-48f6-4980-8d1e-fcbda9da9d0a req-8c6c8147-4b8c-4680-8843-15677e6f707c service nova] Acquiring lock "023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:57:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-53aac4ae-48f6-4980-8d1e-fcbda9da9d0a req-8c6c8147-4b8c-4680-8843-15677e6f707c service nova] Lock "023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:57:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-53aac4ae-48f6-4980-8d1e-fcbda9da9d0a req-8c6c8147-4b8c-4680-8843-15677e6f707c service nova] Lock "023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:57:30 user nova-compute[72766]: DEBUG nova.compute.manager [req-53aac4ae-48f6-4980-8d1e-fcbda9da9d0a req-8c6c8147-4b8c-4680-8843-15677e6f707c service nova] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] No waiting events found dispatching network-vif-unplugged-098d7854-a4f9-4a29-ad8d-552083e4cf23 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:57:30 user nova-compute[72766]: DEBUG nova.compute.manager [req-53aac4ae-48f6-4980-8d1e-fcbda9da9d0a req-8c6c8147-4b8c-4680-8843-15677e6f707c service nova] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Received event network-vif-unplugged-098d7854-a4f9-4a29-ad8d-552083e4cf23 for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 22:57:31 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Instance destroyed successfully.
Aug 14 22:57:31 user nova-compute[72766]: DEBUG nova.objects.instance [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Lazy-loading 'resources' on Instance uuid 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:55:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-322917443',display_name='tempest-DeleteServersTestJSON-server-322917443',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-322917443',id=1,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:55:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77c9d8bf74b94b4c9d82ec1308a7036e',ramdisk_id='',reservation_id='r-8fk0a1kt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1357277735',owner_user_name='tempest-DeleteServersTestJSON-1357277735-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:55:40Z,user_data=None,user_id='0421d92f15f44629b1885a36b4583a92',uuid=023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "098d7854-a4f9-4a29-ad8d-552083e4cf23", "address": "fa:16:3e:50:0b:52", "network": {"id": "aedbfcc5-5c6c-4eba-9533-aa5e618d1f4c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1720375606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c9d8bf74b94b4c9d82ec1308a7036e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap098d7854-a4", "ovs_interfaceid": "098d7854-a4f9-4a29-ad8d-552083e4cf23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Converting VIF {"id": "098d7854-a4f9-4a29-ad8d-552083e4cf23", "address": "fa:16:3e:50:0b:52", "network": {"id": "aedbfcc5-5c6c-4eba-9533-aa5e618d1f4c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1720375606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c9d8bf74b94b4c9d82ec1308a7036e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap098d7854-a4", "ovs_interfaceid": "098d7854-a4f9-4a29-ad8d-552083e4cf23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:0b:52,bridge_name='br-int',has_traffic_filtering=True,id=098d7854-a4f9-4a29-ad8d-552083e4cf23,network=Network(aedbfcc5-5c6c-4eba-9533-aa5e618d1f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap098d7854-a4') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG os_vif [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:0b:52,bridge_name='br-int',has_traffic_filtering=True,id=098d7854-a4f9-4a29-ad8d-552083e4cf23,network=Network(aedbfcc5-5c6c-4eba-9533-aa5e618d1f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap098d7854-a4') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap098d7854-a4, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:31 user nova-compute[72766]: INFO os_vif [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:0b:52,bridge_name='br-int',has_traffic_filtering=True,id=098d7854-a4f9-4a29-ad8d-552083e4cf23,network=Network(aedbfcc5-5c6c-4eba-9533-aa5e618d1f4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap098d7854-a4')
Aug 14 22:57:31 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LehwYGUB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:57:31 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:57:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3fec5d-5690-4586-94df-d7419170300b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b7608a-7de9-4ad8-99b8-8988d4c55217]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 22:57:31 user nova-compute[72766]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369 (non-flash)
Aug 14 22:57:31 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 22:57:31 user nova-compute[72766]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369 (non-flash)
Aug 14 22:57:31 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff16c367e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369'): ({'sdc'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Removing single pathed devices sdc {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[80551a5e-96d6-4134-ae91-26df34ebdf77]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[1106b6cc-3aae-4329-9af4-2ff064035189]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Flushing IO for device /dev/sdc {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[15dd9f6c-637a-41f0-ad0b-657405ca846d]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[610af2f9-84ca-43f0-afe1-5ddb0c75b93d]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] SCSI volumes sdc have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e59f88-2b71-4916-b7dc-e32d10aecbd5]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369 -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[684db069-be94-4edd-941b-3d1400c346d9]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369, portal: 172.16.0.220,3260]
Aug 14 22:57:31 user nova-compute[72766]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369, portal: 172.16.0.220,3260] successful.
Aug 14 22:57:31 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369 -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97ef64c8-96bb-4701-b352-f1e0ed350369 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1862aaf-188f-4396-9254-d76498ca26ab]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] <== disconnect_volume: return (287ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 22:57:31 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Deleting instance files /opt/stack/data/nova/instances/023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa_del
Aug 14 22:57:31 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Deletion of /opt/stack/data/nova/instances/023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa_del complete
Aug 14 22:57:31 user nova-compute[72766]: INFO nova.compute.manager [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Took 1.44 seconds to destroy the instance on the hypervisor.
Aug 14 22:57:31 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 22:57:31 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 22:57:32 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:57:32 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Took 0.73 seconds to deallocate network for instance.
Aug 14 22:57:32 user nova-compute[72766]: DEBUG nova.compute.manager [req-f8e51ff0-dcff-474f-8eaa-07b657ad4e61 req-feb3f5fe-8f68-4cd7-8249-769bc2754762 service nova] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Received event network-vif-deleted-098d7854-a4f9-4a29-ad8d-552083e4cf23 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:57:32 user nova-compute[72766]: INFO nova.compute.manager [req-f8e51ff0-dcff-474f-8eaa-07b657ad4e61 req-feb3f5fe-8f68-4cd7-8249-769bc2754762 service nova] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Neutron deleted interface 098d7854-a4f9-4a29-ad8d-552083e4cf23; detaching it from the instance and deleting it from the info cache
Aug 14 22:57:32 user nova-compute[72766]: DEBUG nova.network.neutron [req-f8e51ff0-dcff-474f-8eaa-07b657ad4e61 req-feb3f5fe-8f68-4cd7-8249-769bc2754762 service nova] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:57:32 user nova-compute[72766]: DEBUG nova.compute.manager [req-f8e51ff0-dcff-474f-8eaa-07b657ad4e61 req-feb3f5fe-8f68-4cd7-8249-769bc2754762 service nova] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Detach interface failed, port_id=098d7854-a4f9-4a29-ad8d-552083e4cf23, reason: Instance 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa could not be found. {{(pid=72766) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 22:57:32 user nova-compute[72766]: DEBUG nova.compute.manager [req-8c5f9447-8af5-4221-9381-00b1c1435af5 req-ff980e76-4abf-408b-bb67-181a8a0aa999 service nova] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Received event network-vif-plugged-098d7854-a4f9-4a29-ad8d-552083e4cf23 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:57:32 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8c5f9447-8af5-4221-9381-00b1c1435af5 req-ff980e76-4abf-408b-bb67-181a8a0aa999 service nova] Acquiring lock "023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:57:32 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8c5f9447-8af5-4221-9381-00b1c1435af5 req-ff980e76-4abf-408b-bb67-181a8a0aa999 service nova] Lock "023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:57:32 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8c5f9447-8af5-4221-9381-00b1c1435af5 req-ff980e76-4abf-408b-bb67-181a8a0aa999 service nova] Lock "023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:57:32 user nova-compute[72766]: DEBUG nova.compute.manager [req-8c5f9447-8af5-4221-9381-00b1c1435af5 req-ff980e76-4abf-408b-bb67-181a8a0aa999 service nova] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] No waiting events found dispatching network-vif-plugged-098d7854-a4f9-4a29-ad8d-552083e4cf23 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:57:32 user nova-compute[72766]: WARNING nova.compute.manager [req-8c5f9447-8af5-4221-9381-00b1c1435af5 req-ff980e76-4abf-408b-bb67-181a8a0aa999 service nova] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Received unexpected event network-vif-plugged-098d7854-a4f9-4a29-ad8d-552083e4cf23 for instance with vm_state active and task_state deleting.
Aug 14 22:57:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:33 user nova-compute[72766]: INFO nova.compute.manager [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Took 1.00 seconds to detach 1 volumes for instance.
Aug 14 22:57:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:57:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:57:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-a13027cc-a9fe-4f91-ae0c-145362068b42 req-49174672-5d95-466d-a0eb-8c27d846f6a1 service nova] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Received event network-changed-9c7ce835-f163-4f4a-bd47-26d5e06ff451 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:57:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-a13027cc-a9fe-4f91-ae0c-145362068b42 req-49174672-5d95-466d-a0eb-8c27d846f6a1 service nova] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Refreshing instance network info cache due to event network-changed-9c7ce835-f163-4f4a-bd47-26d5e06ff451. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:57:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a13027cc-a9fe-4f91-ae0c-145362068b42 req-49174672-5d95-466d-a0eb-8c27d846f6a1 service nova] Acquiring lock "refresh_cache-0850bb6c-6e3e-4007-8478-8eba53089158" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:57:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a13027cc-a9fe-4f91-ae0c-145362068b42 req-49174672-5d95-466d-a0eb-8c27d846f6a1 service nova] Acquired lock "refresh_cache-0850bb6c-6e3e-4007-8478-8eba53089158" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:57:33 user nova-compute[72766]: DEBUG nova.network.neutron [req-a13027cc-a9fe-4f91-ae0c-145362068b42 req-49174672-5d95-466d-a0eb-8c27d846f6a1 service nova] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Refreshing network info cache for port 9c7ce835-f163-4f4a-bd47-26d5e06ff451 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:57:33 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:57:33 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:57:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.396s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:57:33 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Deleted allocations for instance 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa
Aug 14 22:57:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-074caa1f-8c99-422f-b208-15a532e15cf6 tempest-DeleteServersTestJSON-1357277735 tempest-DeleteServersTestJSON-1357277735-project-member] Lock "023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.805s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:57:34 user nova-compute[72766]: DEBUG nova.network.neutron [req-a13027cc-a9fe-4f91-ae0c-145362068b42 req-49174672-5d95-466d-a0eb-8c27d846f6a1 service nova] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Updated VIF entry in instance network info cache for port 9c7ce835-f163-4f4a-bd47-26d5e06ff451. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:57:34 user nova-compute[72766]: DEBUG nova.network.neutron [req-a13027cc-a9fe-4f91-ae0c-145362068b42 req-49174672-5d95-466d-a0eb-8c27d846f6a1 service nova] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Updating instance_info_cache with network_info: [{"id": "9c7ce835-f163-4f4a-bd47-26d5e06ff451", "address": "fa:16:3e:38:75:a9", "network": {"id": "9bdd38f5-9734-4c5a-8a1c-5296215e6944", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1610393487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61a77920bef94526816c1a9c95531cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7ce835-f1", "ovs_interfaceid": "9c7ce835-f163-4f4a-bd47-26d5e06ff451", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:57:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a13027cc-a9fe-4f91-ae0c-145362068b42 req-49174672-5d95-466d-a0eb-8c27d846f6a1 service nova] Releasing lock "refresh_cache-0850bb6c-6e3e-4007-8478-8eba53089158" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:57:36 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:37 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Acquiring lock "0850bb6c-6e3e-4007-8478-8eba53089158" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:57:37 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lock "0850bb6c-6e3e-4007-8478-8eba53089158" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:57:37 user nova-compute[72766]: DEBUG nova.objects.instance [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lazy-loading 'flavor' on Instance uuid 0850bb6c-6e3e-4007-8478-8eba53089158 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:57:37 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lock "0850bb6c-6e3e-4007-8478-8eba53089158" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.092s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:57:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Acquiring lock "0850bb6c-6e3e-4007-8478-8eba53089158" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:57:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lock "0850bb6c-6e3e-4007-8478-8eba53089158" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:57:38 user nova-compute[72766]: INFO nova.compute.manager [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Attaching volume 03b69d23-ff98-4ffd-8dd3-76567061dbf4 to /dev/vdb
Aug 14 22:57:38 user nova-compute[72766]: DEBUG os_brick.utils [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:57:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:38 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6e6755-be11-4dc6-a041-72e908ee3dc0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:38 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[6381cd9a-f208-42aa-9269-1671d78aeb48]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:38 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[46eed595-6e41-4956-bd17-9899c11794d8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:38 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[42169508-d61e-4ec4-9c37-6484f8a98ba0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:57:38 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 22:57:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:57:38 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 22:57:38 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[838454e6-eb57-47df-a2d5-83350021cd1a]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:38 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 22:57:38 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 22:57:38 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 22:57:38 user nova-compute[72766]: DEBUG os_brick.utils [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:57:38 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Updating existing volume attachment record: 4e117f16-4b7a-468a-9c8b-102176f4e601 {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 22:57:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:43 user nova-compute[72766]: DEBUG nova.compute.manager [req-aa21b505-c9c9-43fd-8e62-9da5f7d49d98 req-07cd375e-5132-4c00-8acb-d33a1ad76462 service nova] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Received event network-changed-9406f951-b950-463d-9574-104a83b25e7d {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:57:43 user nova-compute[72766]: DEBUG nova.compute.manager [req-aa21b505-c9c9-43fd-8e62-9da5f7d49d98 req-07cd375e-5132-4c00-8acb-d33a1ad76462 service nova] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Refreshing instance network info cache due to event network-changed-9406f951-b950-463d-9574-104a83b25e7d. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:57:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-aa21b505-c9c9-43fd-8e62-9da5f7d49d98 req-07cd375e-5132-4c00-8acb-d33a1ad76462 service nova] Acquiring lock "refresh_cache-40cd301a-97f2-4f02-b091-f5a2bb1cd016" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:57:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-aa21b505-c9c9-43fd-8e62-9da5f7d49d98 req-07cd375e-5132-4c00-8acb-d33a1ad76462 service nova] Acquired lock "refresh_cache-40cd301a-97f2-4f02-b091-f5a2bb1cd016" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:57:43 user nova-compute[72766]: DEBUG nova.network.neutron [req-aa21b505-c9c9-43fd-8e62-9da5f7d49d98 req-07cd375e-5132-4c00-8acb-d33a1ad76462 service nova] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Refreshing network info cache for port 9406f951-b950-463d-9574-104a83b25e7d {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:57:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:43 user nova-compute[72766]: DEBUG nova.network.neutron [req-aa21b505-c9c9-43fd-8e62-9da5f7d49d98 req-07cd375e-5132-4c00-8acb-d33a1ad76462 service nova] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Updated VIF entry in instance network info cache for port 9406f951-b950-463d-9574-104a83b25e7d. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:57:43 user nova-compute[72766]: DEBUG nova.network.neutron [req-aa21b505-c9c9-43fd-8e62-9da5f7d49d98 req-07cd375e-5132-4c00-8acb-d33a1ad76462 service nova] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Updating instance_info_cache with network_info: [{"id": "9406f951-b950-463d-9574-104a83b25e7d", "address": "fa:16:3e:97:20:81", "network": {"id": "12035bbc-2507-4317-af8b-a71f420b938e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-280915665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85cdad610d1c4f8f9eb3d2677ad62c5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9406f951-b9", "ovs_interfaceid": "9406f951-b950-463d-9574-104a83b25e7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:57:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-aa21b505-c9c9-43fd-8e62-9da5f7d49d98 req-07cd375e-5132-4c00-8acb-d33a1ad76462 service nova] Releasing lock "refresh_cache-40cd301a-97f2-4f02-b091-f5a2bb1cd016" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:57:46 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692053851.2336624, 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:57:46 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] VM Stopped (Lifecycle Event)
Aug 14 22:57:46 user nova-compute[72766]: DEBUG nova.compute.manager [None req-53d50c80-e30a-498f-b94e-f2e4fa4d2d83 None None] [instance: 023e16fd-7e7d-4a3d-8f66-5f1cd5b085aa] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:57:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:46 user nova-compute[72766]: DEBUG nova.compute.manager [req-dabea57e-e5eb-4072-a866-81a6a9310a20 req-e5cb444b-092b-4235-aa97-5c22be6beadd service nova] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Received event network-changed-58e0b222-3a0a-40d3-ad60-e92985bd3584 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:57:46 user nova-compute[72766]: DEBUG nova.compute.manager [req-dabea57e-e5eb-4072-a866-81a6a9310a20 req-e5cb444b-092b-4235-aa97-5c22be6beadd service nova] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Refreshing instance network info cache due to event network-changed-58e0b222-3a0a-40d3-ad60-e92985bd3584. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:57:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-dabea57e-e5eb-4072-a866-81a6a9310a20 req-e5cb444b-092b-4235-aa97-5c22be6beadd service nova] Acquiring lock "refresh_cache-90b55775-2f14-4c80-b48a-b1eed2b570dc" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:57:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-dabea57e-e5eb-4072-a866-81a6a9310a20 req-e5cb444b-092b-4235-aa97-5c22be6beadd service nova] Acquired lock "refresh_cache-90b55775-2f14-4c80-b48a-b1eed2b570dc" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:57:46 user nova-compute[72766]: DEBUG nova.network.neutron [req-dabea57e-e5eb-4072-a866-81a6a9310a20 req-e5cb444b-092b-4235-aa97-5c22be6beadd service nova] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Refreshing network info cache for port 58e0b222-3a0a-40d3-ad60-e92985bd3584 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Acquiring lock "40cd301a-97f2-4f02-b091-f5a2bb1cd016" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Lock "40cd301a-97f2-4f02-b091-f5a2bb1cd016" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG nova.objects.instance [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Lazy-loading 'flavor' on Instance uuid 40cd301a-97f2-4f02-b091-f5a2bb1cd016 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Lock "40cd301a-97f2-4f02-b091-f5a2bb1cd016" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG nova.network.neutron [req-dabea57e-e5eb-4072-a866-81a6a9310a20 req-e5cb444b-092b-4235-aa97-5c22be6beadd service nova] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Updated VIF entry in instance network info cache for port 58e0b222-3a0a-40d3-ad60-e92985bd3584. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG nova.network.neutron [req-dabea57e-e5eb-4072-a866-81a6a9310a20 req-e5cb444b-092b-4235-aa97-5c22be6beadd service nova] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Updating instance_info_cache with network_info: [{"id": "58e0b222-3a0a-40d3-ad60-e92985bd3584", "address": "fa:16:3e:5e:2c:02", "network": {"id": "6f03ef5e-cea3-4538-9f91-e35f756665a1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1408762454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d841b7f732a743658e035777c8629c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e0b222-3a", "ovs_interfaceid": "58e0b222-3a0a-40d3-ad60-e92985bd3584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-dabea57e-e5eb-4072-a866-81a6a9310a20 req-e5cb444b-092b-4235-aa97-5c22be6beadd service nova] Releasing lock "refresh_cache-90b55775-2f14-4c80-b48a-b1eed2b570dc" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-62ef1ebd-eb82-496a-8116-088cdca08ad1 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Acquiring lock "interface-90b55775-2f14-4c80-b48a-b1eed2b570dc-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-62ef1ebd-eb82-496a-8116-088cdca08ad1 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Lock "interface-90b55775-2f14-4c80-b48a-b1eed2b570dc-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG nova.objects.instance [None req-62ef1ebd-eb82-496a-8116-088cdca08ad1 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Lazy-loading 'flavor' on Instance uuid 90b55775-2f14-4c80-b48a-b1eed2b570dc {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Acquiring lock "40cd301a-97f2-4f02-b091-f5a2bb1cd016" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Lock "40cd301a-97f2-4f02-b091-f5a2bb1cd016" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:57:47 user nova-compute[72766]: INFO nova.compute.manager [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Attaching volume 3484f6dd-f78e-43d5-aa74-c668e8181de9 to /dev/sdc
Aug 14 22:57:47 user nova-compute[72766]: DEBUG os_brick.utils [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG nova.objects.instance [None req-62ef1ebd-eb82-496a-8116-088cdca08ad1 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Lazy-loading 'pci_requests' on Instance uuid 90b55775-2f14-4c80-b48a-b1eed2b570dc {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9020351-beb8-4f5c-b829-6cfdd7d9c7ff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG nova.network.neutron [None req-62ef1ebd-eb82-496a-8116-088cdca08ad1 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6da0e3d-31c6-48a1-a6ef-232b438425dd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15f0cd0-4514-42d5-9438-ab09ac05d81e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b3d560-9701-43b7-862d-c091090504a9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:57:47 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 22:57:47 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eeacf2c-54b0-4c78-943b-fe9b444e6cd3]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG os_brick.utils [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Updating existing volume attachment record: 2e9bbb3d-cfef-4977-ab94-5a87477a4106 {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG nova.policy [None req-62ef1ebd-eb82-496a-8116-088cdca08ad1 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'adf9d286eb5749e7a5278af949ca1a9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd841b7f732a743658e035777c8629c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GFsepMXc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:57:47 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:57:47 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:57:47 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:57:47 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:57:47 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 22:57:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4 -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2a3c20-d25e-4088-813f-618f99fd5faf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 22:57:47 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4 -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[521a3a93-64dd-4f61-9178-1bc1119fca05]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4] added
Aug 14 22:57:47 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c1e3e6-688a-488e-87f2-0aaefa21e47b]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b3caa4-b66a-4f35-aa6d-ac308d7c7a9a]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GFsepMXc {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GFsepMXc" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd59c987-6f6c-4706-8f87-3778a3af2a92]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GFsepMXc'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a9dac1-5740-44aa-b031-c149e904d268]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:57:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:48 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a758c2f-141d-40c2-b179-3fe4077d8b1c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 22:57:48 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:57:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 22:57:48 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:57:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4 -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:48 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b95a8f4-218b-4e57-a070-8a750bc62612]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4, portal: 172.16.0.220,3260]
Aug 14 22:57:48 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4, portal: 172.16.0.220,3260] successful.
Aug 14 22:57:48 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:57:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:48 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[da146db3-3296-4a90-b3f8-ce85c3c51722]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:57:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:48 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b77deb-8271-44b5-b2c9-94536b51d92e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 22:57:48 user nova-compute[72766]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4 (non-flash)
Aug 14 22:57:48 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:57:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 22:57:48 user nova-compute[72766]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4 (non-flash)
Aug 14 22:57:48 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:57:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:57:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 22:57:48 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 22:57:48 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 22:57:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:48 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb7ef33-0477-491b-a1ec-876dd7335bcd]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:48 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: None {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:57:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:48 user nova-compute[72766]: DEBUG nova.network.neutron [None req-62ef1ebd-eb82-496a-8116-088cdca08ad1 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Successfully created port: a886f590-4818-4e79-ad6c-785067fbff0d {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 22:57:49 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:57:49 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GFsepMXc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 22:57:49 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:57:49 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23065306434353961', 'path': '/dev/sdc'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:57:49 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065306434353961', 'path': '/dev/sdc'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 22:57:49 user nova-compute[72766]: DEBUG nova.objects.instance [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lazy-loading 'flavor' on Instance uuid 0850bb6c-6e3e-4007-8478-8eba53089158 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:57:49 user nova-compute[72766]: DEBUG nova.compute.manager [req-694cefe9-f4cc-48bf-b96c-04819aae8046 req-88cd6d77-6759-4b35-8f9e-50accfd27628 service nova] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Received event network-changed-3eb61059-fbcd-4dbc-9a10-81aed042e936 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:57:49 user nova-compute[72766]: DEBUG nova.compute.manager [req-694cefe9-f4cc-48bf-b96c-04819aae8046 req-88cd6d77-6759-4b35-8f9e-50accfd27628 service nova] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Refreshing instance network info cache due to event network-changed-3eb61059-fbcd-4dbc-9a10-81aed042e936. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:57:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-694cefe9-f4cc-48bf-b96c-04819aae8046 req-88cd6d77-6759-4b35-8f9e-50accfd27628 service nova] Acquiring lock "refresh_cache-b55141bc-d426-4d35-8ae5-269ece19a793" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:57:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-694cefe9-f4cc-48bf-b96c-04819aae8046 req-88cd6d77-6759-4b35-8f9e-50accfd27628 service nova] Acquired lock "refresh_cache-b55141bc-d426-4d35-8ae5-269ece19a793" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:57:49 user nova-compute[72766]: DEBUG nova.network.neutron [req-694cefe9-f4cc-48bf-b96c-04819aae8046 req-88cd6d77-6759-4b35-8f9e-50accfd27628 service nova] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Refreshing network info cache for port 3eb61059-fbcd-4dbc-9a10-81aed042e936 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:57:49 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 22:57:49 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:57:49 user nova-compute[72766]:   <source dev="/dev/sdc"/>
Aug 14 22:57:49 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:57:49 user nova-compute[72766]:   <serial>03b69d23-ff98-4ffd-8dd3-76567061dbf4</serial>
Aug 14 22:57:49 user nova-compute[72766]: </disk>
Aug 14 22:57:49 user nova-compute[72766]:  {{(pid=72766) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 22:57:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Acquiring lock "b55141bc-d426-4d35-8ae5-269ece19a793" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:57:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Lock "b55141bc-d426-4d35-8ae5-269ece19a793" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:57:49 user nova-compute[72766]: DEBUG nova.objects.instance [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Lazy-loading 'flavor' on Instance uuid b55141bc-d426-4d35-8ae5-269ece19a793 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:57:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Lock "b55141bc-d426-4d35-8ae5-269ece19a793" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.112s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:57:49 user nova-compute[72766]: DEBUG nova.network.neutron [None req-62ef1ebd-eb82-496a-8116-088cdca08ad1 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Successfully updated port: a886f590-4818-4e79-ad6c-785067fbff0d {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 22:57:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-62ef1ebd-eb82-496a-8116-088cdca08ad1 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Acquiring lock "refresh_cache-90b55775-2f14-4c80-b48a-b1eed2b570dc" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:57:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-62ef1ebd-eb82-496a-8116-088cdca08ad1 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Acquired lock "refresh_cache-90b55775-2f14-4c80-b48a-b1eed2b570dc" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:57:49 user nova-compute[72766]: DEBUG nova.network.neutron [None req-62ef1ebd-eb82-496a-8116-088cdca08ad1 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:57:49 user nova-compute[72766]: DEBUG nova.compute.manager [req-2260c796-6bb3-4570-a966-c7e131a0278c req-4ba523ff-6c1d-469d-afbe-8b23c9d3416a service nova] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Received event network-changed-a886f590-4818-4e79-ad6c-785067fbff0d {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:57:49 user nova-compute[72766]: DEBUG nova.compute.manager [req-2260c796-6bb3-4570-a966-c7e131a0278c req-4ba523ff-6c1d-469d-afbe-8b23c9d3416a service nova] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Refreshing instance network info cache due to event network-changed-a886f590-4818-4e79-ad6c-785067fbff0d. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:57:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2260c796-6bb3-4570-a966-c7e131a0278c req-4ba523ff-6c1d-469d-afbe-8b23c9d3416a service nova] Acquiring lock "refresh_cache-90b55775-2f14-4c80-b48a-b1eed2b570dc" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:57:49 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:57:49 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:57:49 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] No VIF found with MAC fa:16:3e:38:75:a9, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:57:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Acquiring lock "33e6f8aa-bb0d-478d-b7b5-3334302476fb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:57:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Lock "33e6f8aa-bb0d-478d-b7b5-3334302476fb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:57:49 user nova-compute[72766]: DEBUG nova.objects.instance [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Lazy-loading 'flavor' on Instance uuid 33e6f8aa-bb0d-478d-b7b5-3334302476fb {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:57:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Acquiring lock "b55141bc-d426-4d35-8ae5-269ece19a793" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:57:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Lock "b55141bc-d426-4d35-8ae5-269ece19a793" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:57:49 user nova-compute[72766]: INFO nova.compute.manager [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Attaching volume 95b6f500-e1ac-418f-a438-72230173c207 to /dev/vdb
Aug 14 22:57:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Lock "33e6f8aa-bb0d-478d-b7b5-3334302476fb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.098s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:57:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-bb69f193-5171-41f2-9ac1-3c212732fb65 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lock "0850bb6c-6e3e-4007-8478-8eba53089158" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.874s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:57:49 user nova-compute[72766]: DEBUG os_brick.utils [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:57:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:49 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b098f369-ee10-427e-b29d-320dbc984db9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:49 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[0938c7b3-a6a5-4926-8781-82eb15f17a5d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:49 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4606e8-cdd5-4325-8284-33b5b7605dcd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:49 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81670cb-ff13-4db9-bc67-1ccba59cd09f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG nova.network.neutron [req-694cefe9-f4cc-48bf-b96c-04819aae8046 req-88cd6d77-6759-4b35-8f9e-50accfd27628 service nova] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Updated VIF entry in instance network info cache for port 3eb61059-fbcd-4dbc-9a10-81aed042e936. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG nova.network.neutron [req-694cefe9-f4cc-48bf-b96c-04819aae8046 req-88cd6d77-6759-4b35-8f9e-50accfd27628 service nova] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Updating instance_info_cache with network_info: [{"id": "3eb61059-fbcd-4dbc-9a10-81aed042e936", "address": "fa:16:3e:b5:ed:a3", "network": {"id": "0ebb9d77-2a5a-4ef1-923e-bd683ccc798c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-8258803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da868713db654a55b759f16167c88297", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb61059-fb", "ovs_interfaceid": "3eb61059-fbcd-4dbc-9a10-81aed042e936", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:57:50 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 22:57:50 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ce2f5f-37ca-4794-9b97-b77f99f45ca4]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-694cefe9-f4cc-48bf-b96c-04819aae8046 req-88cd6d77-6759-4b35-8f9e-50accfd27628 service nova] Releasing lock "refresh_cache-b55141bc-d426-4d35-8ae5-269ece19a793" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG os_brick.utils [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] <== get_connector_properties: return (181ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Updating existing volume attachment record: 917e0aa5-c47a-4aaf-b98a-92f6bb81a1c8 {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Acquiring lock "33e6f8aa-bb0d-478d-b7b5-3334302476fb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Lock "33e6f8aa-bb0d-478d-b7b5-3334302476fb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:57:50 user nova-compute[72766]: INFO nova.compute.manager [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Attaching volume 37f3ab46-4f0d-408f-a4e6-d634bc8e498e to /dev/vdb
Aug 14 22:57:50 user nova-compute[72766]: DEBUG os_brick.utils [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d107d525-48b9-45a5-b2e3-27f6d73adcc3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[81747592-d11a-450e-84d7-01ee9ef16a74]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[43704e1a-6ff5-4770-b609-08b34982df31]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b59b28-1a49-4740-91e9-df0ac7fadc68]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:57:50 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 22:57:50 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d6d03d-3600-4c38-8fc6-87877d303df7]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG os_brick.utils [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Updating existing volume attachment record: dff8bc0a-1716-4e6f-b32e-2c0cfda80f42 {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG nova.network.neutron [None req-62ef1ebd-eb82-496a-8116-088cdca08ad1 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Updating instance_info_cache with network_info: [{"id": "58e0b222-3a0a-40d3-ad60-e92985bd3584", "address": "fa:16:3e:5e:2c:02", "network": {"id": "6f03ef5e-cea3-4538-9f91-e35f756665a1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1408762454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d841b7f732a743658e035777c8629c50", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e0b222-3a", "ovs_interfaceid": "58e0b222-3a0a-40d3-ad60-e92985bd3584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a886f590-4818-4e79-ad6c-785067fbff0d", "address": "fa:16:3e:14:59:64", "network": {"id": "86616d0d-d4bf-4c7d-ab66-1f92f05d79d6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1584215259", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d841b7f732a743658e035777c8629c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa886f590-48", "ovs_interfaceid": "a886f590-4818-4e79-ad6c-785067fbff0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-62ef1ebd-eb82-496a-8116-088cdca08ad1 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Releasing lock "refresh_cache-90b55775-2f14-4c80-b48a-b1eed2b570dc" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2260c796-6bb3-4570-a966-c7e131a0278c req-4ba523ff-6c1d-469d-afbe-8b23c9d3416a service nova] Acquired lock "refresh_cache-90b55775-2f14-4c80-b48a-b1eed2b570dc" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG nova.network.neutron [req-2260c796-6bb3-4570-a966-c7e131a0278c req-4ba523ff-6c1d-469d-afbe-8b23c9d3416a service nova] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Refreshing network info cache for port a886f590-4818-4e79-ad6c-785067fbff0d {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-62ef1ebd-eb82-496a-8116-088cdca08ad1 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T22:55:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-359420211',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-359420211',id=6,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8cq16Tr/aSGWtJWb/xfeRNJOb+B6LjH5taG4rznYJbzp5KjGb+MpXm0+8Y+Xs3FuiWq9fVeEhIpGtH4iqY05CSFniUjByOF+zxj8vXJaj8j0+QLFR098sJu8pYQ2V7Ow==',key_name='tempest-keypair-975754438',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:56:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d841b7f732a743658e035777c8629c50',ramdisk_id='',reservation_id='r-iogn86da',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1079325823',owner_user_name='tempest-TaggedAttachmentsTest-1079325823-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adf9d286eb5749e7a5278af949ca1a9f',uuid=90b55775-2f14-4c80-b48a-b1eed2b570dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a886f590-4818-4e79-ad6c-785067fbff0d", "address": "fa:16:3e:14:59:64", "network": {"id": "86616d0d-d4bf-4c7d-ab66-1f92f05d79d6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1584215259", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d841b7f732a743658e035777c8629c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa886f590-48", "ovs_interfaceid": "a886f590-4818-4e79-ad6c-785067fbff0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-62ef1ebd-eb82-496a-8116-088cdca08ad1 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Converting VIF {"id": "a886f590-4818-4e79-ad6c-785067fbff0d", "address": "fa:16:3e:14:59:64", "network": {"id": "86616d0d-d4bf-4c7d-ab66-1f92f05d79d6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1584215259", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d841b7f732a743658e035777c8629c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa886f590-48", "ovs_interfaceid": "a886f590-4818-4e79-ad6c-785067fbff0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-62ef1ebd-eb82-496a-8116-088cdca08ad1 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:59:64,bridge_name='br-int',has_traffic_filtering=True,id=a886f590-4818-4e79-ad6c-785067fbff0d,network=Network(86616d0d-d4bf-4c7d-ab66-1f92f05d79d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa886f590-48') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG os_vif [None req-62ef1ebd-eb82-496a-8116-088cdca08ad1 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:59:64,bridge_name='br-int',has_traffic_filtering=True,id=a886f590-4818-4e79-ad6c-785067fbff0d,network=Network(86616d0d-d4bf-4c7d-ab66-1f92f05d79d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa886f590-48') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa886f590-48, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa886f590-48, col_values=(('external_ids', {'iface-id': 'a886f590-4818-4e79-ad6c-785067fbff0d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:59:64', 'vm-uuid': '90b55775-2f14-4c80-b48a-b1eed2b570dc'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:50 user nova-compute[72766]: INFO os_vif [None req-62ef1ebd-eb82-496a-8116-088cdca08ad1 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:59:64,bridge_name='br-int',has_traffic_filtering=True,id=a886f590-4818-4e79-ad6c-785067fbff0d,network=Network(86616d0d-d4bf-4c7d-ab66-1f92f05d79d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa886f590-48')
Aug 14 22:57:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-62ef1ebd-eb82-496a-8116-088cdca08ad1 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T22:55:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-359420211',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-359420211',id=6,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8cq16Tr/aSGWtJWb/xfeRNJOb+B6LjH5taG4rznYJbzp5KjGb+MpXm0+8Y+Xs3FuiWq9fVeEhIpGtH4iqY05CSFniUjByOF+zxj8vXJaj8j0+QLFR098sJu8pYQ2V7Ow==',key_name='tempest-keypair-975754438',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:56:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d841b7f732a743658e035777c8629c50',ramdisk_id='',reservation_id='r-iogn86da',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1079325823',owner_user_name='tempest-TaggedAttachmentsTest-1079325823-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adf9d286eb5749e7a5278af949ca1a9f',uuid=90b55775-2f14-4c80-b48a-b1eed2b570dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a886f590-4818-4e79-ad6c-785067fbff0d", "address": "fa:16:3e:14:59:64", "network": {"id": "86616d0d-d4bf-4c7d-ab66-1f92f05d79d6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1584215259", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d841b7f732a743658e035777c8629c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa886f590-48", "ovs_interfaceid": "a886f590-4818-4e79-ad6c-785067fbff0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-62ef1ebd-eb82-496a-8116-088cdca08ad1 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Converting VIF {"id": "a886f590-4818-4e79-ad6c-785067fbff0d", "address": "fa:16:3e:14:59:64", "network": {"id": "86616d0d-d4bf-4c7d-ab66-1f92f05d79d6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1584215259", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d841b7f732a743658e035777c8629c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa886f590-48", "ovs_interfaceid": "a886f590-4818-4e79-ad6c-785067fbff0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-62ef1ebd-eb82-496a-8116-088cdca08ad1 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:59:64,bridge_name='br-int',has_traffic_filtering=True,id=a886f590-4818-4e79-ad6c-785067fbff0d,network=Network(86616d0d-d4bf-4c7d-ab66-1f92f05d79d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa886f590-48') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-62ef1ebd-eb82-496a-8116-088cdca08ad1 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] attach device xml: <interface type="ethernet">
Aug 14 22:57:50 user nova-compute[72766]:   <mac address="fa:16:3e:14:59:64"/>
Aug 14 22:57:50 user nova-compute[72766]:   <model type="virtio"/>
Aug 14 22:57:50 user nova-compute[72766]:   <mtu size="1442"/>
Aug 14 22:57:50 user nova-compute[72766]:   <target dev="tapa886f590-48"/>
Aug 14 22:57:50 user nova-compute[72766]: </interface>
Aug 14 22:57:50 user nova-compute[72766]:  {{(pid=72766) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-62ef1ebd-eb82-496a-8116-088cdca08ad1 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:57:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-62ef1ebd-eb82-496a-8116-088cdca08ad1 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] No BDM found with device name hda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:57:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-62ef1ebd-eb82-496a-8116-088cdca08ad1 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] No VIF found with MAC fa:16:3e:5e:2c:02, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:57:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-62ef1ebd-eb82-496a-8116-088cdca08ad1 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:57:51 user nova-compute[72766]:   <nova:package version="0.0.0"/>
Aug 14 22:57:51 user nova-compute[72766]:   <nova:name>tempest-device-tagging-server-359420211</nova:name>
Aug 14 22:57:51 user nova-compute[72766]:   <nova:creationTime>2023-08-14 22:57:51</nova:creationTime>
Aug 14 22:57:51 user nova-compute[72766]:   <nova:flavor name="m1.tiny">
Aug 14 22:57:51 user nova-compute[72766]:     <nova:memory>512</nova:memory>
Aug 14 22:57:51 user nova-compute[72766]:     <nova:disk>1</nova:disk>
Aug 14 22:57:51 user nova-compute[72766]:     <nova:swap>0</nova:swap>
Aug 14 22:57:51 user nova-compute[72766]:     <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:57:51 user nova-compute[72766]:     <nova:vcpus>1</nova:vcpus>
Aug 14 22:57:51 user nova-compute[72766]:   </nova:flavor>
Aug 14 22:57:51 user nova-compute[72766]:   <nova:owner>
Aug 14 22:57:51 user nova-compute[72766]:     <nova:user uuid="adf9d286eb5749e7a5278af949ca1a9f">tempest-TaggedAttachmentsTest-1079325823-project-member</nova:user>
Aug 14 22:57:51 user nova-compute[72766]:     <nova:project uuid="d841b7f732a743658e035777c8629c50">tempest-TaggedAttachmentsTest-1079325823</nova:project>
Aug 14 22:57:51 user nova-compute[72766]:   </nova:owner>
Aug 14 22:57:51 user nova-compute[72766]:   <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 22:57:51 user nova-compute[72766]:   <nova:ports>
Aug 14 22:57:51 user nova-compute[72766]:     <nova:port uuid="58e0b222-3a0a-40d3-ad60-e92985bd3584">
Aug 14 22:57:51 user nova-compute[72766]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 22:57:51 user nova-compute[72766]:     </nova:port>
Aug 14 22:57:51 user nova-compute[72766]:     <nova:port uuid="a886f590-4818-4e79-ad6c-785067fbff0d">
Aug 14 22:57:51 user nova-compute[72766]:       <nova:ip type="fixed" address="10.10.10.235" ipVersion="4"/>
Aug 14 22:57:51 user nova-compute[72766]:     </nova:port>
Aug 14 22:57:51 user nova-compute[72766]:   </nova:ports>
Aug 14 22:57:51 user nova-compute[72766]: </nova:instance>
Aug 14 22:57:51 user nova-compute[72766]:  {{(pid=72766) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 14 22:57:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-62ef1ebd-eb82-496a-8116-088cdca08ad1 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Lock "interface-90b55775-2f14-4c80-b48a-b1eed2b570dc-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.969s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:57:51 user nova-compute[72766]: DEBUG nova.compute.manager [req-e86d3844-4745-4d9e-9643-6371dcd6fcda req-ad319771-f711-4249-b857-ed5e924d919b service nova] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Received event network-changed-9a214a31-3ef2-4a37-b0fa-c27a86be068c {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:57:51 user nova-compute[72766]: DEBUG nova.compute.manager [req-e86d3844-4745-4d9e-9643-6371dcd6fcda req-ad319771-f711-4249-b857-ed5e924d919b service nova] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Refreshing instance network info cache due to event network-changed-9a214a31-3ef2-4a37-b0fa-c27a86be068c. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:57:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e86d3844-4745-4d9e-9643-6371dcd6fcda req-ad319771-f711-4249-b857-ed5e924d919b service nova] Acquiring lock "refresh_cache-33e6f8aa-bb0d-478d-b7b5-3334302476fb" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:57:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e86d3844-4745-4d9e-9643-6371dcd6fcda req-ad319771-f711-4249-b857-ed5e924d919b service nova] Acquired lock "refresh_cache-33e6f8aa-bb0d-478d-b7b5-3334302476fb" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:57:51 user nova-compute[72766]: DEBUG nova.network.neutron [req-e86d3844-4745-4d9e-9643-6371dcd6fcda req-ad319771-f711-4249-b857-ed5e924d919b service nova] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Refreshing network info cache for port 9a214a31-3ef2-4a37-b0fa-c27a86be068c {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:57:51 user nova-compute[72766]: DEBUG nova.network.neutron [req-2260c796-6bb3-4570-a966-c7e131a0278c req-4ba523ff-6c1d-469d-afbe-8b23c9d3416a service nova] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Updated VIF entry in instance network info cache for port a886f590-4818-4e79-ad6c-785067fbff0d. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:57:51 user nova-compute[72766]: DEBUG nova.network.neutron [req-2260c796-6bb3-4570-a966-c7e131a0278c req-4ba523ff-6c1d-469d-afbe-8b23c9d3416a service nova] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Updating instance_info_cache with network_info: [{"id": "58e0b222-3a0a-40d3-ad60-e92985bd3584", "address": "fa:16:3e:5e:2c:02", "network": {"id": "6f03ef5e-cea3-4538-9f91-e35f756665a1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1408762454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d841b7f732a743658e035777c8629c50", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e0b222-3a", "ovs_interfaceid": "58e0b222-3a0a-40d3-ad60-e92985bd3584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a886f590-4818-4e79-ad6c-785067fbff0d", "address": "fa:16:3e:14:59:64", "network": {"id": "86616d0d-d4bf-4c7d-ab66-1f92f05d79d6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1584215259", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d841b7f732a743658e035777c8629c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa886f590-48", "ovs_interfaceid": "a886f590-4818-4e79-ad6c-785067fbff0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:57:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2260c796-6bb3-4570-a966-c7e131a0278c req-4ba523ff-6c1d-469d-afbe-8b23c9d3416a service nova] Releasing lock "refresh_cache-90b55775-2f14-4c80-b48a-b1eed2b570dc" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:57:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:51 user nova-compute[72766]: DEBUG nova.compute.manager [req-96adce1a-3105-482f-9b00-95c21881de61 req-f7b79a8d-0de1-4112-a43d-db4f20b7002e service nova] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Received event network-vif-plugged-a886f590-4818-4e79-ad6c-785067fbff0d {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:57:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-96adce1a-3105-482f-9b00-95c21881de61 req-f7b79a8d-0de1-4112-a43d-db4f20b7002e service nova] Acquiring lock "90b55775-2f14-4c80-b48a-b1eed2b570dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:57:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-96adce1a-3105-482f-9b00-95c21881de61 req-f7b79a8d-0de1-4112-a43d-db4f20b7002e service nova] Lock "90b55775-2f14-4c80-b48a-b1eed2b570dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:57:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-96adce1a-3105-482f-9b00-95c21881de61 req-f7b79a8d-0de1-4112-a43d-db4f20b7002e service nova] Lock "90b55775-2f14-4c80-b48a-b1eed2b570dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:57:51 user nova-compute[72766]: DEBUG nova.compute.manager [req-96adce1a-3105-482f-9b00-95c21881de61 req-f7b79a8d-0de1-4112-a43d-db4f20b7002e service nova] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] No waiting events found dispatching network-vif-plugged-a886f590-4818-4e79-ad6c-785067fbff0d {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:57:51 user nova-compute[72766]: WARNING nova.compute.manager [req-96adce1a-3105-482f-9b00-95c21881de61 req-f7b79a8d-0de1-4112-a43d-db4f20b7002e service nova] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Received unexpected event network-vif-plugged-a886f590-4818-4e79-ad6c-785067fbff0d for instance with vm_state active and task_state None.
Aug 14 22:57:51 user nova-compute[72766]: DEBUG nova.compute.manager [req-96adce1a-3105-482f-9b00-95c21881de61 req-f7b79a8d-0de1-4112-a43d-db4f20b7002e service nova] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Received event network-vif-plugged-a886f590-4818-4e79-ad6c-785067fbff0d {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:57:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-96adce1a-3105-482f-9b00-95c21881de61 req-f7b79a8d-0de1-4112-a43d-db4f20b7002e service nova] Acquiring lock "90b55775-2f14-4c80-b48a-b1eed2b570dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:57:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-96adce1a-3105-482f-9b00-95c21881de61 req-f7b79a8d-0de1-4112-a43d-db4f20b7002e service nova] Lock "90b55775-2f14-4c80-b48a-b1eed2b570dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:57:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-96adce1a-3105-482f-9b00-95c21881de61 req-f7b79a8d-0de1-4112-a43d-db4f20b7002e service nova] Lock "90b55775-2f14-4c80-b48a-b1eed2b570dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:57:51 user nova-compute[72766]: DEBUG nova.compute.manager [req-96adce1a-3105-482f-9b00-95c21881de61 req-f7b79a8d-0de1-4112-a43d-db4f20b7002e service nova] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] No waiting events found dispatching network-vif-plugged-a886f590-4818-4e79-ad6c-785067fbff0d {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:57:51 user nova-compute[72766]: WARNING nova.compute.manager [req-96adce1a-3105-482f-9b00-95c21881de61 req-f7b79a8d-0de1-4112-a43d-db4f20b7002e service nova] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Received unexpected event network-vif-plugged-a886f590-4818-4e79-ad6c-785067fbff0d for instance with vm_state active and task_state None.
Aug 14 22:57:52 user nova-compute[72766]: DEBUG nova.network.neutron [req-e86d3844-4745-4d9e-9643-6371dcd6fcda req-ad319771-f711-4249-b857-ed5e924d919b service nova] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Updated VIF entry in instance network info cache for port 9a214a31-3ef2-4a37-b0fa-c27a86be068c. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:57:52 user nova-compute[72766]: DEBUG nova.network.neutron [req-e86d3844-4745-4d9e-9643-6371dcd6fcda req-ad319771-f711-4249-b857-ed5e924d919b service nova] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Updating instance_info_cache with network_info: [{"id": "9a214a31-3ef2-4a37-b0fa-c27a86be068c", "address": "fa:16:3e:bb:06:dd", "network": {"id": "411e3c7b-1261-4661-91a6-12630b932df7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-230148116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5740ddd945a1401b98aafaa1cbae8c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a214a31-3e", "ovs_interfaceid": "9a214a31-3ef2-4a37-b0fa-c27a86be068c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:57:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e86d3844-4745-4d9e-9643-6371dcd6fcda req-ad319771-f711-4249-b857-ed5e924d919b service nova] Releasing lock "refresh_cache-33e6f8aa-bb0d-478d-b7b5-3334302476fb" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:57:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:55 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:55 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:57:59 user nova-compute[72766]: DEBUG nova.compute.manager [req-d25d7867-2726-4136-b507-83c09553c9cf req-115272c0-afe2-4685-83b1-02fcb2584d1c service nova] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Received event network-changed-abead9ae-b0f3-474a-b77a-91733d6d3543 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:57:59 user nova-compute[72766]: DEBUG nova.compute.manager [req-d25d7867-2726-4136-b507-83c09553c9cf req-115272c0-afe2-4685-83b1-02fcb2584d1c service nova] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Refreshing instance network info cache due to event network-changed-abead9ae-b0f3-474a-b77a-91733d6d3543. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:57:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d25d7867-2726-4136-b507-83c09553c9cf req-115272c0-afe2-4685-83b1-02fcb2584d1c service nova] Acquiring lock "refresh_cache-a9d6011c-da14-4fcc-8e31-3063db57b2a6" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:57:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d25d7867-2726-4136-b507-83c09553c9cf req-115272c0-afe2-4685-83b1-02fcb2584d1c service nova] Acquired lock "refresh_cache-a9d6011c-da14-4fcc-8e31-3063db57b2a6" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:57:59 user nova-compute[72766]: DEBUG nova.network.neutron [req-d25d7867-2726-4136-b507-83c09553c9cf req-115272c0-afe2-4685-83b1-02fcb2584d1c service nova] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Refreshing network info cache for port abead9ae-b0f3-474a-b77a-91733d6d3543 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:57:59 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 22:57:59 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFpgxeQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:57:59 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:57:59 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:57:59 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:57:59 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:57:59 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:57:59 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:57:59 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 22:57:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:59 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 22:57:59 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mVgSjQTR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:57:59 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:57:59 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:57:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:59 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4e1ac6-3d7e-40ee-a06d-d9a850cab575]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:59 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 22:57:59 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:57:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:59 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[333d7268-73c5-40fa-87c3-414052c3feff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:59 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207] added
Aug 14 22:57:59 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:57:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:59 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb9efa5-51ed-490f-943a-c743deee78b5]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:59 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:57:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:57:59 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f55c599-3335-49c7-9c72-f9e522fa9cd3]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:57:59 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:57:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lFpgxeQP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:57:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lFpgxeQP" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e66742-a5db-4b87-8212-7726b1caaa6e]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lFpgxeQP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd476f7-e6f9-4a76-a396-07509c52881a]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8038a4-e908-4cb2-a549-d8e307ee4d35]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 22:58:00 user nova-compute[72766]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4 (non-flash)
Aug 14 22:58:00 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 22:58:00 user nova-compute[72766]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4 (non-flash)
Aug 14 22:58:00 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Acquiring lock "90b55775-2f14-4c80-b48a-b1eed2b570dc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Lock "90b55775-2f14-4c80-b48a-b1eed2b570dc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG nova.objects.instance [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Lazy-loading 'flavor' on Instance uuid 90b55775-2f14-4c80-b48a-b1eed2b570dc {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecffa86-892e-4cb4-ae91-83e8d6c4313d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207, portal: 172.16.0.220,3260]
Aug 14 22:58:00 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207, portal: 172.16.0.220,3260] successful.
Aug 14 22:58:00 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Lock "90b55775-2f14-4c80-b48a-b1eed2b570dc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a77984-911a-4c17-9c3a-3e1e8dbe2b78]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[1546932b-961d-44ac-87cc-7b64f3e13993]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 22:58:00 user nova-compute[72766]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4 (non-flash)
Aug 14 22:58:00 user nova-compute[72766]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 (non-flash)
Aug 14 22:58:00 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 22:58:00 user nova-compute[72766]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4 (non-flash)
Aug 14 22:58:00 user nova-compute[72766]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 (non-flash)
Aug 14 22:58:00 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[612d0fc7-e30a-4c1d-9944-6bbeefe3fbc2]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFpgxeQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Acquiring lock "90b55775-2f14-4c80-b48a-b1eed2b570dc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Lock "90b55775-2f14-4c80-b48a-b1eed2b570dc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:58:00 user nova-compute[72766]: INFO nova.compute.manager [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Attaching volume 3ba8a773-dabf-4b11-8758-0f643b7727a5 to /dev/vdb
Aug 14 22:58:00 user nova-compute[72766]: DEBUG nova.network.neutron [req-d25d7867-2726-4136-b507-83c09553c9cf req-115272c0-afe2-4685-83b1-02fcb2584d1c service nova] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Updated VIF entry in instance network info cache for port abead9ae-b0f3-474a-b77a-91733d6d3543. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG nova.network.neutron [req-d25d7867-2726-4136-b507-83c09553c9cf req-115272c0-afe2-4685-83b1-02fcb2584d1c service nova] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Updating instance_info_cache with network_info: [{"id": "abead9ae-b0f3-474a-b77a-91733d6d3543", "address": "fa:16:3e:c8:a4:ce", "network": {"id": "58367c0d-d2f6-441c-8a2f-310e045b9cf0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-296205787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2299692e42b74c9c85a255f80990e870", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabead9ae-b0", "ovs_interfaceid": "abead9ae-b0f3-474a-b77a-91733d6d3543", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d25d7867-2726-4136-b507-83c09553c9cf req-115272c0-afe2-4685-83b1-02fcb2584d1c service nova] Releasing lock "refresh_cache-a9d6011c-da14-4fcc-8e31-3063db57b2a6" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG os_brick.utils [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53a259c-5951-43bc-a201-87c9ab947b0d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[89844beb-5396-4e4c-bfca-9c944f7daf2b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[898c0e55-b52c-4e5d-9e29-11ef33d8c330]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[5906c1b6-fa1e-4978-a1cf-672cb0a813dd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-0cabe3f3-cb67-4380-b297-6877e459c1c9 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Acquiring lock "0850bb6c-6e3e-4007-8478-8eba53089158" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-0cabe3f3-cb67-4380-b297-6877e459c1c9 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lock "0850bb6c-6e3e-4007-8478-8eba53089158" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:58:00 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 22:58:00 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c1ff8f-8bb8-4ef6-9ebb-29464dd52b21]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG os_brick.utils [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Updating existing volume attachment record: 6a4d3c29-fff5-48db-94a1-710bfab69d06 {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 22:58:00 user nova-compute[72766]: INFO nova.compute.manager [None req-0cabe3f3-cb67-4380-b297-6877e459c1c9 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Detaching volume 03b69d23-ff98-4ffd-8dd3-76567061dbf4
Aug 14 22:58:00 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:00 user nova-compute[72766]: INFO nova.virt.block_device [None req-0cabe3f3-cb67-4380-b297-6877e459c1c9 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Attempting to driver detach volume 03b69d23-ff98-4ffd-8dd3-76567061dbf4 from mountpoint /dev/vdb
Aug 14 22:58:00 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-0cabe3f3-cb67-4380-b297-6877e459c1c9 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Attempting to detach device vdb from instance 0850bb6c-6e3e-4007-8478-8eba53089158 from the persistent domain config. {{(pid=72766) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-0cabe3f3-cb67-4380-b297-6877e459c1c9 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 22:58:00 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:58:00 user nova-compute[72766]:   <source dev="/dev/sdc"/>
Aug 14 22:58:00 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:58:00 user nova-compute[72766]:   <serial>03b69d23-ff98-4ffd-8dd3-76567061dbf4</serial>
Aug 14 22:58:00 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 22:58:00 user nova-compute[72766]: </disk>
Aug 14 22:58:00 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 22:58:00 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-0cabe3f3-cb67-4380-b297-6877e459c1c9 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Successfully detached device vdb from instance 0850bb6c-6e3e-4007-8478-8eba53089158 from the persistent domain config.
Aug 14 22:58:00 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-0cabe3f3-cb67-4380-b297-6877e459c1c9 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0850bb6c-6e3e-4007-8478-8eba53089158 from the live domain config. {{(pid=72766) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-0cabe3f3-cb67-4380-b297-6877e459c1c9 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 22:58:00 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:58:00 user nova-compute[72766]:   <source dev="/dev/sdc"/>
Aug 14 22:58:00 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:58:00 user nova-compute[72766]:   <serial>03b69d23-ff98-4ffd-8dd3-76567061dbf4</serial>
Aug 14 22:58:00 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 22:58:00 user nova-compute[72766]: </disk>
Aug 14 22:58:00 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 22:58:00 user nova-compute[72766]: INFO nova.compute.manager [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Rebuilding instance
Aug 14 22:58:00 user nova-compute[72766]: DEBUG nova.objects.instance [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Lazy-loading 'trusted_certs' on Instance uuid a9d6011c-da14-4fcc-8e31-3063db57b2a6 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:58:00 user nova-compute[72766]: DEBUG nova.compute.manager [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG nova.objects.instance [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Lazy-loading 'pci_requests' on Instance uuid a9d6011c-da14-4fcc-8e31-3063db57b2a6 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG nova.objects.instance [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Lazy-loading 'pci_devices' on Instance uuid a9d6011c-da14-4fcc-8e31-3063db57b2a6 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG nova.objects.instance [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Lazy-loading 'resources' on Instance uuid a9d6011c-da14-4fcc-8e31-3063db57b2a6 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG nova.objects.instance [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Lazy-loading 'migration_context' on Instance uuid a9d6011c-da14-4fcc-8e31-3063db57b2a6 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG nova.objects.instance [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72766) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Received event <DeviceRemovedEvent: 1692053881.1397753, 0850bb6c-6e3e-4007-8478-8eba53089158 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72766) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-0cabe3f3-cb67-4380-b297-6877e459c1c9 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0850bb6c-6e3e-4007-8478-8eba53089158 {{(pid=72766) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 22:58:01 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-0cabe3f3-cb67-4380-b297-6877e459c1c9 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Successfully detached device vdb from instance 0850bb6c-6e3e-4007-8478-8eba53089158 from the live domain config.
Aug 14 22:58:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cabe3f3-cb67-4380-b297-6877e459c1c9 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cabe3f3-cb67-4380-b297-6877e459c1c9 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GFsepMXc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:58:01 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-0cabe3f3-cb67-4380-b297-6877e459c1c9 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:58:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-0cabe3f3-cb67-4380-b297-6877e459c1c9 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23363396131333362', 'path': '/dev/sdd'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363396131333362', 'path': '/dev/sdd'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.328s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:58:01 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:58:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:58:01 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 22:58:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG nova.objects.instance [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Lazy-loading 'flavor' on Instance uuid b55141bc-d426-4d35-8ae5-269ece19a793 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad09a1b2-650f-4bbf-b4a0-409788d896ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 22:58:01 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d97548b-77e0-425f-800f-6aa56e1c2e33]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e] added
Aug 14 22:58:01 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a59164-6458-473b-9ea7-c1141a334302]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] attach device xml: <disk type="block" device="disk">
Aug 14 22:58:01 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:58:01 user nova-compute[72766]:   <source dev="/dev/sdd"/>
Aug 14 22:58:01 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:58:01 user nova-compute[72766]:   <serial>95b6f500-e1ac-418f-a438-72230173c207</serial>
Aug 14 22:58:01 user nova-compute[72766]: </disk>
Aug 14 22:58:01 user nova-compute[72766]:  {{(pid=72766) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f46991-0987-4785-bb48-e7c3a12b6c92]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mVgSjQTR {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mVgSjQTR" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc39ec2-61a2-4f84-a88e-daa410fc8a5e]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mVgSjQTR'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a946b75-4331-45b7-80ee-58ff6bc77f25]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[5055c7d2-db8e-4eb0-8450-1b7adf376940]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 22:58:01 user nova-compute[72766]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4 (non-flash)
Aug 14 22:58:01 user nova-compute[72766]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 (non-flash)
Aug 14 22:58:01 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 22:58:01 user nova-compute[72766]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4 (non-flash)
Aug 14 22:58:01 user nova-compute[72766]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 (non-flash)
Aug 14 22:58:01 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG nova.compute.manager [req-a80e3754-44ef-4024-b21e-0bcd79c55c45 req-4acd48a3-2193-44ec-be9f-9b729f54e4bf service nova] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Received event network-vif-unplugged-abead9ae-b0f3-474a-b77a-91733d6d3543 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a80e3754-44ef-4024-b21e-0bcd79c55c45 req-4acd48a3-2193-44ec-be9f-9b729f54e4bf service nova] Acquiring lock "a9d6011c-da14-4fcc-8e31-3063db57b2a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a80e3754-44ef-4024-b21e-0bcd79c55c45 req-4acd48a3-2193-44ec-be9f-9b729f54e4bf service nova] Lock "a9d6011c-da14-4fcc-8e31-3063db57b2a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a80e3754-44ef-4024-b21e-0bcd79c55c45 req-4acd48a3-2193-44ec-be9f-9b729f54e4bf service nova] Lock "a9d6011c-da14-4fcc-8e31-3063db57b2a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG nova.compute.manager [req-a80e3754-44ef-4024-b21e-0bcd79c55c45 req-4acd48a3-2193-44ec-be9f-9b729f54e4bf service nova] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] No waiting events found dispatching network-vif-unplugged-abead9ae-b0f3-474a-b77a-91733d6d3543 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:58:01 user nova-compute[72766]: WARNING nova.compute.manager [req-a80e3754-44ef-4024-b21e-0bcd79c55c45 req-4acd48a3-2193-44ec-be9f-9b729f54e4bf service nova] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Received unexpected event network-vif-unplugged-abead9ae-b0f3-474a-b77a-91733d6d3543 for instance with vm_state active and task_state rebuilding.
Aug 14 22:58:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b768d6-7e42-46d0-a07d-8685120917c6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e, portal: 172.16.0.220,3260]
Aug 14 22:58:01 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e, portal: 172.16.0.220,3260] successful.
Aug 14 22:58:01 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fc2a78-9765-45fd-94ad-65ba3ee77fe1]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[824533fb-83b0-4cd0-8b65-bb339d4a6b9e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 22:58:01 user nova-compute[72766]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4 (non-flash)
Aug 14 22:58:01 user nova-compute[72766]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 (non-flash)
Aug 14 22:58:01 user nova-compute[72766]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)
Aug 14 22:58:01 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 22:58:01 user nova-compute[72766]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4 (non-flash)
Aug 14 22:58:01 user nova-compute[72766]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 (non-flash)
Aug 14 22:58:01 user nova-compute[72766]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)
Aug 14 22:58:01 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.035s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b81dfad-fc0a-4b0c-82a7-e8d2169b968d]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mVgSjQTR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:58:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] No VIF found with MAC fa:16:3e:b5:ed:a3, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:58:02 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Instance destroyed successfully.
Aug 14 22:58:02 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Instance destroyed successfully.
Aug 14 22:58:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1337014418',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-273402320',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPaXy9hxXbMdshWzbQLXVvz7nDESavIOLXia9W/DDo7wSvfhX1RXq42V2N0aLa9Nl7IVLmCAYxoggrECsnBwocK7ffwayiXoTZ4mdKpIHRx8EnNL76GFfNmkvMKW2r7fg==',key_name='tempest-keypair-855485889',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:56:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2299692e42b74c9c85a255f80990e870',ramdisk_id='',reservation_id='r-f401gegj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1913842238',owner_user_name='tempest-ServerActionsV293TestJSON-1913842238-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:58:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e0c74f355e34ec6b175e136f6401b20',uuid=a9d6011c-da14-4fcc-8e31-3063db57b2a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "abead9ae-b0f3-474a-b77a-91733d6d3543", "address": "fa:16:3e:c8:a4:ce", "network": {"id": "58367c0d-d2f6-441c-8a2f-310e045b9cf0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-296205787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2299692e42b74c9c85a255f80990e870", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabead9ae-b0", "ovs_interfaceid": "abead9ae-b0f3-474a-b77a-91733d6d3543", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Converting VIF {"id": "abead9ae-b0f3-474a-b77a-91733d6d3543", "address": "fa:16:3e:c8:a4:ce", "network": {"id": "58367c0d-d2f6-441c-8a2f-310e045b9cf0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-296205787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2299692e42b74c9c85a255f80990e870", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabead9ae-b0", "ovs_interfaceid": "abead9ae-b0f3-474a-b77a-91733d6d3543", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:a4:ce,bridge_name='br-int',has_traffic_filtering=True,id=abead9ae-b0f3-474a-b77a-91733d6d3543,network=Network(58367c0d-d2f6-441c-8a2f-310e045b9cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabead9ae-b0') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG os_vif [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:a4:ce,bridge_name='br-int',has_traffic_filtering=True,id=abead9ae-b0f3-474a-b77a-91733d6d3543,network=Network(58367c0d-d2f6-441c-8a2f-310e045b9cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabead9ae-b0') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapabead9ae-b0, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:02 user nova-compute[72766]: INFO os_vif [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:a4:ce,bridge_name='br-int',has_traffic_filtering=True,id=abead9ae-b0f3-474a-b77a-91733d6d3543,network=Network(58367c0d-d2f6-441c-8a2f-310e045b9cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabead9ae-b0')
Aug 14 22:58:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wjbIlVOW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:58:02 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 22:58:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-2d731aab-9690-496f-b7a6-cf8f6ed99c3e tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Lock "b55141bc-d426-4d35-8ae5-269ece19a793" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.797s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.443s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] <== connect_volume: return (2771ms) {'type': 'block', 'scsi_wwn': '26133383935666630', 'path': '/dev/sde'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133383935666630', 'path': '/dev/sde'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-0cabe3f3-cb67-4380-b297-6877e459c1c9 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.493s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cabe3f3-cb67-4380-b297-6877e459c1c9 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG nova.objects.instance [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Lazy-loading 'flavor' on Instance uuid 33e6f8aa-bb0d-478d-b7b5-3334302476fb {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[376ee300-03d5-4235-b8f8-2cb7632979d2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 22:58:02 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:58:02 user nova-compute[72766]:   <source dev="/dev/sde"/>
Aug 14 22:58:02 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:58:02 user nova-compute[72766]:   <serial>37f3ab46-4f0d-408f-a4e6-d634bc8e498e</serial>
Aug 14 22:58:02 user nova-compute[72766]: </disk>
Aug 14 22:58:02 user nova-compute[72766]:  {{(pid=72766) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b36bfc6-56c5-4820-9b19-681e74b607ff]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cabe3f3-cb67-4380-b297-6877e459c1c9 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 22:58:02 user nova-compute[72766]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4 (non-flash)
Aug 14 22:58:02 user nova-compute[72766]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 (non-flash)
Aug 14 22:58:02 user nova-compute[72766]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)
Aug 14 22:58:02 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cabe3f3-cb67-4380-b297-6877e459c1c9 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 22:58:02 user nova-compute[72766]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4 (non-flash)
Aug 14 22:58:02 user nova-compute[72766]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 (non-flash)
Aug 14 22:58:02 user nova-compute[72766]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)
Aug 14 22:58:02 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cabe3f3-cb67-4380-b297-6877e459c1c9 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff16c13a5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4'): ({'sdc'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-0cabe3f3-cb67-4380-b297-6877e459c1c9 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Removing single pathed devices sdc {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6cb22ef-46eb-46e4-8ea6-e0017675aea5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1fe2a7-60d7-4a88-bb00-3738bf468a1b]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-0cabe3f3-cb67-4380-b297-6877e459c1c9 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Flushing IO for device /dev/sdc {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[df399af1-ccaf-4c81-b135-e683708a1a8f]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-0cabe3f3-cb67-4380-b297-6877e459c1c9 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a968d9-f78b-48c7-bb5a-4488f77f6fda]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-0cabe3f3-cb67-4380-b297-6877e459c1c9 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-0cabe3f3-cb67-4380-b297-6877e459c1c9 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] SCSI volumes sdc have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cabe3f3-cb67-4380-b297-6877e459c1c9 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d0e784-6f5e-41ef-9aef-436e2bff6d60]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cabe3f3-cb67-4380-b297-6877e459c1c9 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4 -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0b5cd7-08b4-40cd-b9a6-41607c4c1cba]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cabe3f3-cb67-4380-b297-6877e459c1c9 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4, portal: 172.16.0.220,3260]
Aug 14 22:58:02 user nova-compute[72766]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4, portal: 172.16.0.220,3260] successful.
Aug 14 22:58:02 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4 -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03b69d23-ff98-4ffd-8dd3-76567061dbf4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e1c743-b27b-4f08-adce-a53c57738edf]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cabe3f3-cb67-4380-b297-6877e459c1c9 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-0cabe3f3-cb67-4380-b297-6877e459c1c9 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cabe3f3-cb67-4380-b297-6877e459c1c9 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] <== disconnect_volume: return (1786ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cabe3f3-cb67-4380-b297-6877e459c1c9 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.397s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2881c24-ec1c-419d-88a9-1bb31e1b42b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c54fac-fab9-4e42-86fb-b099b75ee0b7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 22:58:03 user nova-compute[72766]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 (non-flash)
Aug 14 22:58:03 user nova-compute[72766]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)
Aug 14 22:58:03 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 22:58:03 user nova-compute[72766]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 (non-flash)
Aug 14 22:58:03 user nova-compute[72766]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)
Aug 14 22:58:03 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff16c1384c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9'): ({'sdb'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Removing single pathed devices sdb {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8952e36-d53e-4e70-b22b-3772f4a9259c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[49522d0b-9614-477e-944f-d773f1077cb2]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Flushing IO for device /dev/sdb {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3106401-1088-42f5-a733-8c5b3c0fbc7d]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a8bbf6-f4a7-45a5-b0a9-0757ba46b455]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] SCSI volumes sdb have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee478b7c-13c8-474f-aa60-cf3dcfe66a9d]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] No VIF found with MAC fa:16:3e:bb:06:dd, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e20aa5f-d191-4d9d-a959-a9ef45bba966]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9, portal: 172.16.0.220,3260]
Aug 14 22:58:03 user nova-compute[72766]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9, portal: 172.16.0.220,3260] successful.
Aug 14 22:58:03 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0752fe4-ab31-4fe9-8d3c-d82d3ebe0669]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] <== disconnect_volume: return (677ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 22:58:03 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Deleting instance files /opt/stack/data/nova/instances/a9d6011c-da14-4fcc-8e31-3063db57b2a6_del
Aug 14 22:58:03 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Deletion of /opt/stack/data/nova/instances/a9d6011c-da14-4fcc-8e31-3063db57b2a6_del complete
Aug 14 22:58:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG nova.compute.manager [req-d1c02fdd-1e0c-455b-8783-1702a3eff955 req-b55db766-f965-4242-b00e-4281cdc85142 service nova] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Received event network-vif-plugged-abead9ae-b0f3-474a-b77a-91733d6d3543 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d1c02fdd-1e0c-455b-8783-1702a3eff955 req-b55db766-f965-4242-b00e-4281cdc85142 service nova] Acquiring lock "a9d6011c-da14-4fcc-8e31-3063db57b2a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d1c02fdd-1e0c-455b-8783-1702a3eff955 req-b55db766-f965-4242-b00e-4281cdc85142 service nova] Lock "a9d6011c-da14-4fcc-8e31-3063db57b2a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d1c02fdd-1e0c-455b-8783-1702a3eff955 req-b55db766-f965-4242-b00e-4281cdc85142 service nova] Lock "a9d6011c-da14-4fcc-8e31-3063db57b2a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG nova.compute.manager [req-d1c02fdd-1e0c-455b-8783-1702a3eff955 req-b55db766-f965-4242-b00e-4281cdc85142 service nova] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] No waiting events found dispatching network-vif-plugged-abead9ae-b0f3-474a-b77a-91733d6d3543 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:58:03 user nova-compute[72766]: WARNING nova.compute.manager [req-d1c02fdd-1e0c-455b-8783-1702a3eff955 req-b55db766-f965-4242-b00e-4281cdc85142 service nova] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Received unexpected event network-vif-plugged-abead9ae-b0f3-474a-b77a-91733d6d3543 for instance with vm_state active and task_state rebuilding.
Aug 14 22:58:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG nova.objects.instance [None req-0cabe3f3-cb67-4380-b297-6877e459c1c9 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lazy-loading 'flavor' on Instance uuid 0850bb6c-6e3e-4007-8478-8eba53089158 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-0cabe3f3-cb67-4380-b297-6877e459c1c9 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lock "0850bb6c-6e3e-4007-8478-8eba53089158" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.280s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:58:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-9d7d9322-effc-4f58-9bc8-09076d723f4c tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Lock "33e6f8aa-bb0d-478d-b7b5-3334302476fb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.822s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:58:04 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance a9d6011c-da14-4fcc-8e31-3063db57b2a6 could not be found.
Aug 14 22:58:04 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f707f54d-3b3d-411c-9ffa-55b69dac3c0f tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] volume_snapshot_create: create_info: {'snapshot_id': '150735ad-166d-45cf-b86b-e1b68750e81e', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=72766) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wjbIlVOW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:58:04 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 22:58:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f707f54d-3b3d-411c-9ffa-55b69dac3c0f tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] snap xml: <domainsnapshot>
Aug 14 22:58:04 user nova-compute[72766]:   <disks>
Aug 14 22:58:04 user nova-compute[72766]:     <disk name="/dev/sdd" snapshot="external" type="file">
Aug 14 22:58:04 user nova-compute[72766]:       <source file="/dev/new_file"/>
Aug 14 22:58:04 user nova-compute[72766]:     </disk>
Aug 14 22:58:04 user nova-compute[72766]:     <disk name="vda" snapshot="no"/>
Aug 14 22:58:04 user nova-compute[72766]:   </disks>
Aug 14 22:58:04 user nova-compute[72766]: </domainsnapshot>
Aug 14 22:58:04 user nova-compute[72766]:  {{(pid=72766) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG nova.objects.instance [None req-f707f54d-3b3d-411c-9ffa-55b69dac3c0f tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Lazy-loading 'system_metadata' on Instance uuid b55141bc-d426-4d35-8ae5-269ece19a793 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a284f358-d301-4434-b5b1-8ef9e9340972]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[374e9116-595a-432d-b2cd-8dedb2b08e5a]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 (non-flash)
Aug 14 22:58:04 user nova-compute[72766]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)
Aug 14 22:58:04 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 (non-flash)
Aug 14 22:58:04 user nova-compute[72766]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)
Aug 14 22:58:04 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff1741cc940>, {}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Disconnecting from: [] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.050s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] <== disconnect_volume: return (51ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6ab20f56-b540-491a-b3c5-a4b06dfdad90 tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] volume_snapshot_delete: delete_info: {'volume_id': '95b6f500-e1ac-418f-a438-72230173c207'} {{(pid=72766) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [None req-6ab20f56-b540-491a-b3c5-a4b06dfdad90 tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Traceback (most recent call last):
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793]     if delete_info['type'] != 'qcow2':
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793] KeyError: 'type'
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793] 
Aug 14 22:58:04 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-f707f54d-3b3d-411c-9ffa-55b69dac3c0f tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [None req-f707f54d-3b3d-411c-9ffa-55b69dac3c0f tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Traceback (most recent call last):
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793]     rv = execute(f, *args, **kwargs)
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793]     six.reraise(c, e, tb)
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793]     raise value
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793]     rv = meth(*args, **kwargs)
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793] 
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [None req-f707f54d-3b3d-411c-9ffa-55b69dac3c0f tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Traceback (most recent call last):
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793]     self._volume_snapshot_create(context, instance, guest,
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793]     rv = execute(f, *args, **kwargs)
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793]     six.reraise(c, e, tb)
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793]     raise value
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793]     rv = meth(*args, **kwargs)
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [instance: b55141bc-d426-4d35-8ae5-269ece19a793] 
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [None req-6ab20f56-b540-491a-b3c5-a4b06dfdad90 tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver 
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver 
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-adf28831-3b9b-4bbf-9932-f756b093132e)
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver 
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver 
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver 
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server [None req-6ab20f56-b540-491a-b3c5-a4b06dfdad90 tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Exception during message handling: KeyError: 'type'
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server 
Aug 14 22:58:04 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aNjOscFq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:58:04 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:58:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:58:04 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:58:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:58:04 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 22:58:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9 -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver [None req-f707f54d-3b3d-411c-9ffa-55b69dac3c0f tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 150735ad-166d-45cf-b86b-e1b68750e81e could not be found.
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     raise value
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver 
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver 
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 150735ad-166d-45cf-b86b-e1b68750e81e could not be found. (HTTP 404) (Request-ID: req-1e67065b-6fb3-4542-bd7b-5d341f5d2871)
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver 
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver 
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 150735ad-166d-45cf-b86b-e1b68750e81e could not be found.
Aug 14 22:58:04 user nova-compute[72766]: ERROR nova.virt.libvirt.driver 
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server [None req-f707f54d-3b3d-411c-9ffa-55b69dac3c0f tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     raise value
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 22:58:04 user nova-compute[72766]: ERROR oslo_messaging.rpc.server 
Aug 14 22:58:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e2c4b4-f2ab-4b8f-9dff-9a25c8b7197d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 22:58:04 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9 -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc77951-6eae-4043-86c9-b9f60b7fd719]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9] added
Aug 14 22:58:04 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dea566c-1ce2-40ee-a2a3-06750839675a]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[485ced0f-4123-46c4-aae9-c1f950f6422e]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aNjOscFq {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aNjOscFq" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57bbfbe-b5b0-45fb-b7df-784103ebc863]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aNjOscFq'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[1394912d-b195-4078-9314-cad6bbe677bf]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[262f5718-6d4b-44f1-9b1d-c4ba5304df0c]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 (non-flash)
Aug 14 22:58:04 user nova-compute[72766]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)
Aug 14 22:58:04 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 (non-flash)
Aug 14 22:58:04 user nova-compute[72766]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)
Aug 14 22:58:04 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9 -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[58cacd92-ee6a-4d38-b5ba-6b8a70065a8e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9, portal: 172.16.0.220,3260]
Aug 14 22:58:04 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9, portal: 172.16.0.220,3260] successful.
Aug 14 22:58:04 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b9c7ae-1f1c-449f-b51a-de3869c8e732]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-03b3ae71-d088-4e8f-a6c8-f1f8cff94f78 tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Acquiring lock "b55141bc-d426-4d35-8ae5-269ece19a793" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-03b3ae71-d088-4e8f-a6c8-f1f8cff94f78 tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Lock "b55141bc-d426-4d35-8ae5-269ece19a793" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fdb5843-c8ec-45b4-a550-c3180d2190e0]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 (non-flash)
Aug 14 22:58:04 user nova-compute[72766]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)
Aug 14 22:58:04 user nova-compute[72766]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9 (non-flash)
Aug 14 22:58:04 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 (non-flash)
Aug 14 22:58:04 user nova-compute[72766]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)
Aug 14 22:58:04 user nova-compute[72766]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9 (non-flash)
Aug 14 22:58:04 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] HCTL ('33', '-', '-', 0) found on session 7 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:04 user nova-compute[72766]: INFO nova.compute.manager [None req-03b3ae71-d088-4e8f-a6c8-f1f8cff94f78 tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Detaching volume 95b6f500-e1ac-418f-a438-72230173c207
Aug 14 22:58:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c50f9a-48e9-452d-b41f-91549111fe3b]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:04 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Searching for a device in session 7 and hctl ['33', '*', '*', 0] yield: None {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:58:05 user nova-compute[72766]: INFO nova.virt.block_device [None req-03b3ae71-d088-4e8f-a6c8-f1f8cff94f78 tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Attempting to driver detach volume 95b6f500-e1ac-418f-a438-72230173c207 from mountpoint /dev/vdb
Aug 14 22:58:05 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-03b3ae71-d088-4e8f-a6c8-f1f8cff94f78 tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Attempting to detach device vdb from instance b55141bc-d426-4d35-8ae5-269ece19a793 from the persistent domain config. {{(pid=72766) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 22:58:05 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-03b3ae71-d088-4e8f-a6c8-f1f8cff94f78 tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] detach device xml: <disk type="block" device="disk">
Aug 14 22:58:05 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:58:05 user nova-compute[72766]:   <source dev="/dev/sdd"/>
Aug 14 22:58:05 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:58:05 user nova-compute[72766]:   <serial>95b6f500-e1ac-418f-a438-72230173c207</serial>
Aug 14 22:58:05 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 22:58:05 user nova-compute[72766]: </disk>
Aug 14 22:58:05 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 22:58:05 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-03b3ae71-d088-4e8f-a6c8-f1f8cff94f78 tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Successfully detached device vdb from instance b55141bc-d426-4d35-8ae5-269ece19a793 from the persistent domain config.
Aug 14 22:58:05 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-03b3ae71-d088-4e8f-a6c8-f1f8cff94f78 tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b55141bc-d426-4d35-8ae5-269ece19a793 from the live domain config. {{(pid=72766) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 22:58:05 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-03b3ae71-d088-4e8f-a6c8-f1f8cff94f78 tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] detach device xml: <disk type="block" device="disk">
Aug 14 22:58:05 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:58:05 user nova-compute[72766]:   <source dev="/dev/sdd"/>
Aug 14 22:58:05 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:58:05 user nova-compute[72766]:   <serial>95b6f500-e1ac-418f-a438-72230173c207</serial>
Aug 14 22:58:05 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 22:58:05 user nova-compute[72766]: </disk>
Aug 14 22:58:05 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 22:58:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Acquiring lock "33e6f8aa-bb0d-478d-b7b5-3334302476fb" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:58:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Lock "33e6f8aa-bb0d-478d-b7b5-3334302476fb" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:58:05 user nova-compute[72766]: DEBUG os_brick.utils [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:58:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:05 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b772859e-a6b8-4957-bca0-b5061034e6c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:05 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f6a93d-a652-4014-a199-fc158b8387ee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:05 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2d5d45-005b-42dc-ab89-23b2a1a2b268]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:05 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[281c24c0-d2cd-4da3-a274-81ce4c411626]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:58:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 22:58:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:05 user nova-compute[72766]: DEBUG nova.compute.manager [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Preparing to wait for external event volume-reimaged-bdfde062-9b2c-45a4-be3a-eccc18e9cef9 {{(pid=72766) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 14 22:58:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Acquiring lock "a9d6011c-da14-4fcc-8e31-3063db57b2a6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:58:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Lock "a9d6011c-da14-4fcc-8e31-3063db57b2a6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:58:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Lock "a9d6011c-da14-4fcc-8e31-3063db57b2a6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:58:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:58:05 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 22:58:05 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff27e32-b266-42f4-ac5c-d7a7ead10983]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 22:58:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 22:58:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 22:58:05 user nova-compute[72766]: DEBUG os_brick.utils [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:58:05 user nova-compute[72766]: INFO nova.compute.manager [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Swapping volume 37f3ab46-4f0d-408f-a4e6-d634bc8e498e for 8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf
Aug 14 22:58:05 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Received event <DeviceRemovedEvent: 1692053885.6282496, b55141bc-d426-4d35-8ae5-269ece19a793 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72766) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 22:58:05 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-03b3ae71-d088-4e8f-a6c8-f1f8cff94f78 tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b55141bc-d426-4d35-8ae5-269ece19a793 {{(pid=72766) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 22:58:05 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-03b3ae71-d088-4e8f-a6c8-f1f8cff94f78 tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Successfully detached device vdb from instance b55141bc-d426-4d35-8ae5-269ece19a793 from the live domain config.
Aug 14 22:58:05 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03b3ae71-d088-4e8f-a6c8-f1f8cff94f78 tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 22:58:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b3ae71-d088-4e8f-a6c8-f1f8cff94f78 tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFpgxeQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:58:05 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-03b3ae71-d088-4e8f-a6c8-f1f8cff94f78 tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:58:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-03b3ae71-d088-4e8f-a6c8-f1f8cff94f78 tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:58:05 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Searching for a device in session 7 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:58:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aNjOscFq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 22:58:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:58:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '23430643132326134', 'path': '/dev/sdb'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:58:05 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430643132326134', 'path': '/dev/sdb'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 22:58:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-03b3ae71-d088-4e8f-a6c8-f1f8cff94f78 tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.319s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:58:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b3ae71-d088-4e8f-a6c8-f1f8cff94f78 tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 22:58:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:05 user nova-compute[72766]: DEBUG nova.objects.instance [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Lazy-loading 'flavor' on Instance uuid 40cd301a-97f2-4f02-b091-f5a2bb1cd016 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:58:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:05 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[32063769-8728-4037-aa20-7fc5e84255e9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:06 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 22:58:06 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:58:06 user nova-compute[72766]:   <source dev="/dev/sdb"/>
Aug 14 22:58:06 user nova-compute[72766]:   <target dev="sdc" bus="scsi"/>
Aug 14 22:58:06 user nova-compute[72766]:   <serial>3484f6dd-f78e-43d5-aa74-c668e8181de9</serial>
Aug 14 22:58:06 user nova-compute[72766]:   <address type="drive" controller="0" unit="2"/>
Aug 14 22:58:06 user nova-compute[72766]: </disk>
Aug 14 22:58:06 user nova-compute[72766]:  {{(pid=72766) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 22:58:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:06 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0dfb45-4fbd-4f6c-b551-641bd1667059]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:06 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b3ae71-d088-4e8f-a6c8-f1f8cff94f78 tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 (non-flash)
Aug 14 22:58:06 user nova-compute[72766]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)
Aug 14 22:58:06 user nova-compute[72766]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9 (non-flash)
Aug 14 22:58:06 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:58:06 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b3ae71-d088-4e8f-a6c8-f1f8cff94f78 tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 (non-flash)
Aug 14 22:58:06 user nova-compute[72766]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)
Aug 14 22:58:06 user nova-compute[72766]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9 (non-flash)
Aug 14 22:58:06 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:58:06 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b3ae71-d088-4e8f-a6c8-f1f8cff94f78 tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff16c350e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207'): ({'sdd'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 22:58:06 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-03b3ae71-d088-4e8f-a6c8-f1f8cff94f78 tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Removing single pathed devices sdd {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 22:58:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:06 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfc1d6a-ea55-46b7-8440-025a802f5039]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:06 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[897a1f2b-26e2-4485-ac08-cf4c636d07e2]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:06 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-03b3ae71-d088-4e8f-a6c8-f1f8cff94f78 tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Flushing IO for device /dev/sdd {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 22:58:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:06 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[9976c0a9-8dd9-4c29-89dd-301badbed856]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:06 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-03b3ae71-d088-4e8f-a6c8-f1f8cff94f78 tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 22:58:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:06 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[28020f9c-1877-4fc7-8bd8-a691a70c8662]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:06 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-03b3ae71-d088-4e8f-a6c8-f1f8cff94f78 tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 22:58:06 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-03b3ae71-d088-4e8f-a6c8-f1f8cff94f78 tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] SCSI volumes sdd have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 22:58:06 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b3ae71-d088-4e8f-a6c8-f1f8cff94f78 tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 22:58:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:06 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcd6369-d1a1-431e-ab8c-3506de27922f]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:06 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b3ae71-d088-4e8f-a6c8-f1f8cff94f78 tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:06 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56573c8-4bd7-42ae-be40-36d6f62c134e]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:06 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b3ae71-d088-4e8f-a6c8-f1f8cff94f78 tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207, portal: 172.16.0.220,3260]
Aug 14 22:58:06 user nova-compute[72766]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207, portal: 172.16.0.220,3260] successful.
Aug 14 22:58:06 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95b6f500-e1ac-418f-a438-72230173c207 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:06 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49b73d6-33e6-4514-b102-0150ea93165b]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:06 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b3ae71-d088-4e8f-a6c8-f1f8cff94f78 tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:06 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-03b3ae71-d088-4e8f-a6c8-f1f8cff94f78 tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:58:06 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b3ae71-d088-4e8f-a6c8-f1f8cff94f78 tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] <== disconnect_volume: return (674ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:58:06 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03b3ae71-d088-4e8f-a6c8-f1f8cff94f78 tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 22:58:06 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] No BDM found with device name sda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:58:06 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:58:06 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] No BDM found with device name sdc, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:58:06 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] No VIF found with MAC fa:16:3e:97:20:81, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:58:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:07 user nova-compute[72766]: DEBUG nova.objects.instance [None req-03b3ae71-d088-4e8f-a6c8-f1f8cff94f78 tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Lazy-loading 'flavor' on Instance uuid b55141bc-d426-4d35-8ae5-269ece19a793 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:58:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-15295635-f4c7-4d87-ba1b-fd9ceee20726 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Lock "40cd301a-97f2-4f02-b091-f5a2bb1cd016" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.956s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:58:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-03b3ae71-d088-4e8f-a6c8-f1f8cff94f78 tempest-VolumesAssistedSnapshotsTest-1462827120 tempest-VolumesAssistedSnapshotsTest-1462827120-project-admin] Lock "b55141bc-d426-4d35-8ae5-269ece19a793" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.416s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:58:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-83f5cd8f-9fd1-46c0-b2f6-d2d5ee6a68bf tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Acquiring lock "40cd301a-97f2-4f02-b091-f5a2bb1cd016" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-83f5cd8f-9fd1-46c0-b2f6-d2d5ee6a68bf tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Lock "40cd301a-97f2-4f02-b091-f5a2bb1cd016" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:58:08 user nova-compute[72766]: INFO nova.compute.manager [None req-83f5cd8f-9fd1-46c0-b2f6-d2d5ee6a68bf tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Detaching volume 3484f6dd-f78e-43d5-aa74-c668e8181de9
Aug 14 22:58:08 user nova-compute[72766]: INFO nova.virt.block_device [None req-83f5cd8f-9fd1-46c0-b2f6-d2d5ee6a68bf tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Attempting to driver detach volume 3484f6dd-f78e-43d5-aa74-c668e8181de9 from mountpoint /dev/sdc
Aug 14 22:58:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-83f5cd8f-9fd1-46c0-b2f6-d2d5ee6a68bf tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Attempting to detach device sdc from instance 40cd301a-97f2-4f02-b091-f5a2bb1cd016 from the persistent domain config. {{(pid=72766) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-83f5cd8f-9fd1-46c0-b2f6-d2d5ee6a68bf tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 22:58:08 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:58:08 user nova-compute[72766]:   <source dev="/dev/sdb"/>
Aug 14 22:58:08 user nova-compute[72766]:   <target dev="sdc" bus="scsi"/>
Aug 14 22:58:08 user nova-compute[72766]:   <serial>3484f6dd-f78e-43d5-aa74-c668e8181de9</serial>
Aug 14 22:58:08 user nova-compute[72766]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 14 22:58:08 user nova-compute[72766]: </disk>
Aug 14 22:58:08 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 22:58:08 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-83f5cd8f-9fd1-46c0-b2f6-d2d5ee6a68bf tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Successfully detached device sdc from instance 40cd301a-97f2-4f02-b091-f5a2bb1cd016 from the persistent domain config.
Aug 14 22:58:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-83f5cd8f-9fd1-46c0-b2f6-d2d5ee6a68bf tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 40cd301a-97f2-4f02-b091-f5a2bb1cd016 from the live domain config. {{(pid=72766) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-83f5cd8f-9fd1-46c0-b2f6-d2d5ee6a68bf tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 22:58:08 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:58:08 user nova-compute[72766]:   <source dev="/dev/sdb"/>
Aug 14 22:58:08 user nova-compute[72766]:   <target dev="sdc" bus="scsi"/>
Aug 14 22:58:08 user nova-compute[72766]:   <serial>3484f6dd-f78e-43d5-aa74-c668e8181de9</serial>
Aug 14 22:58:08 user nova-compute[72766]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 14 22:58:08 user nova-compute[72766]: </disk>
Aug 14 22:58:08 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Received event <DeviceRemovedEvent: 1692053888.6054595, 40cd301a-97f2-4f02-b091-f5a2bb1cd016 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72766) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-83f5cd8f-9fd1-46c0-b2f6-d2d5ee6a68bf tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 40cd301a-97f2-4f02-b091-f5a2bb1cd016 {{(pid=72766) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 22:58:08 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-83f5cd8f-9fd1-46c0-b2f6-d2d5ee6a68bf tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Successfully detached device sdc from instance 40cd301a-97f2-4f02-b091-f5a2bb1cd016 from the live domain config.
Aug 14 22:58:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83f5cd8f-9fd1-46c0-b2f6-d2d5ee6a68bf tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f5cd8f-9fd1-46c0-b2f6-d2d5ee6a68bf tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aNjOscFq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:58:08 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-83f5cd8f-9fd1-46c0-b2f6-d2d5ee6a68bf tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:58:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-83f5cd8f-9fd1-46c0-b2f6-d2d5ee6a68bf tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-83f5cd8f-9fd1-46c0-b2f6-d2d5ee6a68bf tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f5cd8f-9fd1-46c0-b2f6-d2d5ee6a68bf tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e352e24-9f09-460a-b2b6-137248b66fd4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe63299-0f66-456e-b079-2958f83b5dc7]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f5cd8f-9fd1-46c0-b2f6-d2d5ee6a68bf tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)
Aug 14 22:58:08 user nova-compute[72766]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9 (non-flash)
Aug 14 22:58:08 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f5cd8f-9fd1-46c0-b2f6-d2d5ee6a68bf tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)
Aug 14 22:58:08 user nova-compute[72766]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9 (non-flash)
Aug 14 22:58:08 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f5cd8f-9fd1-46c0-b2f6-d2d5ee6a68bf tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff16c365360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9'): ({'sdb'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-83f5cd8f-9fd1-46c0-b2f6-d2d5ee6a68bf tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Removing single pathed devices sdb {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d3dad6-a835-4de5-859b-ac1465c3a366]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fcb836d-3f2e-4585-9a3b-d6a167c4f55d]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-83f5cd8f-9fd1-46c0-b2f6-d2d5ee6a68bf tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Flushing IO for device /dev/sdb {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1b6f15-cbda-4e15-991f-b5aebb48e2f4]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-83f5cd8f-9fd1-46c0-b2f6-d2d5ee6a68bf tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d551384-58ee-44e0-94a1-55d490de64c9]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-83f5cd8f-9fd1-46c0-b2f6-d2d5ee6a68bf tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-83f5cd8f-9fd1-46c0-b2f6-d2d5ee6a68bf tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] SCSI volumes sdb have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f5cd8f-9fd1-46c0-b2f6-d2d5ee6a68bf tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c22147d-2aff-4958-a758-6f51cac573f2]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f5cd8f-9fd1-46c0-b2f6-d2d5ee6a68bf tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9 -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac3fd7f-f73f-42da-943c-201250f7690c]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f5cd8f-9fd1-46c0-b2f6-d2d5ee6a68bf tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9, portal: 172.16.0.220,3260]
Aug 14 22:58:08 user nova-compute[72766]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9, portal: 172.16.0.220,3260] successful.
Aug 14 22:58:08 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9 -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3484f6dd-f78e-43d5-aa74-c668e8181de9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a63883-3566-453e-8a7f-5dc773c0cc25]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f5cd8f-9fd1-46c0-b2f6-d2d5ee6a68bf tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-83f5cd8f-9fd1-46c0-b2f6-d2d5ee6a68bf tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f5cd8f-9fd1-46c0-b2f6-d2d5ee6a68bf tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] <== disconnect_volume: return (298ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:58:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83f5cd8f-9fd1-46c0-b2f6-d2d5ee6a68bf tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 22:58:09 user nova-compute[72766]: DEBUG nova.objects.instance [None req-83f5cd8f-9fd1-46c0-b2f6-d2d5ee6a68bf tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Lazy-loading 'flavor' on Instance uuid 40cd301a-97f2-4f02-b091-f5a2bb1cd016 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:58:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-83f5cd8f-9fd1-46c0-b2f6-d2d5ee6a68bf tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Lock "40cd301a-97f2-4f02-b091-f5a2bb1cd016" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.926s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:58:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6d3a63d6-a721-4270-8adc-d0ecb9270912 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Acquiring lock "40cd301a-97f2-4f02-b091-f5a2bb1cd016" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:58:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6d3a63d6-a721-4270-8adc-d0ecb9270912 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Lock "40cd301a-97f2-4f02-b091-f5a2bb1cd016" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:58:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6d3a63d6-a721-4270-8adc-d0ecb9270912 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Acquiring lock "40cd301a-97f2-4f02-b091-f5a2bb1cd016-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:58:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6d3a63d6-a721-4270-8adc-d0ecb9270912 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Lock "40cd301a-97f2-4f02-b091-f5a2bb1cd016-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:58:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6d3a63d6-a721-4270-8adc-d0ecb9270912 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Lock "40cd301a-97f2-4f02-b091-f5a2bb1cd016-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:58:10 user nova-compute[72766]: INFO nova.compute.manager [None req-6d3a63d6-a721-4270-8adc-d0ecb9270912 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Terminating instance
Aug 14 22:58:10 user nova-compute[72766]: DEBUG nova.compute.manager [None req-6d3a63d6-a721-4270-8adc-d0ecb9270912 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 22:58:10 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:10 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:10 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:10 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:10 user nova-compute[72766]: DEBUG nova.compute.manager [req-d6fbde27-5c6d-4644-9aff-a70259fa50f1 req-15b2ef1d-fde2-4acf-86ea-063273b0d630 service nova] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Received event network-vif-unplugged-9406f951-b950-463d-9574-104a83b25e7d {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:58:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d6fbde27-5c6d-4644-9aff-a70259fa50f1 req-15b2ef1d-fde2-4acf-86ea-063273b0d630 service nova] Acquiring lock "40cd301a-97f2-4f02-b091-f5a2bb1cd016-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:58:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d6fbde27-5c6d-4644-9aff-a70259fa50f1 req-15b2ef1d-fde2-4acf-86ea-063273b0d630 service nova] Lock "40cd301a-97f2-4f02-b091-f5a2bb1cd016-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:58:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d6fbde27-5c6d-4644-9aff-a70259fa50f1 req-15b2ef1d-fde2-4acf-86ea-063273b0d630 service nova] Lock "40cd301a-97f2-4f02-b091-f5a2bb1cd016-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:58:10 user nova-compute[72766]: DEBUG nova.compute.manager [req-d6fbde27-5c6d-4644-9aff-a70259fa50f1 req-15b2ef1d-fde2-4acf-86ea-063273b0d630 service nova] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] No waiting events found dispatching network-vif-unplugged-9406f951-b950-463d-9574-104a83b25e7d {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:58:10 user nova-compute[72766]: DEBUG nova.compute.manager [req-d6fbde27-5c6d-4644-9aff-a70259fa50f1 req-15b2ef1d-fde2-4acf-86ea-063273b0d630 service nova] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Received event network-vif-unplugged-9406f951-b950-463d-9574-104a83b25e7d for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 22:58:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 22:58:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hGSdOQkz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:58:10 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:58:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:58:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:58:10 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:58:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:58:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:58:10 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 22:58:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5 -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:10 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec40dfbf-1194-47b2-a538-24781517c2b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 22:58:10 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:10 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a413c12b-e095-4c93-a92b-9371f959c7f2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5] added
Aug 14 22:58:10 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:10 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2df3c02-4a1c-4bb7-b514-fb63243aaa99]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:10 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[152c57ed-cd96-4a5c-8de1-6ed4a1ba8187]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hGSdOQkz {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hGSdOQkz" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:10 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[425f5944-3ae2-4989-b160-f9457892d080]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hGSdOQkz'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:10 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6774c3e-fb39-4019-b427-92b3eae7f98a]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:11 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6a979e-782b-433d-a8c3-6b4256c01f62]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:11 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)
Aug 14 22:58:11 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:58:11 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)
Aug 14 22:58:11 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:58:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5 -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:11 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b37e42d-5c84-4325-8ebb-c2063a4a890d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:11 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5, portal: 172.16.0.220,3260]
Aug 14 22:58:11 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5, portal: 172.16.0.220,3260] successful.
Aug 14 22:58:11 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:11 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf83e6e-6f3c-4f2e-8175-0b6deb52e966]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:11 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:11 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb004ae-e694-47e5-8ae6-7da3462957ab]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:11 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)
Aug 14 22:58:11 user nova-compute[72766]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5 (non-flash)
Aug 14 22:58:11 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:58:11 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)
Aug 14 22:58:11 user nova-compute[72766]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5 (non-flash)
Aug 14 22:58:11 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:58:11 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:58:11 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 22:58:11 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] HCTL ('33', '-', '-', 0) found on session 8 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 22:58:11 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 22:58:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:11 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d420134-a3f9-44aa-b5f3-a02fc4549c93]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:11 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Searching for a device in session 8 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:58:11 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hGSdOQkz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 22:58:11 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Instance destroyed successfully.
Aug 14 22:58:11 user nova-compute[72766]: DEBUG nova.objects.instance [None req-6d3a63d6-a721-4270-8adc-d0ecb9270912 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Lazy-loading 'resources' on Instance uuid 40cd301a-97f2-4f02-b091-f5a2bb1cd016 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:58:11 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-6d3a63d6-a721-4270-8adc-d0ecb9270912 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T22:55:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1398839154',display_name='tempest-AttachSCSIVolumeTestJSON-server-1398839154',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1398839154',id=5,image_ref='6965249c-ed43-4d6f-9720-9b9543bc6e36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE07CscbRwiFXt4oowixGelS8cd8+TrGRhQZUTn4sQQh6dYhsSP3vBYNaHrOhsecr9RlWR/To/KqS1yieVJ3+g5dSeUHlJ0CvSgPRzoHoeKuUUkhapDJqVUINSaa/HN5tw==',key_name='tempest-keypair-427507318',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:56:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85cdad610d1c4f8f9eb3d2677ad62c5c',ramdisk_id='',reservation_id='r-jfsxlmdg',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6965249c-ed43-4d6f-9720-9b9543bc6e36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-455382250',owner_user_name='tempest-AttachSCSIVolumeTestJSON-455382250-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:56:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63b79fe4bc2e4fb68986d0927db750f9',uuid=40cd301a-97f2-4f02-b091-f5a2bb1cd016,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9406f951-b950-463d-9574-104a83b25e7d", "address": "fa:16:3e:97:20:81", "network": {"id": "12035bbc-2507-4317-af8b-a71f420b938e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-280915665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85cdad610d1c4f8f9eb3d2677ad62c5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9406f951-b9", "ovs_interfaceid": "9406f951-b950-463d-9574-104a83b25e7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 22:58:11 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-6d3a63d6-a721-4270-8adc-d0ecb9270912 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Converting VIF {"id": "9406f951-b950-463d-9574-104a83b25e7d", "address": "fa:16:3e:97:20:81", "network": {"id": "12035bbc-2507-4317-af8b-a71f420b938e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-280915665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85cdad610d1c4f8f9eb3d2677ad62c5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9406f951-b9", "ovs_interfaceid": "9406f951-b950-463d-9574-104a83b25e7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:58:11 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-6d3a63d6-a721-4270-8adc-d0ecb9270912 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:20:81,bridge_name='br-int',has_traffic_filtering=True,id=9406f951-b950-463d-9574-104a83b25e7d,network=Network(12035bbc-2507-4317-af8b-a71f420b938e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9406f951-b9') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:58:11 user nova-compute[72766]: DEBUG os_vif [None req-6d3a63d6-a721-4270-8adc-d0ecb9270912 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:20:81,bridge_name='br-int',has_traffic_filtering=True,id=9406f951-b950-463d-9574-104a83b25e7d,network=Network(12035bbc-2507-4317-af8b-a71f420b938e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9406f951-b9') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 22:58:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9406f951-b9, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:58:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:11 user nova-compute[72766]: INFO os_vif [None req-6d3a63d6-a721-4270-8adc-d0ecb9270912 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:20:81,bridge_name='br-int',has_traffic_filtering=True,id=9406f951-b950-463d-9574-104a83b25e7d,network=Network(12035bbc-2507-4317-af8b-a71f420b938e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9406f951-b9')
Aug 14 22:58:11 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-6d3a63d6-a721-4270-8adc-d0ecb9270912 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Deleting instance files /opt/stack/data/nova/instances/40cd301a-97f2-4f02-b091-f5a2bb1cd016_del
Aug 14 22:58:11 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-6d3a63d6-a721-4270-8adc-d0ecb9270912 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Deletion of /opt/stack/data/nova/instances/40cd301a-97f2-4f02-b091-f5a2bb1cd016_del complete
Aug 14 22:58:11 user nova-compute[72766]: INFO nova.compute.manager [None req-6d3a63d6-a721-4270-8adc-d0ecb9270912 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 14 22:58:11 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-6d3a63d6-a721-4270-8adc-d0ecb9270912 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 22:58:11 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 22:58:11 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 22:58:12 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:58:12 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23131643633393261', 'path': '/dev/sdb'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:58:12 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131643633393261', 'path': '/dev/sdb'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 22:58:12 user nova-compute[72766]: DEBUG nova.objects.instance [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Lazy-loading 'flavor' on Instance uuid 90b55775-2f14-4c80-b48a-b1eed2b570dc {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:58:12 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 22:58:12 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:58:12 user nova-compute[72766]:   <source dev="/dev/sdb"/>
Aug 14 22:58:12 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:58:12 user nova-compute[72766]:   <serial>3ba8a773-dabf-4b11-8758-0f643b7727a5</serial>
Aug 14 22:58:12 user nova-compute[72766]: </disk>
Aug 14 22:58:12 user nova-compute[72766]:  {{(pid=72766) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 22:58:12 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:58:12 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Took 1.04 seconds to deallocate network for instance.
Aug 14 22:58:12 user nova-compute[72766]: DEBUG nova.compute.manager [req-eb372902-c6fa-49fc-aa64-dd3db4958107 req-4778472b-df42-4bad-8262-af79a4046886 service nova] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Received event network-vif-deleted-9406f951-b950-463d-9574-104a83b25e7d {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:58:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6d3a63d6-a721-4270-8adc-d0ecb9270912 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:58:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6d3a63d6-a721-4270-8adc-d0ecb9270912 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:58:12 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:58:12 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] No BDM found with device name hda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:58:12 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] No VIF found with MAC fa:16:3e:5e:2c:02, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:58:12 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:58:12 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 22:58:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-87712dfd-d67b-4e5e-a75d-ca2dd7c764b1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:58:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-87712dfd-d67b-4e5e-a75d-ca2dd7c764b1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:58:12 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 22:58:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-38ee96ae-442e-4b82-8052-4a109323fc50 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Lock "90b55775-2f14-4c80-b48a-b1eed2b570dc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.529s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:58:12 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-6d3a63d6-a721-4270-8adc-d0ecb9270912 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:58:12 user nova-compute[72766]: DEBUG nova.compute.manager [req-8346b3a7-9950-421f-af8e-09e686dc4d0e req-10560f25-2bab-4709-b90b-8f86cedd7151 service nova] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Received event network-vif-plugged-9406f951-b950-463d-9574-104a83b25e7d {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:58:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8346b3a7-9950-421f-af8e-09e686dc4d0e req-10560f25-2bab-4709-b90b-8f86cedd7151 service nova] Acquiring lock "40cd301a-97f2-4f02-b091-f5a2bb1cd016-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:58:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8346b3a7-9950-421f-af8e-09e686dc4d0e req-10560f25-2bab-4709-b90b-8f86cedd7151 service nova] Lock "40cd301a-97f2-4f02-b091-f5a2bb1cd016-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:58:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8346b3a7-9950-421f-af8e-09e686dc4d0e req-10560f25-2bab-4709-b90b-8f86cedd7151 service nova] Lock "40cd301a-97f2-4f02-b091-f5a2bb1cd016-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:58:12 user nova-compute[72766]: DEBUG nova.compute.manager [req-8346b3a7-9950-421f-af8e-09e686dc4d0e req-10560f25-2bab-4709-b90b-8f86cedd7151 service nova] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] No waiting events found dispatching network-vif-plugged-9406f951-b950-463d-9574-104a83b25e7d {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:58:12 user nova-compute[72766]: WARNING nova.compute.manager [req-8346b3a7-9950-421f-af8e-09e686dc4d0e req-10560f25-2bab-4709-b90b-8f86cedd7151 service nova] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Received unexpected event network-vif-plugged-9406f951-b950-463d-9574-104a83b25e7d for instance with vm_state deleted and task_state None.
Aug 14 22:58:12 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-6d3a63d6-a721-4270-8adc-d0ecb9270912 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:58:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6d3a63d6-a721-4270-8adc-d0ecb9270912 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.444s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:58:12 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-6d3a63d6-a721-4270-8adc-d0ecb9270912 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Deleted allocations for instance 40cd301a-97f2-4f02-b091-f5a2bb1cd016
Aug 14 22:58:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6d3a63d6-a721-4270-8adc-d0ecb9270912 tempest-AttachSCSIVolumeTestJSON-455382250 tempest-AttachSCSIVolumeTestJSON-455382250-project-member] Lock "40cd301a-97f2-4f02-b091-f5a2bb1cd016" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.618s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:58:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:13 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Updating instance_info_cache with network_info: [{"id": "baa7e0c2-91d4-4077-8405-abb537475df2", "address": "fa:16:3e:88:35:14", "network": {"id": "aff4f146-97db-4102-abf1-6528e74cad55", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1894452367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6942d31258304de68c9f7f8bb9304acb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa7e0c2-91", "ovs_interfaceid": "baa7e0c2-91d4-4077-8405-abb537475df2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:58:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-87712dfd-d67b-4e5e-a75d-ca2dd7c764b1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:58:13 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 22:58:13 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:58:13 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:58:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a1847f02-3eba-469b-88b3-6222c6f70490 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Acquiring lock "90b55775-2f14-4c80-b48a-b1eed2b570dc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:58:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a1847f02-3eba-469b-88b3-6222c6f70490 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Lock "90b55775-2f14-4c80-b48a-b1eed2b570dc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:58:14 user nova-compute[72766]: INFO nova.compute.manager [None req-a1847f02-3eba-469b-88b3-6222c6f70490 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Detaching volume 3ba8a773-dabf-4b11-8758-0f643b7727a5
Aug 14 22:58:14 user nova-compute[72766]: INFO nova.virt.block_device [None req-a1847f02-3eba-469b-88b3-6222c6f70490 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Attempting to driver detach volume 3ba8a773-dabf-4b11-8758-0f643b7727a5 from mountpoint /dev/vdb
Aug 14 22:58:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a1847f02-3eba-469b-88b3-6222c6f70490 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Attempting to detach device vdb from instance 90b55775-2f14-4c80-b48a-b1eed2b570dc from the persistent domain config. {{(pid=72766) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 22:58:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-a1847f02-3eba-469b-88b3-6222c6f70490 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 22:58:14 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:58:14 user nova-compute[72766]:   <source dev="/dev/sdb"/>
Aug 14 22:58:14 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:58:14 user nova-compute[72766]:   <serial>3ba8a773-dabf-4b11-8758-0f643b7727a5</serial>
Aug 14 22:58:14 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 14 22:58:14 user nova-compute[72766]: </disk>
Aug 14 22:58:14 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 22:58:14 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-a1847f02-3eba-469b-88b3-6222c6f70490 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Successfully detached device vdb from instance 90b55775-2f14-4c80-b48a-b1eed2b570dc from the persistent domain config.
Aug 14 22:58:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a1847f02-3eba-469b-88b3-6222c6f70490 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 90b55775-2f14-4c80-b48a-b1eed2b570dc from the live domain config. {{(pid=72766) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 22:58:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-a1847f02-3eba-469b-88b3-6222c6f70490 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 22:58:14 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:58:14 user nova-compute[72766]:   <source dev="/dev/sdb"/>
Aug 14 22:58:14 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:58:14 user nova-compute[72766]:   <serial>3ba8a773-dabf-4b11-8758-0f643b7727a5</serial>
Aug 14 22:58:14 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 14 22:58:14 user nova-compute[72766]: </disk>
Aug 14 22:58:14 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 22:58:14 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:58:14 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 22:58:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Received event <DeviceRemovedEvent: 1692053894.814528, 90b55775-2f14-4c80-b48a-b1eed2b570dc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72766) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 22:58:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a1847f02-3eba-469b-88b3-6222c6f70490 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 90b55775-2f14-4c80-b48a-b1eed2b570dc {{(pid=72766) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 22:58:14 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-a1847f02-3eba-469b-88b3-6222c6f70490 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Successfully detached device vdb from instance 90b55775-2f14-4c80-b48a-b1eed2b570dc from the live domain config.
Aug 14 22:58:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1847f02-3eba-469b-88b3-6222c6f70490 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 22:58:14 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1847f02-3eba-469b-88b3-6222c6f70490 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hGSdOQkz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:58:14 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-a1847f02-3eba-469b-88b3-6222c6f70490 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:58:14 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-a1847f02-3eba-469b-88b3-6222c6f70490 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:58:14 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-a1847f02-3eba-469b-88b3-6222c6f70490 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:58:14 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1847f02-3eba-469b-88b3-6222c6f70490 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 22:58:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:14 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[5baa9791-1c1b-4f96-854f-6ceb4110e40b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:14 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f24fe9-d502-44ca-931f-132e2a02f394]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:14 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1847f02-3eba-469b-88b3-6222c6f70490 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)
Aug 14 22:58:14 user nova-compute[72766]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5 (non-flash)
Aug 14 22:58:14 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:58:14 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1847f02-3eba-469b-88b3-6222c6f70490 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)
Aug 14 22:58:14 user nova-compute[72766]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5 (non-flash)
Aug 14 22:58:14 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:58:14 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1847f02-3eba-469b-88b3-6222c6f70490 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff16c138820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5'): ({'sdb'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 22:58:14 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-a1847f02-3eba-469b-88b3-6222c6f70490 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Removing single pathed devices sdb {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 22:58:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:14 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a10558-5af1-4608-807b-647ad9aef319]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:14 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[637552a1-026e-4d8f-a87b-09116f97d0e8]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:14 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-a1847f02-3eba-469b-88b3-6222c6f70490 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Flushing IO for device /dev/sdb {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 22:58:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:14 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dadfb1d-c114-46b7-bd0f-bbc32a5db8ea]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:14 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-a1847f02-3eba-469b-88b3-6222c6f70490 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 22:58:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.063s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4640fdc4-308c-4c3b-8fe0-805970e4c3d9]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-a1847f02-3eba-469b-88b3-6222c6f70490 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-a1847f02-3eba-469b-88b3-6222c6f70490 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] SCSI volumes sdb have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1847f02-3eba-469b-88b3-6222c6f70490 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fa9939-c4ff-4e87-a957-a8eaa57b7e86]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1847f02-3eba-469b-88b3-6222c6f70490 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5 -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[6320f3bd-bfca-4072-a93e-9379908b9194]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1847f02-3eba-469b-88b3-6222c6f70490 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5, portal: 172.16.0.220,3260]
Aug 14 22:58:15 user nova-compute[72766]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5, portal: 172.16.0.220,3260] successful.
Aug 14 22:58:15 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5 -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ba8a773-dabf-4b11-8758-0f643b7727a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f1bc9a-a616-4a5d-a416-de5d5351188d]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1847f02-3eba-469b-88b3-6222c6f70490 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-a1847f02-3eba-469b-88b3-6222c6f70490 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1847f02-3eba-469b-88b3-6222c6f70490 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] <== disconnect_volume: return (311ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1847f02-3eba-469b-88b3-6222c6f70490 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG nova.compute.manager [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JshAerTH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '33e6f8aa-bb0d-478d-b7b5-3334302476fb', 'attached_at': '', 'detached_at': '', 'volume_id': '8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf', 'serial': '8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mVgSjQTR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '33e6f8aa-bb0d-478d-b7b5-3334302476fb', 'attached_at': '', 'detached_at': '', 'volume_id': '37f3ab46-4f0d-408f-a4e6-d634bc8e498e', 'serial'} {{(pid=72766) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JshAerTH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:58:15 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:58:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:58:15 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:58:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:58:15 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[3072b166-dbc9-4a7b-9290-96743784977d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 22:58:15 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[3798cd59-3308-4da1-947c-36dfcf089434]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf] added
Aug 14 22:58:15 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afc662b-2520-45f0-b831-e49b134e8f7b]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce8e083-7a95-4c70-a6ed-e5db8ef69a0c]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JshAerTH {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JshAerTH" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fffa49-ec71-4de3-9753-f87c745365a7]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JshAerTH'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb443b0-9465-4700-90c0-453bb524919f]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[448c474c-603a-4383-b5c5-6d1993a22100]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)
Aug 14 22:58:15 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)
Aug 14 22:58:15 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b6c96f-d04d-4e4a-ab5f-6df406c3c60c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf, portal: 172.16.0.220,3260]
Aug 14 22:58:15 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf, portal: 172.16.0.220,3260] successful.
Aug 14 22:58:15 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9eb063-ecdc-4163-8949-6da81df2cd48]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc18cbec-e506-4a92-8482-a7027bef7f07]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)
Aug 14 22:58:15 user nova-compute[72766]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf (non-flash)
Aug 14 22:58:15 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)
Aug 14 22:58:15 user nova-compute[72766]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf (non-flash)
Aug 14 22:58:15 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] HCTL ('33', '-', '-', 0) found on session 9 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[943cd902-ad31-4f87-a9e0-0abad3121ec9]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Searching for a device in session 9 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JshAerTH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33e6f8aa-bb0d-478d-b7b5-3334302476fb/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:15 user nova-compute[72766]: DEBUG nova.objects.instance [None req-a1847f02-3eba-469b-88b3-6222c6f70490 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Lazy-loading 'flavor' on Instance uuid 90b55775-2f14-4c80-b48a-b1eed2b570dc {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:58:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a1847f02-3eba-469b-88b3-6222c6f70490 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Lock "90b55775-2f14-4c80-b48a-b1eed2b570dc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.878s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:58:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33e6f8aa-bb0d-478d-b7b5-3334302476fb/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33e6f8aa-bb0d-478d-b7b5-3334302476fb/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33e6f8aa-bb0d-478d-b7b5-3334302476fb/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:58:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d0ad2d1b-fb95-456e-b7b1-59bddd47f1f5 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Acquiring lock "interface-90b55775-2f14-4c80-b48a-b1eed2b570dc-a886f590-4818-4e79-ad6c-785067fbff0d" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:58:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d0ad2d1b-fb95-456e-b7b1-59bddd47f1f5 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Lock "interface-90b55775-2f14-4c80-b48a-b1eed2b570dc-a886f590-4818-4e79-ad6c-785067fbff0d" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:58:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:16 user nova-compute[72766]: DEBUG nova.objects.instance [None req-d0ad2d1b-fb95-456e-b7b1-59bddd47f1f5 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Lazy-loading 'flavor' on Instance uuid 90b55775-2f14-4c80-b48a-b1eed2b570dc {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:58:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-d0ad2d1b-fb95-456e-b7b1-59bddd47f1f5 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T22:55:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-359420211',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-359420211',id=6,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8cq16Tr/aSGWtJWb/xfeRNJOb+B6LjH5taG4rznYJbzp5KjGb+MpXm0+8Y+Xs3FuiWq9fVeEhIpGtH4iqY05CSFniUjByOF+zxj8vXJaj8j0+QLFR098sJu8pYQ2V7Ow==',key_name='tempest-keypair-975754438',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:56:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d841b7f732a743658e035777c8629c50',ramdisk_id='',reservation_id='r-iogn86da',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1079325823',owner_user_name='tempest-TaggedAttachmentsTest-1079325823-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adf9d286eb5749e7a5278af949ca1a9f',uuid=90b55775-2f14-4c80-b48a-b1eed2b570dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a886f590-4818-4e79-ad6c-785067fbff0d", "address": "fa:16:3e:14:59:64", "network": {"id": "86616d0d-d4bf-4c7d-ab66-1f92f05d79d6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1584215259", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d841b7f732a743658e035777c8629c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa886f590-48", "ovs_interfaceid": "a886f590-4818-4e79-ad6c-785067fbff0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 22:58:16 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-d0ad2d1b-fb95-456e-b7b1-59bddd47f1f5 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Converting VIF {"id": "a886f590-4818-4e79-ad6c-785067fbff0d", "address": "fa:16:3e:14:59:64", "network": {"id": "86616d0d-d4bf-4c7d-ab66-1f92f05d79d6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1584215259", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d841b7f732a743658e035777c8629c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa886f590-48", "ovs_interfaceid": "a886f590-4818-4e79-ad6c-785067fbff0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:58:16 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-d0ad2d1b-fb95-456e-b7b1-59bddd47f1f5 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:59:64,bridge_name='br-int',has_traffic_filtering=True,id=a886f590-4818-4e79-ad6c-785067fbff0d,network=Network(86616d0d-d4bf-4c7d-ab66-1f92f05d79d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa886f590-48') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:58:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-d0ad2d1b-fb95-456e-b7b1-59bddd47f1f5 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:14:59:64"/><model type="virtio"/><mtu size="1442"/><target dev="tapa886f590-48"/></interface> {{(pid=72766) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 14 22:58:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-d0ad2d1b-fb95-456e-b7b1-59bddd47f1f5 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:14:59:64"/><model type="virtio"/><mtu size="1442"/><target dev="tapa886f590-48"/></interface> {{(pid=72766) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 14 22:58:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-d0ad2d1b-fb95-456e-b7b1-59bddd47f1f5 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Attempting to detach device tapa886f590-48 from instance 90b55775-2f14-4c80-b48a-b1eed2b570dc from the persistent domain config. {{(pid=72766) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 22:58:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-d0ad2d1b-fb95-456e-b7b1-59bddd47f1f5 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] detach device xml: <interface type="ethernet">
Aug 14 22:58:16 user nova-compute[72766]:   <mac address="fa:16:3e:14:59:64"/>
Aug 14 22:58:16 user nova-compute[72766]:   <model type="virtio"/>
Aug 14 22:58:16 user nova-compute[72766]:   <mtu size="1442"/>
Aug 14 22:58:16 user nova-compute[72766]:   <target dev="tapa886f590-48"/>
Aug 14 22:58:16 user nova-compute[72766]: </interface>
Aug 14 22:58:16 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 22:58:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-d0ad2d1b-fb95-456e-b7b1-59bddd47f1f5 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:14:59:64"/><model type="virtio"/><mtu size="1442"/><target dev="tapa886f590-48"/></interface> {{(pid=72766) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 14 22:58:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-d0ad2d1b-fb95-456e-b7b1-59bddd47f1f5 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:14:59:64"/><model type="virtio"/><mtu size="1442"/><target dev="tapa886f590-48"/></interface>not found in domain: <domain type='kvm' id='6'>
Aug 14 22:58:16 user nova-compute[72766]:   <name>instance-00000006</name>
Aug 14 22:58:16 user nova-compute[72766]:   <uuid>90b55775-2f14-4c80-b48a-b1eed2b570dc</uuid>
Aug 14 22:58:16 user nova-compute[72766]:   <metadata>
Aug 14 22:58:16 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:58:16 user nova-compute[72766]:   <nova:package version="0.0.0"/>
Aug 14 22:58:16 user nova-compute[72766]:   <nova:name>tempest-device-tagging-server-359420211</nova:name>
Aug 14 22:58:16 user nova-compute[72766]:   <nova:creationTime>2023-08-14 22:57:51</nova:creationTime>
Aug 14 22:58:16 user nova-compute[72766]:   <nova:flavor name="m1.tiny">
Aug 14 22:58:16 user nova-compute[72766]:     <nova:memory>512</nova:memory>
Aug 14 22:58:16 user nova-compute[72766]:     <nova:disk>1</nova:disk>
Aug 14 22:58:16 user nova-compute[72766]:     <nova:swap>0</nova:swap>
Aug 14 22:58:16 user nova-compute[72766]:     <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:58:16 user nova-compute[72766]:     <nova:vcpus>1</nova:vcpus>
Aug 14 22:58:16 user nova-compute[72766]:   </nova:flavor>
Aug 14 22:58:16 user nova-compute[72766]:   <nova:owner>
Aug 14 22:58:16 user nova-compute[72766]:     <nova:user uuid="adf9d286eb5749e7a5278af949ca1a9f">tempest-TaggedAttachmentsTest-1079325823-project-member</nova:user>
Aug 14 22:58:16 user nova-compute[72766]:     <nova:project uuid="d841b7f732a743658e035777c8629c50">tempest-TaggedAttachmentsTest-1079325823</nova:project>
Aug 14 22:58:16 user nova-compute[72766]:   </nova:owner>
Aug 14 22:58:16 user nova-compute[72766]:   <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 22:58:16 user nova-compute[72766]:   <nova:ports>
Aug 14 22:58:16 user nova-compute[72766]:     <nova:port uuid="58e0b222-3a0a-40d3-ad60-e92985bd3584">
Aug 14 22:58:16 user nova-compute[72766]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 22:58:16 user nova-compute[72766]:     </nova:port>
Aug 14 22:58:16 user nova-compute[72766]:     <nova:port uuid="a886f590-4818-4e79-ad6c-785067fbff0d">
Aug 14 22:58:16 user nova-compute[72766]:       <nova:ip type="fixed" address="10.10.10.235" ipVersion="4"/>
Aug 14 22:58:16 user nova-compute[72766]:     </nova:port>
Aug 14 22:58:16 user nova-compute[72766]:   </nova:ports>
Aug 14 22:58:16 user nova-compute[72766]: </nova:instance>
Aug 14 22:58:16 user nova-compute[72766]:   </metadata>
Aug 14 22:58:16 user nova-compute[72766]:   <memory unit='KiB'>524288</memory>
Aug 14 22:58:16 user nova-compute[72766]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 14 22:58:16 user nova-compute[72766]:   <vcpu placement='static'>1</vcpu>
Aug 14 22:58:16 user nova-compute[72766]:   <resource>
Aug 14 22:58:16 user nova-compute[72766]:     <partition>/machine</partition>
Aug 14 22:58:16 user nova-compute[72766]:   </resource>
Aug 14 22:58:16 user nova-compute[72766]:   <sysinfo type='smbios'>
Aug 14 22:58:16 user nova-compute[72766]:     <system>
Aug 14 22:58:16 user nova-compute[72766]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 14 22:58:16 user nova-compute[72766]:       <entry name='product'>OpenStack Nova</entry>
Aug 14 22:58:16 user nova-compute[72766]:       <entry name='version'>0.0.0</entry>
Aug 14 22:58:16 user nova-compute[72766]:       <entry name='serial'>90b55775-2f14-4c80-b48a-b1eed2b570dc</entry>
Aug 14 22:58:16 user nova-compute[72766]:       <entry name='uuid'>90b55775-2f14-4c80-b48a-b1eed2b570dc</entry>
Aug 14 22:58:16 user nova-compute[72766]:       <entry name='family'>Virtual Machine</entry>
Aug 14 22:58:16 user nova-compute[72766]:     </system>
Aug 14 22:58:16 user nova-compute[72766]:   </sysinfo>
Aug 14 22:58:16 user nova-compute[72766]:   <os>
Aug 14 22:58:16 user nova-compute[72766]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 14 22:58:16 user nova-compute[72766]:     <boot dev='hd'/>
Aug 14 22:58:16 user nova-compute[72766]:     <smbios mode='sysinfo'/>
Aug 14 22:58:16 user nova-compute[72766]:   </os>
Aug 14 22:58:16 user nova-compute[72766]:   <features>
Aug 14 22:58:16 user nova-compute[72766]:     <acpi/>
Aug 14 22:58:16 user nova-compute[72766]:     <apic/>
Aug 14 22:58:16 user nova-compute[72766]:     <vmcoreinfo state='on'/>
Aug 14 22:58:16 user nova-compute[72766]:   </features>
Aug 14 22:58:16 user nova-compute[72766]:   <cpu mode='custom' match='exact' check='full'>
Aug 14 22:58:16 user nova-compute[72766]:     <model fallback='forbid'>Nehalem</model>
Aug 14 22:58:16 user nova-compute[72766]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 14 22:58:16 user nova-compute[72766]:     <feature policy='require' name='vme'/>
Aug 14 22:58:16 user nova-compute[72766]:     <feature policy='require' name='x2apic'/>
Aug 14 22:58:16 user nova-compute[72766]:     <feature policy='require' name='hypervisor'/>
Aug 14 22:58:16 user nova-compute[72766]:   </cpu>
Aug 14 22:58:16 user nova-compute[72766]:   <clock offset='utc'>
Aug 14 22:58:16 user nova-compute[72766]:     <timer name='pit' tickpolicy='delay'/>
Aug 14 22:58:16 user nova-compute[72766]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 14 22:58:16 user nova-compute[72766]:     <timer name='hpet' present='no'/>
Aug 14 22:58:16 user nova-compute[72766]:   </clock>
Aug 14 22:58:16 user nova-compute[72766]:   <on_poweroff>destroy</on_poweroff>
Aug 14 22:58:16 user nova-compute[72766]:   <on_reboot>restart</on_reboot>
Aug 14 22:58:16 user nova-compute[72766]:   <on_crash>destroy</on_crash>
Aug 14 22:58:16 user nova-compute[72766]:   <devices>
Aug 14 22:58:16 user nova-compute[72766]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 14 22:58:16 user nova-compute[72766]:     <disk type='file' device='disk'>
Aug 14 22:58:16 user nova-compute[72766]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 14 22:58:16 user nova-compute[72766]:       <source file='/opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc/disk' index='2'/>
Aug 14 22:58:16 user nova-compute[72766]:       <backingStore type='file' index='3'>
Aug 14 22:58:16 user nova-compute[72766]:         <format type='raw'/>
Aug 14 22:58:16 user nova-compute[72766]:         <source file='/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb'/>
Aug 14 22:58:16 user nova-compute[72766]:         <backingStore/>
Aug 14 22:58:16 user nova-compute[72766]:       </backingStore>
Aug 14 22:58:16 user nova-compute[72766]:       <target dev='vda' bus='virtio'/>
Aug 14 22:58:16 user nova-compute[72766]:       <alias name='virtio-disk0'/>
Aug 14 22:58:16 user nova-compute[72766]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 14 22:58:16 user nova-compute[72766]:     </disk>
Aug 14 22:58:16 user nova-compute[72766]:     <disk type='file' device='cdrom'>
Aug 14 22:58:16 user nova-compute[72766]:       <driver name='qemu' type='raw' cache='none'/>
Aug 14 22:58:16 user nova-compute[72766]:       <source file='/opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc/disk.config' index='1'/>
Aug 14 22:58:16 user nova-compute[72766]:       <backingStore/>
Aug 14 22:58:16 user nova-compute[72766]:       <target dev='hda' bus='ide'/>
Aug 14 22:58:16 user nova-compute[72766]:       <readonly/>
Aug 14 22:58:16 user nova-compute[72766]:       <alias name='ide0-0-0'/>
Aug 14 22:58:16 user nova-compute[72766]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 14 22:58:16 user nova-compute[72766]:     </disk>
Aug 14 22:58:16 user nova-compute[72766]:     <controller type='usb' index='0' model='none'>
Aug 14 22:58:16 user nova-compute[72766]:       <alias name='usb'/>
Aug 14 22:58:16 user nova-compute[72766]:     </controller>
Aug 14 22:58:16 user nova-compute[72766]:     <controller type='pci' index='0' model='pci-root'>
Aug 14 22:58:16 user nova-compute[72766]:       <alias name='pci.0'/>
Aug 14 22:58:16 user nova-compute[72766]:     </controller>
Aug 14 22:58:16 user nova-compute[72766]:     <controller type='ide' index='0'>
Aug 14 22:58:16 user nova-compute[72766]:       <alias name='ide'/>
Aug 14 22:58:16 user nova-compute[72766]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 14 22:58:16 user nova-compute[72766]:     </controller>
Aug 14 22:58:16 user nova-compute[72766]:     <interface type='ethernet'>
Aug 14 22:58:16 user nova-compute[72766]:       <mac address='fa:16:3e:5e:2c:02'/>
Aug 14 22:58:16 user nova-compute[72766]:       <target dev='tap58e0b222-3a'/>
Aug 14 22:58:16 user nova-compute[72766]:       <model type='virtio'/>
Aug 14 22:58:16 user nova-compute[72766]:       <mtu size='1442'/>
Aug 14 22:58:16 user nova-compute[72766]:       <alias name='net0'/>
Aug 14 22:58:16 user nova-compute[72766]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 14 22:58:16 user nova-compute[72766]:     </interface>
Aug 14 22:58:16 user nova-compute[72766]:     <interface type='ethernet'>
Aug 14 22:58:16 user nova-compute[72766]:       <mac address='fa:16:3e:14:59:64'/>
Aug 14 22:58:16 user nova-compute[72766]:       <target dev='tapa886f590-48'/>
Aug 14 22:58:16 user nova-compute[72766]:       <model type='virtio'/>
Aug 14 22:58:16 user nova-compute[72766]:       <mtu size='1442'/>
Aug 14 22:58:16 user nova-compute[72766]:       <alias name='net1'/>
Aug 14 22:58:16 user nova-compute[72766]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 14 22:58:16 user nova-compute[72766]:     </interface>
Aug 14 22:58:16 user nova-compute[72766]:     <serial type='pty'>
Aug 14 22:58:16 user nova-compute[72766]:       <source path='/dev/pts/5'/>
Aug 14 22:58:16 user nova-compute[72766]:       <log file='/opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc/console.log' append='off'/>
Aug 14 22:58:16 user nova-compute[72766]:       <target type='isa-serial' port='0'>
Aug 14 22:58:16 user nova-compute[72766]:         <model name='isa-serial'/>
Aug 14 22:58:16 user nova-compute[72766]:       </target>
Aug 14 22:58:16 user nova-compute[72766]:       <alias name='serial0'/>
Aug 14 22:58:16 user nova-compute[72766]:     </serial>
Aug 14 22:58:16 user nova-compute[72766]:     <console type='pty' tty='/dev/pts/5'>
Aug 14 22:58:16 user nova-compute[72766]:       <source path='/dev/pts/5'/>
Aug 14 22:58:16 user nova-compute[72766]:       <log file='/opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc/console.log' append='off'/>
Aug 14 22:58:16 user nova-compute[72766]:       <target type='serial' port='0'/>
Aug 14 22:58:16 user nova-compute[72766]:       <alias name='serial0'/>
Aug 14 22:58:16 user nova-compute[72766]:     </console>
Aug 14 22:58:16 user nova-compute[72766]:     <input type='mouse' bus='ps2'>
Aug 14 22:58:16 user nova-compute[72766]:       <alias name='input0'/>
Aug 14 22:58:16 user nova-compute[72766]:     </input>
Aug 14 22:58:16 user nova-compute[72766]:     <input type='keyboard' bus='ps2'>
Aug 14 22:58:16 user nova-compute[72766]:       <alias name='input1'/>
Aug 14 22:58:16 user nova-compute[72766]:     </input>
Aug 14 22:58:16 user nova-compute[72766]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Aug 14 22:58:16 user nova-compute[72766]:       <listen type='address' address='0.0.0.0'/>
Aug 14 22:58:16 user nova-compute[72766]:     </graphics>
Aug 14 22:58:16 user nova-compute[72766]:     <audio id='1' type='none'/>
Aug 14 22:58:16 user nova-compute[72766]:     <video>
Aug 14 22:58:16 user nova-compute[72766]:       <model type='virtio' heads='1' primary='yes'/>
Aug 14 22:58:16 user nova-compute[72766]:       <alias name='video0'/>
Aug 14 22:58:16 user nova-compute[72766]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 14 22:58:16 user nova-compute[72766]:     </video>
Aug 14 22:58:16 user nova-compute[72766]:     <memballoon model='virtio'>
Aug 14 22:58:16 user nova-compute[72766]:       <stats period='10'/>
Aug 14 22:58:16 user nova-compute[72766]:       <alias name='balloon0'/>
Aug 14 22:58:16 user nova-compute[72766]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 14 22:58:16 user nova-compute[72766]:     </memballoon>
Aug 14 22:58:16 user nova-compute[72766]:     <rng model='virtio'>
Aug 14 22:58:16 user nova-compute[72766]:       <backend model='random'>/dev/urandom</backend>
Aug 14 22:58:16 user nova-compute[72766]:       <alias name='rng0'/>
Aug 14 22:58:16 user nova-compute[72766]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 14 22:58:16 user nova-compute[72766]:     </rng>
Aug 14 22:58:16 user nova-compute[72766]:   </devices>
Aug 14 22:58:16 user nova-compute[72766]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 14 22:58:16 user nova-compute[72766]:     <label>libvirt-90b55775-2f14-4c80-b48a-b1eed2b570dc</label>
Aug 14 22:58:16 user nova-compute[72766]:     <imagelabel>libvirt-90b55775-2f14-4c80-b48a-b1eed2b570dc</imagelabel>
Aug 14 22:58:16 user nova-compute[72766]:   </seclabel>
Aug 14 22:58:16 user nova-compute[72766]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 14 22:58:16 user nova-compute[72766]:     <label>+64055:+108</label>
Aug 14 22:58:16 user nova-compute[72766]:     <imagelabel>+64055:+108</imagelabel>
Aug 14 22:58:16 user nova-compute[72766]:   </seclabel>
Aug 14 22:58:16 user nova-compute[72766]: </domain>
Aug 14 22:58:16 user nova-compute[72766]:  {{(pid=72766) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 14 22:58:16 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-d0ad2d1b-fb95-456e-b7b1-59bddd47f1f5 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Successfully detached device tapa886f590-48 from instance 90b55775-2f14-4c80-b48a-b1eed2b570dc from the persistent domain config.
Aug 14 22:58:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-d0ad2d1b-fb95-456e-b7b1-59bddd47f1f5 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] (1/8): Attempting to detach device tapa886f590-48 with device alias net1 from instance 90b55775-2f14-4c80-b48a-b1eed2b570dc from the live domain config. {{(pid=72766) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 22:58:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-d0ad2d1b-fb95-456e-b7b1-59bddd47f1f5 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] detach device xml: <interface type="ethernet">
Aug 14 22:58:16 user nova-compute[72766]:   <mac address="fa:16:3e:14:59:64"/>
Aug 14 22:58:16 user nova-compute[72766]:   <model type="virtio"/>
Aug 14 22:58:16 user nova-compute[72766]:   <mtu size="1442"/>
Aug 14 22:58:16 user nova-compute[72766]:   <target dev="tapa886f590-48"/>
Aug 14 22:58:16 user nova-compute[72766]: </interface>
Aug 14 22:58:16 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 22:58:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:58:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '26136643532616666', 'path': '/dev/sdb'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:58:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136643532616666', 'path': '/dev/sdb'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 22:58:16 user nova-compute[72766]: DEBUG nova.objects.instance [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Lazy-loading 'flavor' on Instance uuid 33e6f8aa-bb0d-478d-b7b5-3334302476fb {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:58:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0850bb6c-6e3e-4007-8478-8eba53089158/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Received event <DeviceRemovedEvent: 1692053896.949273, 90b55775-2f14-4c80-b48a-b1eed2b570dc => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72766) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 22:58:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-d0ad2d1b-fb95-456e-b7b1-59bddd47f1f5 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Start waiting for the detach event from libvirt for device tapa886f590-48 with device alias net1 for instance 90b55775-2f14-4c80-b48a-b1eed2b570dc {{(pid=72766) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 22:58:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-d0ad2d1b-fb95-456e-b7b1-59bddd47f1f5 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:14:59:64"/><model type="virtio"/><mtu size="1442"/><target dev="tapa886f590-48"/></interface> {{(pid=72766) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 14 22:58:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-d0ad2d1b-fb95-456e-b7b1-59bddd47f1f5 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:14:59:64"/><model type="virtio"/><mtu size="1442"/><target dev="tapa886f590-48"/></interface>not found in domain: <domain type='kvm' id='6'>
Aug 14 22:58:16 user nova-compute[72766]:   <name>instance-00000006</name>
Aug 14 22:58:16 user nova-compute[72766]:   <uuid>90b55775-2f14-4c80-b48a-b1eed2b570dc</uuid>
Aug 14 22:58:16 user nova-compute[72766]:   <metadata>
Aug 14 22:58:16 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:58:16 user nova-compute[72766]:   <nova:package version="0.0.0"/>
Aug 14 22:58:16 user nova-compute[72766]:   <nova:name>tempest-device-tagging-server-359420211</nova:name>
Aug 14 22:58:16 user nova-compute[72766]:   <nova:creationTime>2023-08-14 22:57:51</nova:creationTime>
Aug 14 22:58:16 user nova-compute[72766]:   <nova:flavor name="m1.tiny">
Aug 14 22:58:16 user nova-compute[72766]:     <nova:memory>512</nova:memory>
Aug 14 22:58:16 user nova-compute[72766]:     <nova:disk>1</nova:disk>
Aug 14 22:58:16 user nova-compute[72766]:     <nova:swap>0</nova:swap>
Aug 14 22:58:16 user nova-compute[72766]:     <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:58:16 user nova-compute[72766]:     <nova:vcpus>1</nova:vcpus>
Aug 14 22:58:16 user nova-compute[72766]:   </nova:flavor>
Aug 14 22:58:16 user nova-compute[72766]:   <nova:owner>
Aug 14 22:58:16 user nova-compute[72766]:     <nova:user uuid="adf9d286eb5749e7a5278af949ca1a9f">tempest-TaggedAttachmentsTest-1079325823-project-member</nova:user>
Aug 14 22:58:16 user nova-compute[72766]:     <nova:project uuid="d841b7f732a743658e035777c8629c50">tempest-TaggedAttachmentsTest-1079325823</nova:project>
Aug 14 22:58:16 user nova-compute[72766]:   </nova:owner>
Aug 14 22:58:16 user nova-compute[72766]:   <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 22:58:16 user nova-compute[72766]:   <nova:ports>
Aug 14 22:58:16 user nova-compute[72766]:     <nova:port uuid="58e0b222-3a0a-40d3-ad60-e92985bd3584">
Aug 14 22:58:16 user nova-compute[72766]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 22:58:16 user nova-compute[72766]:     </nova:port>
Aug 14 22:58:16 user nova-compute[72766]:     <nova:port uuid="a886f590-4818-4e79-ad6c-785067fbff0d">
Aug 14 22:58:16 user nova-compute[72766]:       <nova:ip type="fixed" address="10.10.10.235" ipVersion="4"/>
Aug 14 22:58:16 user nova-compute[72766]:     </nova:port>
Aug 14 22:58:16 user nova-compute[72766]:   </nova:ports>
Aug 14 22:58:16 user nova-compute[72766]: </nova:instance>
Aug 14 22:58:16 user nova-compute[72766]:   </metadata>
Aug 14 22:58:16 user nova-compute[72766]:   <memory unit='KiB'>524288</memory>
Aug 14 22:58:16 user nova-compute[72766]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 14 22:58:16 user nova-compute[72766]:   <vcpu placement='static'>1</vcpu>
Aug 14 22:58:16 user nova-compute[72766]:   <resource>
Aug 14 22:58:16 user nova-compute[72766]:     <partition>/machine</partition>
Aug 14 22:58:16 user nova-compute[72766]:   </resource>
Aug 14 22:58:16 user nova-compute[72766]:   <sysinfo type='smbios'>
Aug 14 22:58:16 user nova-compute[72766]:     <system>
Aug 14 22:58:16 user nova-compute[72766]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 14 22:58:16 user nova-compute[72766]:       <entry name='product'>OpenStack Nova</entry>
Aug 14 22:58:16 user nova-compute[72766]:       <entry name='version'>0.0.0</entry>
Aug 14 22:58:16 user nova-compute[72766]:       <entry name='serial'>90b55775-2f14-4c80-b48a-b1eed2b570dc</entry>
Aug 14 22:58:16 user nova-compute[72766]:       <entry name='uuid'>90b55775-2f14-4c80-b48a-b1eed2b570dc</entry>
Aug 14 22:58:16 user nova-compute[72766]:       <entry name='family'>Virtual Machine</entry>
Aug 14 22:58:16 user nova-compute[72766]:     </system>
Aug 14 22:58:16 user nova-compute[72766]:   </sysinfo>
Aug 14 22:58:16 user nova-compute[72766]:   <os>
Aug 14 22:58:16 user nova-compute[72766]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 14 22:58:16 user nova-compute[72766]:     <boot dev='hd'/>
Aug 14 22:58:16 user nova-compute[72766]:     <smbios mode='sysinfo'/>
Aug 14 22:58:16 user nova-compute[72766]:   </os>
Aug 14 22:58:16 user nova-compute[72766]:   <features>
Aug 14 22:58:16 user nova-compute[72766]:     <acpi/>
Aug 14 22:58:16 user nova-compute[72766]:     <apic/>
Aug 14 22:58:16 user nova-compute[72766]:     <vmcoreinfo state='on'/>
Aug 14 22:58:16 user nova-compute[72766]:   </features>
Aug 14 22:58:16 user nova-compute[72766]:   <cpu mode='custom' match='exact' check='full'>
Aug 14 22:58:16 user nova-compute[72766]:     <model fallback='forbid'>Nehalem</model>
Aug 14 22:58:16 user nova-compute[72766]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 14 22:58:16 user nova-compute[72766]:     <feature policy='require' name='vme'/>
Aug 14 22:58:16 user nova-compute[72766]:     <feature policy='require' name='x2apic'/>
Aug 14 22:58:16 user nova-compute[72766]:     <feature policy='require' name='hypervisor'/>
Aug 14 22:58:16 user nova-compute[72766]:   </cpu>
Aug 14 22:58:16 user nova-compute[72766]:   <clock offset='utc'>
Aug 14 22:58:16 user nova-compute[72766]:     <timer name='pit' tickpolicy='delay'/>
Aug 14 22:58:16 user nova-compute[72766]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 14 22:58:16 user nova-compute[72766]:     <timer name='hpet' present='no'/>
Aug 14 22:58:16 user nova-compute[72766]:   </clock>
Aug 14 22:58:16 user nova-compute[72766]:   <on_poweroff>destroy</on_poweroff>
Aug 14 22:58:16 user nova-compute[72766]:   <on_reboot>restart</on_reboot>
Aug 14 22:58:16 user nova-compute[72766]:   <on_crash>destroy</on_crash>
Aug 14 22:58:16 user nova-compute[72766]:   <devices>
Aug 14 22:58:16 user nova-compute[72766]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 14 22:58:16 user nova-compute[72766]:     <disk type='file' device='disk'>
Aug 14 22:58:16 user nova-compute[72766]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 14 22:58:16 user nova-compute[72766]:       <source file='/opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc/disk' index='2'/>
Aug 14 22:58:16 user nova-compute[72766]:       <backingStore type='file' index='3'>
Aug 14 22:58:16 user nova-compute[72766]:         <format type='raw'/>
Aug 14 22:58:16 user nova-compute[72766]:         <source file='/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb'/>
Aug 14 22:58:16 user nova-compute[72766]:         <backingStore/>
Aug 14 22:58:16 user nova-compute[72766]:       </backingStore>
Aug 14 22:58:16 user nova-compute[72766]:       <target dev='vda' bus='virtio'/>
Aug 14 22:58:16 user nova-compute[72766]:       <alias name='virtio-disk0'/>
Aug 14 22:58:16 user nova-compute[72766]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 14 22:58:16 user nova-compute[72766]:     </disk>
Aug 14 22:58:16 user nova-compute[72766]:     <disk type='file' device='cdrom'>
Aug 14 22:58:16 user nova-compute[72766]:       <driver name='qemu' type='raw' cache='none'/>
Aug 14 22:58:16 user nova-compute[72766]:       <source file='/opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc/disk.config' index='1'/>
Aug 14 22:58:16 user nova-compute[72766]:       <backingStore/>
Aug 14 22:58:16 user nova-compute[72766]:       <target dev='hda' bus='ide'/>
Aug 14 22:58:16 user nova-compute[72766]:       <readonly/>
Aug 14 22:58:16 user nova-compute[72766]:       <alias name='ide0-0-0'/>
Aug 14 22:58:16 user nova-compute[72766]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 14 22:58:16 user nova-compute[72766]:     </disk>
Aug 14 22:58:16 user nova-compute[72766]:     <controller type='usb' index='0' model='none'>
Aug 14 22:58:16 user nova-compute[72766]:       <alias name='usb'/>
Aug 14 22:58:16 user nova-compute[72766]:     </controller>
Aug 14 22:58:16 user nova-compute[72766]:     <controller type='pci' index='0' model='pci-root'>
Aug 14 22:58:16 user nova-compute[72766]:       <alias name='pci.0'/>
Aug 14 22:58:16 user nova-compute[72766]:     </controller>
Aug 14 22:58:16 user nova-compute[72766]:     <controller type='ide' index='0'>
Aug 14 22:58:16 user nova-compute[72766]:       <alias name='ide'/>
Aug 14 22:58:16 user nova-compute[72766]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 14 22:58:16 user nova-compute[72766]:     </controller>
Aug 14 22:58:16 user nova-compute[72766]:     <interface type='ethernet'>
Aug 14 22:58:16 user nova-compute[72766]:       <mac address='fa:16:3e:5e:2c:02'/>
Aug 14 22:58:16 user nova-compute[72766]:       <target dev='tap58e0b222-3a'/>
Aug 14 22:58:16 user nova-compute[72766]:       <model type='virtio'/>
Aug 14 22:58:16 user nova-compute[72766]:       <mtu size='1442'/>
Aug 14 22:58:16 user nova-compute[72766]:       <alias name='net0'/>
Aug 14 22:58:16 user nova-compute[72766]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 14 22:58:16 user nova-compute[72766]:     </interface>
Aug 14 22:58:16 user nova-compute[72766]:     <serial type='pty'>
Aug 14 22:58:16 user nova-compute[72766]:       <source path='/dev/pts/5'/>
Aug 14 22:58:16 user nova-compute[72766]:       <log file='/opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc/console.log' append='off'/>
Aug 14 22:58:16 user nova-compute[72766]:       <target type='isa-serial' port='0'>
Aug 14 22:58:16 user nova-compute[72766]:         <model name='isa-serial'/>
Aug 14 22:58:16 user nova-compute[72766]:       </target>
Aug 14 22:58:16 user nova-compute[72766]:       <alias name='serial0'/>
Aug 14 22:58:16 user nova-compute[72766]:     </serial>
Aug 14 22:58:16 user nova-compute[72766]:     <console type='pty' tty='/dev/pts/5'>
Aug 14 22:58:16 user nova-compute[72766]:       <source path='/dev/pts/5'/>
Aug 14 22:58:16 user nova-compute[72766]:       <log file='/opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc/console.log' append='off'/>
Aug 14 22:58:16 user nova-compute[72766]:       <target type='serial' port='0'/>
Aug 14 22:58:16 user nova-compute[72766]:       <alias name='serial0'/>
Aug 14 22:58:16 user nova-compute[72766]:     </console>
Aug 14 22:58:16 user nova-compute[72766]:     <input type='mouse' bus='ps2'>
Aug 14 22:58:16 user nova-compute[72766]:       <alias name='input0'/>
Aug 14 22:58:16 user nova-compute[72766]:     </input>
Aug 14 22:58:16 user nova-compute[72766]:     <input type='keyboard' bus='ps2'>
Aug 14 22:58:16 user nova-compute[72766]:       <alias name='input1'/>
Aug 14 22:58:16 user nova-compute[72766]:     </input>
Aug 14 22:58:16 user nova-compute[72766]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Aug 14 22:58:16 user nova-compute[72766]:       <listen type='address' address='0.0.0.0'/>
Aug 14 22:58:16 user nova-compute[72766]:     </graphics>
Aug 14 22:58:16 user nova-compute[72766]:     <audio id='1' type='none'/>
Aug 14 22:58:16 user nova-compute[72766]:     <video>
Aug 14 22:58:16 user nova-compute[72766]:       <model type='virtio' heads='1' primary='yes'/>
Aug 14 22:58:16 user nova-compute[72766]:       <alias name='video0'/>
Aug 14 22:58:16 user nova-compute[72766]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 14 22:58:16 user nova-compute[72766]:     </video>
Aug 14 22:58:16 user nova-compute[72766]:     <memballoon model='virtio'>
Aug 14 22:58:16 user nova-compute[72766]:       <stats period='10'/>
Aug 14 22:58:16 user nova-compute[72766]:       <alias name='balloon0'/>
Aug 14 22:58:16 user nova-compute[72766]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 14 22:58:16 user nova-compute[72766]:     </memballoon>
Aug 14 22:58:16 user nova-compute[72766]:     <rng model='virtio'>
Aug 14 22:58:16 user nova-compute[72766]:       <backend model='random'>/dev/urandom</backend>
Aug 14 22:58:16 user nova-compute[72766]:       <alias name='rng0'/>
Aug 14 22:58:16 user nova-compute[72766]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 14 22:58:16 user nova-compute[72766]:     </rng>
Aug 14 22:58:16 user nova-compute[72766]:   </devices>
Aug 14 22:58:16 user nova-compute[72766]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 14 22:58:16 user nova-compute[72766]:     <label>libvirt-90b55775-2f14-4c80-b48a-b1eed2b570dc</label>
Aug 14 22:58:16 user nova-compute[72766]:     <imagelabel>libvirt-90b55775-2f14-4c80-b48a-b1eed2b570dc</imagelabel>
Aug 14 22:58:16 user nova-compute[72766]:   </seclabel>
Aug 14 22:58:16 user nova-compute[72766]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 14 22:58:16 user nova-compute[72766]:     <label>+64055:+108</label>
Aug 14 22:58:16 user nova-compute[72766]:     <imagelabel>+64055:+108</imagelabel>
Aug 14 22:58:16 user nova-compute[72766]:   </seclabel>
Aug 14 22:58:16 user nova-compute[72766]: </domain>
Aug 14 22:58:16 user nova-compute[72766]:  {{(pid=72766) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 14 22:58:16 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-d0ad2d1b-fb95-456e-b7b1-59bddd47f1f5 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Successfully detached device tapa886f590-48 from instance 90b55775-2f14-4c80-b48a-b1eed2b570dc from the live domain config.
Aug 14 22:58:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-d0ad2d1b-fb95-456e-b7b1-59bddd47f1f5 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T22:55:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-359420211',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-359420211',id=6,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8cq16Tr/aSGWtJWb/xfeRNJOb+B6LjH5taG4rznYJbzp5KjGb+MpXm0+8Y+Xs3FuiWq9fVeEhIpGtH4iqY05CSFniUjByOF+zxj8vXJaj8j0+QLFR098sJu8pYQ2V7Ow==',key_name='tempest-keypair-975754438',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:56:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d841b7f732a743658e035777c8629c50',ramdisk_id='',reservation_id='r-iogn86da',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1079325823',owner_user_name='tempest-TaggedAttachmentsTest-1079325823-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adf9d286eb5749e7a5278af949ca1a9f',uuid=90b55775-2f14-4c80-b48a-b1eed2b570dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a886f590-4818-4e79-ad6c-785067fbff0d", "address": "fa:16:3e:14:59:64", "network": {"id": "86616d0d-d4bf-4c7d-ab66-1f92f05d79d6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1584215259", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d841b7f732a743658e035777c8629c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa886f590-48", "ovs_interfaceid": "a886f590-4818-4e79-ad6c-785067fbff0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 22:58:16 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-d0ad2d1b-fb95-456e-b7b1-59bddd47f1f5 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Converting VIF {"id": "a886f590-4818-4e79-ad6c-785067fbff0d", "address": "fa:16:3e:14:59:64", "network": {"id": "86616d0d-d4bf-4c7d-ab66-1f92f05d79d6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1584215259", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d841b7f732a743658e035777c8629c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa886f590-48", "ovs_interfaceid": "a886f590-4818-4e79-ad6c-785067fbff0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:58:16 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-d0ad2d1b-fb95-456e-b7b1-59bddd47f1f5 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:59:64,bridge_name='br-int',has_traffic_filtering=True,id=a886f590-4818-4e79-ad6c-785067fbff0d,network=Network(86616d0d-d4bf-4c7d-ab66-1f92f05d79d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa886f590-48') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:58:16 user nova-compute[72766]: DEBUG os_vif [None req-d0ad2d1b-fb95-456e-b7b1-59bddd47f1f5 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:59:64,bridge_name='br-int',has_traffic_filtering=True,id=a886f590-4818-4e79-ad6c-785067fbff0d,network=Network(86616d0d-d4bf-4c7d-ab66-1f92f05d79d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa886f590-48') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 22:58:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa886f590-48, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:58:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:58:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:16 user nova-compute[72766]: INFO os_vif [None req-d0ad2d1b-fb95-456e-b7b1-59bddd47f1f5 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:59:64,bridge_name='br-int',has_traffic_filtering=True,id=a886f590-4818-4e79-ad6c-785067fbff0d,network=Network(86616d0d-d4bf-4c7d-ab66-1f92f05d79d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa886f590-48')
Aug 14 22:58:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-d0ad2d1b-fb95-456e-b7b1-59bddd47f1f5 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:58:16 user nova-compute[72766]:   <nova:package version="0.0.0"/>
Aug 14 22:58:16 user nova-compute[72766]:   <nova:name>tempest-device-tagging-server-359420211</nova:name>
Aug 14 22:58:16 user nova-compute[72766]:   <nova:creationTime>2023-08-14 22:58:16</nova:creationTime>
Aug 14 22:58:16 user nova-compute[72766]:   <nova:flavor name="m1.tiny">
Aug 14 22:58:16 user nova-compute[72766]:     <nova:memory>512</nova:memory>
Aug 14 22:58:16 user nova-compute[72766]:     <nova:disk>1</nova:disk>
Aug 14 22:58:16 user nova-compute[72766]:     <nova:swap>0</nova:swap>
Aug 14 22:58:16 user nova-compute[72766]:     <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:58:16 user nova-compute[72766]:     <nova:vcpus>1</nova:vcpus>
Aug 14 22:58:16 user nova-compute[72766]:   </nova:flavor>
Aug 14 22:58:16 user nova-compute[72766]:   <nova:owner>
Aug 14 22:58:16 user nova-compute[72766]:     <nova:user uuid="adf9d286eb5749e7a5278af949ca1a9f">tempest-TaggedAttachmentsTest-1079325823-project-member</nova:user>
Aug 14 22:58:16 user nova-compute[72766]:     <nova:project uuid="d841b7f732a743658e035777c8629c50">tempest-TaggedAttachmentsTest-1079325823</nova:project>
Aug 14 22:58:16 user nova-compute[72766]:   </nova:owner>
Aug 14 22:58:16 user nova-compute[72766]:   <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 22:58:16 user nova-compute[72766]:   <nova:ports>
Aug 14 22:58:16 user nova-compute[72766]:     <nova:port uuid="58e0b222-3a0a-40d3-ad60-e92985bd3584">
Aug 14 22:58:16 user nova-compute[72766]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 22:58:16 user nova-compute[72766]:     </nova:port>
Aug 14 22:58:16 user nova-compute[72766]:   </nova:ports>
Aug 14 22:58:16 user nova-compute[72766]: </nova:instance>
Aug 14 22:58:16 user nova-compute[72766]:  {{(pid=72766) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 14 22:58:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0850bb6c-6e3e-4007-8478-8eba53089158/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0850bb6c-6e3e-4007-8478-8eba53089158/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:17 user nova-compute[72766]: DEBUG nova.compute.manager [req-e1712d13-aac6-47ed-ac3e-dea1c231b98a req-0b2d8120-afc9-4a83-973b-c15f00a2efdf service nova] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Received event network-vif-unplugged-a886f590-4818-4e79-ad6c-785067fbff0d {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:58:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e1712d13-aac6-47ed-ac3e-dea1c231b98a req-0b2d8120-afc9-4a83-973b-c15f00a2efdf service nova] Acquiring lock "90b55775-2f14-4c80-b48a-b1eed2b570dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:58:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e1712d13-aac6-47ed-ac3e-dea1c231b98a req-0b2d8120-afc9-4a83-973b-c15f00a2efdf service nova] Lock "90b55775-2f14-4c80-b48a-b1eed2b570dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:58:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e1712d13-aac6-47ed-ac3e-dea1c231b98a req-0b2d8120-afc9-4a83-973b-c15f00a2efdf service nova] Lock "90b55775-2f14-4c80-b48a-b1eed2b570dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:58:17 user nova-compute[72766]: DEBUG nova.compute.manager [req-e1712d13-aac6-47ed-ac3e-dea1c231b98a req-0b2d8120-afc9-4a83-973b-c15f00a2efdf service nova] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] No waiting events found dispatching network-vif-unplugged-a886f590-4818-4e79-ad6c-785067fbff0d {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:58:17 user nova-compute[72766]: WARNING nova.compute.manager [req-e1712d13-aac6-47ed-ac3e-dea1c231b98a req-0b2d8120-afc9-4a83-973b-c15f00a2efdf service nova] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Received unexpected event network-vif-unplugged-a886f590-4818-4e79-ad6c-785067fbff0d for instance with vm_state active and task_state None.
Aug 14 22:58:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0850bb6c-6e3e-4007-8478-8eba53089158/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bde3ff44-cdf8-4ef7-bb7d-50865129268f/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] COPY block job progress, current cursor: 14680064 final cursor: 1073741824 {{(pid=72766) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 22:58:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bde3ff44-cdf8-4ef7-bb7d-50865129268f/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bde3ff44-cdf8-4ef7-bb7d-50865129268f/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:17 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692053882.5226176, a9d6011c-da14-4fcc-8e31-3063db57b2a6 => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:58:17 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] VM Stopped (Lifecycle Event)
Aug 14 22:58:17 user nova-compute[72766]: DEBUG nova.compute.manager [None req-b2591bba-8ffe-4e1e-9c57-46b9dfc54735 None None] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:58:17 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bde3ff44-cdf8-4ef7-bb7d-50865129268f/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:17 user nova-compute[72766]: DEBUG nova.compute.manager [req-963c75c1-5e9a-4d88-9e8f-4ef3ec93efdf req-db2faf81-e156-4794-828a-eba9443cbb93 service nova] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Received event network-vif-deleted-a886f590-4818-4e79-ad6c-785067fbff0d {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:58:17 user nova-compute[72766]: INFO nova.compute.manager [req-963c75c1-5e9a-4d88-9e8f-4ef3ec93efdf req-db2faf81-e156-4794-828a-eba9443cbb93 service nova] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Neutron deleted interface a886f590-4818-4e79-ad6c-785067fbff0d; detaching it from the instance and deleting it from the info cache
Aug 14 22:58:17 user nova-compute[72766]: DEBUG nova.network.neutron [req-963c75c1-5e9a-4d88-9e8f-4ef3ec93efdf req-db2faf81-e156-4794-828a-eba9443cbb93 service nova] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Updating instance_info_cache with network_info: [{"id": "58e0b222-3a0a-40d3-ad60-e92985bd3584", "address": "fa:16:3e:5e:2c:02", "network": {"id": "6f03ef5e-cea3-4538-9f91-e35f756665a1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1408762454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d841b7f732a743658e035777c8629c50", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e0b222-3a", "ovs_interfaceid": "58e0b222-3a0a-40d3-ad60-e92985bd3584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:58:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] COPY block job progress, current cursor: 97517568 final cursor: 1073741824 {{(pid=72766) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 22:58:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d0ad2d1b-fb95-456e-b7b1-59bddd47f1f5 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Acquiring lock "refresh_cache-90b55775-2f14-4c80-b48a-b1eed2b570dc" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:58:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d0ad2d1b-fb95-456e-b7b1-59bddd47f1f5 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Acquired lock "refresh_cache-90b55775-2f14-4c80-b48a-b1eed2b570dc" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:58:17 user nova-compute[72766]: DEBUG nova.network.neutron [None req-d0ad2d1b-fb95-456e-b7b1-59bddd47f1f5 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:58:17 user nova-compute[72766]: DEBUG nova.objects.instance [req-963c75c1-5e9a-4d88-9e8f-4ef3ec93efdf req-db2faf81-e156-4794-828a-eba9443cbb93 service nova] Lazy-loading 'system_metadata' on Instance uuid 90b55775-2f14-4c80-b48a-b1eed2b570dc {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:58:17 user nova-compute[72766]: DEBUG nova.objects.instance [req-963c75c1-5e9a-4d88-9e8f-4ef3ec93efdf req-db2faf81-e156-4794-828a-eba9443cbb93 service nova] Lazy-loading 'flavor' on Instance uuid 90b55775-2f14-4c80-b48a-b1eed2b570dc {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:58:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [req-963c75c1-5e9a-4d88-9e8f-4ef3ec93efdf req-db2faf81-e156-4794-828a-eba9443cbb93 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T22:55:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-359420211',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-359420211',id=6,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8cq16Tr/aSGWtJWb/xfeRNJOb+B6LjH5taG4rznYJbzp5KjGb+MpXm0+8Y+Xs3FuiWq9fVeEhIpGtH4iqY05CSFniUjByOF+zxj8vXJaj8j0+QLFR098sJu8pYQ2V7Ow==',key_name='tempest-keypair-975754438',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:56:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d841b7f732a743658e035777c8629c50',ramdisk_id='',reservation_id='r-iogn86da',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1079325823',owner_user_name='tempest-TaggedAttachmentsTest-1079325823-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adf9d286eb5749e7a5278af949ca1a9f',uuid=90b55775-2f14-4c80-b48a-b1eed2b570dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a886f590-4818-4e79-ad6c-785067fbff0d", "address": "fa:16:3e:14:59:64", "network": {"id": "86616d0d-d4bf-4c7d-ab66-1f92f05d79d6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1584215259", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d841b7f732a743658e035777c8629c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa886f590-48", "ovs_interfaceid": "a886f590-4818-4e79-ad6c-785067fbff0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 22:58:17 user nova-compute[72766]: DEBUG nova.network.os_vif_util [req-963c75c1-5e9a-4d88-9e8f-4ef3ec93efdf req-db2faf81-e156-4794-828a-eba9443cbb93 service nova] Converting VIF {"id": "a886f590-4818-4e79-ad6c-785067fbff0d", "address": "fa:16:3e:14:59:64", "network": {"id": "86616d0d-d4bf-4c7d-ab66-1f92f05d79d6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1584215259", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d841b7f732a743658e035777c8629c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa886f590-48", "ovs_interfaceid": "a886f590-4818-4e79-ad6c-785067fbff0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:58:17 user nova-compute[72766]: DEBUG nova.network.os_vif_util [req-963c75c1-5e9a-4d88-9e8f-4ef3ec93efdf req-db2faf81-e156-4794-828a-eba9443cbb93 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:59:64,bridge_name='br-int',has_traffic_filtering=True,id=a886f590-4818-4e79-ad6c-785067fbff0d,network=Network(86616d0d-d4bf-4c7d-ab66-1f92f05d79d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa886f590-48') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:58:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [req-963c75c1-5e9a-4d88-9e8f-4ef3ec93efdf req-db2faf81-e156-4794-828a-eba9443cbb93 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:14:59:64"/><model type="virtio"/><mtu size="1442"/><target dev="tapa886f590-48"/></interface> {{(pid=72766) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 14 22:58:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [req-963c75c1-5e9a-4d88-9e8f-4ef3ec93efdf req-db2faf81-e156-4794-828a-eba9443cbb93 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:14:59:64"/><model type="virtio"/><mtu size="1442"/><target dev="tapa886f590-48"/></interface>not found in domain: <domain type='kvm' id='6'>
Aug 14 22:58:17 user nova-compute[72766]:   <name>instance-00000006</name>
Aug 14 22:58:17 user nova-compute[72766]:   <uuid>90b55775-2f14-4c80-b48a-b1eed2b570dc</uuid>
Aug 14 22:58:17 user nova-compute[72766]:   <metadata>
Aug 14 22:58:17 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:58:17 user nova-compute[72766]:   <nova:package version="0.0.0"/>
Aug 14 22:58:17 user nova-compute[72766]:   <nova:name>tempest-device-tagging-server-359420211</nova:name>
Aug 14 22:58:17 user nova-compute[72766]:   <nova:creationTime>2023-08-14 22:58:16</nova:creationTime>
Aug 14 22:58:17 user nova-compute[72766]:   <nova:flavor name="m1.tiny">
Aug 14 22:58:17 user nova-compute[72766]:     <nova:memory>512</nova:memory>
Aug 14 22:58:17 user nova-compute[72766]:     <nova:disk>1</nova:disk>
Aug 14 22:58:17 user nova-compute[72766]:     <nova:swap>0</nova:swap>
Aug 14 22:58:17 user nova-compute[72766]:     <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:58:17 user nova-compute[72766]:     <nova:vcpus>1</nova:vcpus>
Aug 14 22:58:17 user nova-compute[72766]:   </nova:flavor>
Aug 14 22:58:17 user nova-compute[72766]:   <nova:owner>
Aug 14 22:58:17 user nova-compute[72766]:     <nova:user uuid="adf9d286eb5749e7a5278af949ca1a9f">tempest-TaggedAttachmentsTest-1079325823-project-member</nova:user>
Aug 14 22:58:17 user nova-compute[72766]:     <nova:project uuid="d841b7f732a743658e035777c8629c50">tempest-TaggedAttachmentsTest-1079325823</nova:project>
Aug 14 22:58:17 user nova-compute[72766]:   </nova:owner>
Aug 14 22:58:17 user nova-compute[72766]:   <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 22:58:17 user nova-compute[72766]:   <nova:ports>
Aug 14 22:58:17 user nova-compute[72766]:     <nova:port uuid="58e0b222-3a0a-40d3-ad60-e92985bd3584">
Aug 14 22:58:17 user nova-compute[72766]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 22:58:17 user nova-compute[72766]:     </nova:port>
Aug 14 22:58:17 user nova-compute[72766]:   </nova:ports>
Aug 14 22:58:17 user nova-compute[72766]: </nova:instance>
Aug 14 22:58:17 user nova-compute[72766]:   </metadata>
Aug 14 22:58:17 user nova-compute[72766]:   <memory unit='KiB'>524288</memory>
Aug 14 22:58:17 user nova-compute[72766]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 14 22:58:17 user nova-compute[72766]:   <vcpu placement='static'>1</vcpu>
Aug 14 22:58:17 user nova-compute[72766]:   <resource>
Aug 14 22:58:17 user nova-compute[72766]:     <partition>/machine</partition>
Aug 14 22:58:17 user nova-compute[72766]:   </resource>
Aug 14 22:58:17 user nova-compute[72766]:   <sysinfo type='smbios'>
Aug 14 22:58:17 user nova-compute[72766]:     <system>
Aug 14 22:58:17 user nova-compute[72766]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 14 22:58:17 user nova-compute[72766]:       <entry name='product'>OpenStack Nova</entry>
Aug 14 22:58:17 user nova-compute[72766]:       <entry name='version'>0.0.0</entry>
Aug 14 22:58:17 user nova-compute[72766]:       <entry name='serial'>90b55775-2f14-4c80-b48a-b1eed2b570dc</entry>
Aug 14 22:58:17 user nova-compute[72766]:       <entry name='uuid'>90b55775-2f14-4c80-b48a-b1eed2b570dc</entry>
Aug 14 22:58:17 user nova-compute[72766]:       <entry name='family'>Virtual Machine</entry>
Aug 14 22:58:17 user nova-compute[72766]:     </system>
Aug 14 22:58:17 user nova-compute[72766]:   </sysinfo>
Aug 14 22:58:17 user nova-compute[72766]:   <os>
Aug 14 22:58:17 user nova-compute[72766]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 14 22:58:17 user nova-compute[72766]:     <boot dev='hd'/>
Aug 14 22:58:17 user nova-compute[72766]:     <smbios mode='sysinfo'/>
Aug 14 22:58:17 user nova-compute[72766]:   </os>
Aug 14 22:58:17 user nova-compute[72766]:   <features>
Aug 14 22:58:17 user nova-compute[72766]:     <acpi/>
Aug 14 22:58:17 user nova-compute[72766]:     <apic/>
Aug 14 22:58:17 user nova-compute[72766]:     <vmcoreinfo state='on'/>
Aug 14 22:58:17 user nova-compute[72766]:   </features>
Aug 14 22:58:17 user nova-compute[72766]:   <cpu mode='custom' match='exact' check='full'>
Aug 14 22:58:17 user nova-compute[72766]:     <model fallback='forbid'>Nehalem</model>
Aug 14 22:58:17 user nova-compute[72766]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 14 22:58:17 user nova-compute[72766]:     <feature policy='require' name='vme'/>
Aug 14 22:58:17 user nova-compute[72766]:     <feature policy='require' name='x2apic'/>
Aug 14 22:58:17 user nova-compute[72766]:     <feature policy='require' name='hypervisor'/>
Aug 14 22:58:17 user nova-compute[72766]:   </cpu>
Aug 14 22:58:17 user nova-compute[72766]:   <clock offset='utc'>
Aug 14 22:58:17 user nova-compute[72766]:     <timer name='pit' tickpolicy='delay'/>
Aug 14 22:58:17 user nova-compute[72766]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 14 22:58:17 user nova-compute[72766]:     <timer name='hpet' present='no'/>
Aug 14 22:58:17 user nova-compute[72766]:   </clock>
Aug 14 22:58:17 user nova-compute[72766]:   <on_poweroff>destroy</on_poweroff>
Aug 14 22:58:17 user nova-compute[72766]:   <on_reboot>restart</on_reboot>
Aug 14 22:58:17 user nova-compute[72766]:   <on_crash>destroy</on_crash>
Aug 14 22:58:17 user nova-compute[72766]:   <devices>
Aug 14 22:58:17 user nova-compute[72766]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 14 22:58:17 user nova-compute[72766]:     <disk type='file' device='disk'>
Aug 14 22:58:17 user nova-compute[72766]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 14 22:58:17 user nova-compute[72766]:       <source file='/opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc/disk' index='2'/>
Aug 14 22:58:17 user nova-compute[72766]:       <backingStore type='file' index='3'>
Aug 14 22:58:17 user nova-compute[72766]:         <format type='raw'/>
Aug 14 22:58:17 user nova-compute[72766]:         <source file='/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb'/>
Aug 14 22:58:17 user nova-compute[72766]:         <backingStore/>
Aug 14 22:58:17 user nova-compute[72766]:       </backingStore>
Aug 14 22:58:17 user nova-compute[72766]:       <target dev='vda' bus='virtio'/>
Aug 14 22:58:17 user nova-compute[72766]:       <alias name='virtio-disk0'/>
Aug 14 22:58:17 user nova-compute[72766]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 14 22:58:17 user nova-compute[72766]:     </disk>
Aug 14 22:58:17 user nova-compute[72766]:     <disk type='file' device='cdrom'>
Aug 14 22:58:17 user nova-compute[72766]:       <driver name='qemu' type='raw' cache='none'/>
Aug 14 22:58:17 user nova-compute[72766]:       <source file='/opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc/disk.config' index='1'/>
Aug 14 22:58:17 user nova-compute[72766]:       <backingStore/>
Aug 14 22:58:17 user nova-compute[72766]:       <target dev='hda' bus='ide'/>
Aug 14 22:58:17 user nova-compute[72766]:       <readonly/>
Aug 14 22:58:17 user nova-compute[72766]:       <alias name='ide0-0-0'/>
Aug 14 22:58:17 user nova-compute[72766]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 14 22:58:17 user nova-compute[72766]:     </disk>
Aug 14 22:58:17 user nova-compute[72766]:     <controller type='usb' index='0' model='none'>
Aug 14 22:58:17 user nova-compute[72766]:       <alias name='usb'/>
Aug 14 22:58:17 user nova-compute[72766]:     </controller>
Aug 14 22:58:17 user nova-compute[72766]:     <controller type='pci' index='0' model='pci-root'>
Aug 14 22:58:17 user nova-compute[72766]:       <alias name='pci.0'/>
Aug 14 22:58:17 user nova-compute[72766]:     </controller>
Aug 14 22:58:17 user nova-compute[72766]:     <controller type='ide' index='0'>
Aug 14 22:58:17 user nova-compute[72766]:       <alias name='ide'/>
Aug 14 22:58:17 user nova-compute[72766]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 14 22:58:17 user nova-compute[72766]:     </controller>
Aug 14 22:58:17 user nova-compute[72766]:     <interface type='ethernet'>
Aug 14 22:58:17 user nova-compute[72766]:       <mac address='fa:16:3e:5e:2c:02'/>
Aug 14 22:58:17 user nova-compute[72766]:       <target dev='tap58e0b222-3a'/>
Aug 14 22:58:17 user nova-compute[72766]:       <model type='virtio'/>
Aug 14 22:58:17 user nova-compute[72766]:       <mtu size='1442'/>
Aug 14 22:58:17 user nova-compute[72766]:       <alias name='net0'/>
Aug 14 22:58:17 user nova-compute[72766]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 14 22:58:17 user nova-compute[72766]:     </interface>
Aug 14 22:58:17 user nova-compute[72766]:     <serial type='pty'>
Aug 14 22:58:17 user nova-compute[72766]:       <source path='/dev/pts/5'/>
Aug 14 22:58:17 user nova-compute[72766]:       <log file='/opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc/console.log' append='off'/>
Aug 14 22:58:17 user nova-compute[72766]:       <target type='isa-serial' port='0'>
Aug 14 22:58:17 user nova-compute[72766]:         <model name='isa-serial'/>
Aug 14 22:58:17 user nova-compute[72766]:       </target>
Aug 14 22:58:17 user nova-compute[72766]:       <alias name='serial0'/>
Aug 14 22:58:17 user nova-compute[72766]:     </serial>
Aug 14 22:58:17 user nova-compute[72766]:     <console type='pty' tty='/dev/pts/5'>
Aug 14 22:58:17 user nova-compute[72766]:       <source path='/dev/pts/5'/>
Aug 14 22:58:17 user nova-compute[72766]:       <log file='/opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc/console.log' append='off'/>
Aug 14 22:58:17 user nova-compute[72766]:       <target type='serial' port='0'/>
Aug 14 22:58:17 user nova-compute[72766]:       <alias name='serial0'/>
Aug 14 22:58:17 user nova-compute[72766]:     </console>
Aug 14 22:58:17 user nova-compute[72766]:     <input type='mouse' bus='ps2'>
Aug 14 22:58:17 user nova-compute[72766]:       <alias name='input0'/>
Aug 14 22:58:17 user nova-compute[72766]:     </input>
Aug 14 22:58:17 user nova-compute[72766]:     <input type='keyboard' bus='ps2'>
Aug 14 22:58:17 user nova-compute[72766]:       <alias name='input1'/>
Aug 14 22:58:17 user nova-compute[72766]:     </input>
Aug 14 22:58:17 user nova-compute[72766]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Aug 14 22:58:17 user nova-compute[72766]:       <listen type='address' address='0.0.0.0'/>
Aug 14 22:58:17 user nova-compute[72766]:     </graphics>
Aug 14 22:58:17 user nova-compute[72766]:     <audio id='1' type='none'/>
Aug 14 22:58:17 user nova-compute[72766]:     <video>
Aug 14 22:58:17 user nova-compute[72766]:       <model type='virtio' heads='1' primary='yes'/>
Aug 14 22:58:17 user nova-compute[72766]:       <alias name='video0'/>
Aug 14 22:58:17 user nova-compute[72766]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 14 22:58:17 user nova-compute[72766]:     </video>
Aug 14 22:58:17 user nova-compute[72766]:     <memballoon model='virtio'>
Aug 14 22:58:17 user nova-compute[72766]:       <stats period='10'/>
Aug 14 22:58:17 user nova-compute[72766]:       <alias name='balloon0'/>
Aug 14 22:58:17 user nova-compute[72766]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 14 22:58:17 user nova-compute[72766]:     </memballoon>
Aug 14 22:58:17 user nova-compute[72766]:     <rng model='virtio'>
Aug 14 22:58:17 user nova-compute[72766]:       <backend model='random'>/dev/urandom</backend>
Aug 14 22:58:17 user nova-compute[72766]:       <alias name='rng0'/>
Aug 14 22:58:17 user nova-compute[72766]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 14 22:58:17 user nova-compute[72766]:     </rng>
Aug 14 22:58:17 user nova-compute[72766]:   </devices>
Aug 14 22:58:17 user nova-compute[72766]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 14 22:58:17 user nova-compute[72766]:     <label>libvirt-90b55775-2f14-4c80-b48a-b1eed2b570dc</label>
Aug 14 22:58:17 user nova-compute[72766]:     <imagelabel>libvirt-90b55775-2f14-4c80-b48a-b1eed2b570dc</imagelabel>
Aug 14 22:58:17 user nova-compute[72766]:   </seclabel>
Aug 14 22:58:17 user nova-compute[72766]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 14 22:58:17 user nova-compute[72766]:     <label>+64055:+108</label>
Aug 14 22:58:17 user nova-compute[72766]:     <imagelabel>+64055:+108</imagelabel>
Aug 14 22:58:17 user nova-compute[72766]:   </seclabel>
Aug 14 22:58:17 user nova-compute[72766]: </domain>
Aug 14 22:58:17 user nova-compute[72766]:  {{(pid=72766) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 14 22:58:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [req-963c75c1-5e9a-4d88-9e8f-4ef3ec93efdf req-db2faf81-e156-4794-828a-eba9443cbb93 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:14:59:64"/><model type="virtio"/><mtu size="1442"/><target dev="tapa886f590-48"/></interface> {{(pid=72766) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 14 22:58:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [req-963c75c1-5e9a-4d88-9e8f-4ef3ec93efdf req-db2faf81-e156-4794-828a-eba9443cbb93 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:14:59:64"/><model type="virtio"/><mtu size="1442"/><target dev="tapa886f590-48"/></interface>not found in domain: <domain type='kvm' id='6'>
Aug 14 22:58:17 user nova-compute[72766]:   <name>instance-00000006</name>
Aug 14 22:58:17 user nova-compute[72766]:   <uuid>90b55775-2f14-4c80-b48a-b1eed2b570dc</uuid>
Aug 14 22:58:17 user nova-compute[72766]:   <metadata>
Aug 14 22:58:17 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:58:17 user nova-compute[72766]:   <nova:package version="0.0.0"/>
Aug 14 22:58:17 user nova-compute[72766]:   <nova:name>tempest-device-tagging-server-359420211</nova:name>
Aug 14 22:58:17 user nova-compute[72766]:   <nova:creationTime>2023-08-14 22:58:16</nova:creationTime>
Aug 14 22:58:17 user nova-compute[72766]:   <nova:flavor name="m1.tiny">
Aug 14 22:58:17 user nova-compute[72766]:     <nova:memory>512</nova:memory>
Aug 14 22:58:17 user nova-compute[72766]:     <nova:disk>1</nova:disk>
Aug 14 22:58:17 user nova-compute[72766]:     <nova:swap>0</nova:swap>
Aug 14 22:58:17 user nova-compute[72766]:     <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:58:17 user nova-compute[72766]:     <nova:vcpus>1</nova:vcpus>
Aug 14 22:58:17 user nova-compute[72766]:   </nova:flavor>
Aug 14 22:58:17 user nova-compute[72766]:   <nova:owner>
Aug 14 22:58:17 user nova-compute[72766]:     <nova:user uuid="adf9d286eb5749e7a5278af949ca1a9f">tempest-TaggedAttachmentsTest-1079325823-project-member</nova:user>
Aug 14 22:58:17 user nova-compute[72766]:     <nova:project uuid="d841b7f732a743658e035777c8629c50">tempest-TaggedAttachmentsTest-1079325823</nova:project>
Aug 14 22:58:17 user nova-compute[72766]:   </nova:owner>
Aug 14 22:58:17 user nova-compute[72766]:   <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 22:58:17 user nova-compute[72766]:   <nova:ports>
Aug 14 22:58:17 user nova-compute[72766]:     <nova:port uuid="58e0b222-3a0a-40d3-ad60-e92985bd3584">
Aug 14 22:58:17 user nova-compute[72766]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 22:58:17 user nova-compute[72766]:     </nova:port>
Aug 14 22:58:17 user nova-compute[72766]:   </nova:ports>
Aug 14 22:58:17 user nova-compute[72766]: </nova:instance>
Aug 14 22:58:17 user nova-compute[72766]:   </metadata>
Aug 14 22:58:17 user nova-compute[72766]:   <memory unit='KiB'>524288</memory>
Aug 14 22:58:17 user nova-compute[72766]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 14 22:58:17 user nova-compute[72766]:   <vcpu placement='static'>1</vcpu>
Aug 14 22:58:17 user nova-compute[72766]:   <resource>
Aug 14 22:58:17 user nova-compute[72766]:     <partition>/machine</partition>
Aug 14 22:58:17 user nova-compute[72766]:   </resource>
Aug 14 22:58:17 user nova-compute[72766]:   <sysinfo type='smbios'>
Aug 14 22:58:17 user nova-compute[72766]:     <system>
Aug 14 22:58:17 user nova-compute[72766]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 14 22:58:17 user nova-compute[72766]:       <entry name='product'>OpenStack Nova</entry>
Aug 14 22:58:17 user nova-compute[72766]:       <entry name='version'>0.0.0</entry>
Aug 14 22:58:17 user nova-compute[72766]:       <entry name='serial'>90b55775-2f14-4c80-b48a-b1eed2b570dc</entry>
Aug 14 22:58:17 user nova-compute[72766]:       <entry name='uuid'>90b55775-2f14-4c80-b48a-b1eed2b570dc</entry>
Aug 14 22:58:17 user nova-compute[72766]:       <entry name='family'>Virtual Machine</entry>
Aug 14 22:58:17 user nova-compute[72766]:     </system>
Aug 14 22:58:17 user nova-compute[72766]:   </sysinfo>
Aug 14 22:58:17 user nova-compute[72766]:   <os>
Aug 14 22:58:17 user nova-compute[72766]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 14 22:58:17 user nova-compute[72766]:     <boot dev='hd'/>
Aug 14 22:58:17 user nova-compute[72766]:     <smbios mode='sysinfo'/>
Aug 14 22:58:17 user nova-compute[72766]:   </os>
Aug 14 22:58:17 user nova-compute[72766]:   <features>
Aug 14 22:58:17 user nova-compute[72766]:     <acpi/>
Aug 14 22:58:17 user nova-compute[72766]:     <apic/>
Aug 14 22:58:17 user nova-compute[72766]:     <vmcoreinfo state='on'/>
Aug 14 22:58:17 user nova-compute[72766]:   </features>
Aug 14 22:58:17 user nova-compute[72766]:   <cpu mode='custom' match='exact' check='full'>
Aug 14 22:58:17 user nova-compute[72766]:     <model fallback='forbid'>Nehalem</model>
Aug 14 22:58:17 user nova-compute[72766]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 14 22:58:17 user nova-compute[72766]:     <feature policy='require' name='vme'/>
Aug 14 22:58:17 user nova-compute[72766]:     <feature policy='require' name='x2apic'/>
Aug 14 22:58:17 user nova-compute[72766]:     <feature policy='require' name='hypervisor'/>
Aug 14 22:58:17 user nova-compute[72766]:   </cpu>
Aug 14 22:58:17 user nova-compute[72766]:   <clock offset='utc'>
Aug 14 22:58:17 user nova-compute[72766]:     <timer name='pit' tickpolicy='delay'/>
Aug 14 22:58:17 user nova-compute[72766]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 14 22:58:17 user nova-compute[72766]:     <timer name='hpet' present='no'/>
Aug 14 22:58:17 user nova-compute[72766]:   </clock>
Aug 14 22:58:17 user nova-compute[72766]:   <on_poweroff>destroy</on_poweroff>
Aug 14 22:58:17 user nova-compute[72766]:   <on_reboot>restart</on_reboot>
Aug 14 22:58:17 user nova-compute[72766]:   <on_crash>destroy</on_crash>
Aug 14 22:58:17 user nova-compute[72766]:   <devices>
Aug 14 22:58:17 user nova-compute[72766]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 14 22:58:17 user nova-compute[72766]:     <disk type='file' device='disk'>
Aug 14 22:58:17 user nova-compute[72766]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 14 22:58:17 user nova-compute[72766]:       <source file='/opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc/disk' index='2'/>
Aug 14 22:58:17 user nova-compute[72766]:       <backingStore type='file' index='3'>
Aug 14 22:58:17 user nova-compute[72766]:         <format type='raw'/>
Aug 14 22:58:17 user nova-compute[72766]:         <source file='/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb'/>
Aug 14 22:58:17 user nova-compute[72766]:         <backingStore/>
Aug 14 22:58:17 user nova-compute[72766]:       </backingStore>
Aug 14 22:58:17 user nova-compute[72766]:       <target dev='vda' bus='virtio'/>
Aug 14 22:58:17 user nova-compute[72766]:       <alias name='virtio-disk0'/>
Aug 14 22:58:17 user nova-compute[72766]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 14 22:58:17 user nova-compute[72766]:     </disk>
Aug 14 22:58:17 user nova-compute[72766]:     <disk type='file' device='cdrom'>
Aug 14 22:58:17 user nova-compute[72766]:       <driver name='qemu' type='raw' cache='none'/>
Aug 14 22:58:17 user nova-compute[72766]:       <source file='/opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc/disk.config' index='1'/>
Aug 14 22:58:17 user nova-compute[72766]:       <backingStore/>
Aug 14 22:58:17 user nova-compute[72766]:       <target dev='hda' bus='ide'/>
Aug 14 22:58:17 user nova-compute[72766]:       <readonly/>
Aug 14 22:58:17 user nova-compute[72766]:       <alias name='ide0-0-0'/>
Aug 14 22:58:17 user nova-compute[72766]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 14 22:58:17 user nova-compute[72766]:     </disk>
Aug 14 22:58:17 user nova-compute[72766]:     <controller type='usb' index='0' model='none'>
Aug 14 22:58:17 user nova-compute[72766]:       <alias name='usb'/>
Aug 14 22:58:17 user nova-compute[72766]:     </controller>
Aug 14 22:58:17 user nova-compute[72766]:     <controller type='pci' index='0' model='pci-root'>
Aug 14 22:58:17 user nova-compute[72766]:       <alias name='pci.0'/>
Aug 14 22:58:17 user nova-compute[72766]:     </controller>
Aug 14 22:58:17 user nova-compute[72766]:     <controller type='ide' index='0'>
Aug 14 22:58:17 user nova-compute[72766]:       <alias name='ide'/>
Aug 14 22:58:17 user nova-compute[72766]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 14 22:58:17 user nova-compute[72766]:     </controller>
Aug 14 22:58:17 user nova-compute[72766]:     <interface type='ethernet'>
Aug 14 22:58:17 user nova-compute[72766]:       <mac address='fa:16:3e:5e:2c:02'/>
Aug 14 22:58:17 user nova-compute[72766]:       <target dev='tap58e0b222-3a'/>
Aug 14 22:58:17 user nova-compute[72766]:       <model type='virtio'/>
Aug 14 22:58:17 user nova-compute[72766]:       <mtu size='1442'/>
Aug 14 22:58:17 user nova-compute[72766]:       <alias name='net0'/>
Aug 14 22:58:17 user nova-compute[72766]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 14 22:58:17 user nova-compute[72766]:     </interface>
Aug 14 22:58:17 user nova-compute[72766]:     <serial type='pty'>
Aug 14 22:58:17 user nova-compute[72766]:       <source path='/dev/pts/5'/>
Aug 14 22:58:17 user nova-compute[72766]:       <log file='/opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc/console.log' append='off'/>
Aug 14 22:58:17 user nova-compute[72766]:       <target type='isa-serial' port='0'>
Aug 14 22:58:17 user nova-compute[72766]:         <model name='isa-serial'/>
Aug 14 22:58:17 user nova-compute[72766]:       </target>
Aug 14 22:58:17 user nova-compute[72766]:       <alias name='serial0'/>
Aug 14 22:58:17 user nova-compute[72766]:     </serial>
Aug 14 22:58:17 user nova-compute[72766]:     <console type='pty' tty='/dev/pts/5'>
Aug 14 22:58:17 user nova-compute[72766]:       <source path='/dev/pts/5'/>
Aug 14 22:58:17 user nova-compute[72766]:       <log file='/opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc/console.log' append='off'/>
Aug 14 22:58:17 user nova-compute[72766]:       <target type='serial' port='0'/>
Aug 14 22:58:17 user nova-compute[72766]:       <alias name='serial0'/>
Aug 14 22:58:17 user nova-compute[72766]:     </console>
Aug 14 22:58:17 user nova-compute[72766]:     <input type='mouse' bus='ps2'>
Aug 14 22:58:17 user nova-compute[72766]:       <alias name='input0'/>
Aug 14 22:58:17 user nova-compute[72766]:     </input>
Aug 14 22:58:17 user nova-compute[72766]:     <input type='keyboard' bus='ps2'>
Aug 14 22:58:17 user nova-compute[72766]:       <alias name='input1'/>
Aug 14 22:58:17 user nova-compute[72766]:     </input>
Aug 14 22:58:17 user nova-compute[72766]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Aug 14 22:58:17 user nova-compute[72766]:       <listen type='address' address='0.0.0.0'/>
Aug 14 22:58:17 user nova-compute[72766]:     </graphics>
Aug 14 22:58:17 user nova-compute[72766]:     <audio id='1' type='none'/>
Aug 14 22:58:17 user nova-compute[72766]:     <video>
Aug 14 22:58:17 user nova-compute[72766]:       <model type='virtio' heads='1' primary='yes'/>
Aug 14 22:58:17 user nova-compute[72766]:       <alias name='video0'/>
Aug 14 22:58:17 user nova-compute[72766]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 14 22:58:17 user nova-compute[72766]:     </video>
Aug 14 22:58:17 user nova-compute[72766]:     <memballoon model='virtio'>
Aug 14 22:58:17 user nova-compute[72766]:       <stats period='10'/>
Aug 14 22:58:17 user nova-compute[72766]:       <alias name='balloon0'/>
Aug 14 22:58:17 user nova-compute[72766]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 14 22:58:17 user nova-compute[72766]:     </memballoon>
Aug 14 22:58:17 user nova-compute[72766]:     <rng model='virtio'>
Aug 14 22:58:17 user nova-compute[72766]:       <backend model='random'>/dev/urandom</backend>
Aug 14 22:58:17 user nova-compute[72766]:       <alias name='rng0'/>
Aug 14 22:58:17 user nova-compute[72766]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 14 22:58:17 user nova-compute[72766]:     </rng>
Aug 14 22:58:17 user nova-compute[72766]:   </devices>
Aug 14 22:58:17 user nova-compute[72766]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 14 22:58:17 user nova-compute[72766]:     <label>libvirt-90b55775-2f14-4c80-b48a-b1eed2b570dc</label>
Aug 14 22:58:17 user nova-compute[72766]:     <imagelabel>libvirt-90b55775-2f14-4c80-b48a-b1eed2b570dc</imagelabel>
Aug 14 22:58:17 user nova-compute[72766]:   </seclabel>
Aug 14 22:58:17 user nova-compute[72766]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 14 22:58:17 user nova-compute[72766]:     <label>+64055:+108</label>
Aug 14 22:58:17 user nova-compute[72766]:     <imagelabel>+64055:+108</imagelabel>
Aug 14 22:58:17 user nova-compute[72766]:   </seclabel>
Aug 14 22:58:17 user nova-compute[72766]: </domain>
Aug 14 22:58:17 user nova-compute[72766]:  {{(pid=72766) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 14 22:58:17 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [req-963c75c1-5e9a-4d88-9e8f-4ef3ec93efdf req-db2faf81-e156-4794-828a-eba9443cbb93 service nova] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Detaching interface fa:16:3e:14:59:64 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapa886f590-48' not found.
Aug 14 22:58:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [req-963c75c1-5e9a-4d88-9e8f-4ef3ec93efdf req-db2faf81-e156-4794-828a-eba9443cbb93 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T22:55:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-359420211',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-359420211',id=6,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8cq16Tr/aSGWtJWb/xfeRNJOb+B6LjH5taG4rznYJbzp5KjGb+MpXm0+8Y+Xs3FuiWq9fVeEhIpGtH4iqY05CSFniUjByOF+zxj8vXJaj8j0+QLFR098sJu8pYQ2V7Ow==',key_name='tempest-keypair-975754438',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:56:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d841b7f732a743658e035777c8629c50',ramdisk_id='',reservation_id='r-iogn86da',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1079325823',owner_user_name='tempest-TaggedAttachmentsTest-1079325823-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adf9d286eb5749e7a5278af949ca1a9f',uuid=90b55775-2f14-4c80-b48a-b1eed2b570dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a886f590-4818-4e79-ad6c-785067fbff0d", "address": "fa:16:3e:14:59:64", "network": {"id": "86616d0d-d4bf-4c7d-ab66-1f92f05d79d6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1584215259", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d841b7f732a743658e035777c8629c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa886f590-48", "ovs_interfaceid": "a886f590-4818-4e79-ad6c-785067fbff0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 22:58:17 user nova-compute[72766]: DEBUG nova.network.os_vif_util [req-963c75c1-5e9a-4d88-9e8f-4ef3ec93efdf req-db2faf81-e156-4794-828a-eba9443cbb93 service nova] Converting VIF {"id": "a886f590-4818-4e79-ad6c-785067fbff0d", "address": "fa:16:3e:14:59:64", "network": {"id": "86616d0d-d4bf-4c7d-ab66-1f92f05d79d6", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1584215259", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d841b7f732a743658e035777c8629c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa886f590-48", "ovs_interfaceid": "a886f590-4818-4e79-ad6c-785067fbff0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:58:17 user nova-compute[72766]: DEBUG nova.network.os_vif_util [req-963c75c1-5e9a-4d88-9e8f-4ef3ec93efdf req-db2faf81-e156-4794-828a-eba9443cbb93 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:59:64,bridge_name='br-int',has_traffic_filtering=True,id=a886f590-4818-4e79-ad6c-785067fbff0d,network=Network(86616d0d-d4bf-4c7d-ab66-1f92f05d79d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa886f590-48') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:58:17 user nova-compute[72766]: DEBUG os_vif [req-963c75c1-5e9a-4d88-9e8f-4ef3ec93efdf req-db2faf81-e156-4794-828a-eba9443cbb93 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:59:64,bridge_name='br-int',has_traffic_filtering=True,id=a886f590-4818-4e79-ad6c-785067fbff0d,network=Network(86616d0d-d4bf-4c7d-ab66-1f92f05d79d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa886f590-48') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 22:58:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:17 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:17 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa886f590-48, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:58:17 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 22:58:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:18 user nova-compute[72766]: INFO os_vif [req-963c75c1-5e9a-4d88-9e8f-4ef3ec93efdf req-db2faf81-e156-4794-828a-eba9443cbb93 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:59:64,bridge_name='br-int',has_traffic_filtering=True,id=a886f590-4818-4e79-ad6c-785067fbff0d,network=Network(86616d0d-d4bf-4c7d-ab66-1f92f05d79d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa886f590-48')
Aug 14 22:58:18 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [req-963c75c1-5e9a-4d88-9e8f-4ef3ec93efdf req-db2faf81-e156-4794-828a-eba9443cbb93 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:58:18 user nova-compute[72766]:   <nova:package version="0.0.0"/>
Aug 14 22:58:18 user nova-compute[72766]:   <nova:name>tempest-device-tagging-server-359420211</nova:name>
Aug 14 22:58:18 user nova-compute[72766]:   <nova:creationTime>2023-08-14 22:58:18</nova:creationTime>
Aug 14 22:58:18 user nova-compute[72766]:   <nova:flavor name="m1.tiny">
Aug 14 22:58:18 user nova-compute[72766]:     <nova:memory>512</nova:memory>
Aug 14 22:58:18 user nova-compute[72766]:     <nova:disk>1</nova:disk>
Aug 14 22:58:18 user nova-compute[72766]:     <nova:swap>0</nova:swap>
Aug 14 22:58:18 user nova-compute[72766]:     <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:58:18 user nova-compute[72766]:     <nova:vcpus>1</nova:vcpus>
Aug 14 22:58:18 user nova-compute[72766]:   </nova:flavor>
Aug 14 22:58:18 user nova-compute[72766]:   <nova:owner>
Aug 14 22:58:18 user nova-compute[72766]:     <nova:user uuid="adf9d286eb5749e7a5278af949ca1a9f">tempest-TaggedAttachmentsTest-1079325823-project-member</nova:user>
Aug 14 22:58:18 user nova-compute[72766]:     <nova:project uuid="d841b7f732a743658e035777c8629c50">tempest-TaggedAttachmentsTest-1079325823</nova:project>
Aug 14 22:58:18 user nova-compute[72766]:   </nova:owner>
Aug 14 22:58:18 user nova-compute[72766]:   <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 22:58:18 user nova-compute[72766]:   <nova:ports>
Aug 14 22:58:18 user nova-compute[72766]:     <nova:port uuid="58e0b222-3a0a-40d3-ad60-e92985bd3584">
Aug 14 22:58:18 user nova-compute[72766]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 22:58:18 user nova-compute[72766]:     </nova:port>
Aug 14 22:58:18 user nova-compute[72766]:   </nova:ports>
Aug 14 22:58:18 user nova-compute[72766]: </nova:instance>
Aug 14 22:58:18 user nova-compute[72766]:  {{(pid=72766) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 14 22:58:18 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:18 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:18 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] COPY block job progress, current cursor: 208666624 final cursor: 1073741824 {{(pid=72766) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 22:58:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:18 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:18 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:18 user nova-compute[72766]: DEBUG nova.network.neutron [None req-d0ad2d1b-fb95-456e-b7b1-59bddd47f1f5 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Updating instance_info_cache with network_info: [{"id": "58e0b222-3a0a-40d3-ad60-e92985bd3584", "address": "fa:16:3e:5e:2c:02", "network": {"id": "6f03ef5e-cea3-4538-9f91-e35f756665a1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1408762454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d841b7f732a743658e035777c8629c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e0b222-3a", "ovs_interfaceid": "58e0b222-3a0a-40d3-ad60-e92985bd3584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:58:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d0ad2d1b-fb95-456e-b7b1-59bddd47f1f5 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Releasing lock "refresh_cache-90b55775-2f14-4c80-b48a-b1eed2b570dc" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:58:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d0ad2d1b-fb95-456e-b7b1-59bddd47f1f5 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Lock "interface-90b55775-2f14-4c80-b48a-b1eed2b570dc-a886f590-4818-4e79-ad6c-785067fbff0d" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.947s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:58:18 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:18 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b55141bc-d426-4d35-8ae5-269ece19a793/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:18 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] COPY block job progress, current cursor: 348127232 final cursor: 1073741824 {{(pid=72766) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 22:58:18 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b55141bc-d426-4d35-8ae5-269ece19a793/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:18 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b55141bc-d426-4d35-8ae5-269ece19a793/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b55141bc-d426-4d35-8ae5-269ece19a793/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Acquiring lock "4d919875-5f24-4bed-bf26-cf437e0de3e2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:58:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Lock "4d919875-5f24-4bed-bf26-cf437e0de3e2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:58:19 user nova-compute[72766]: DEBUG nova.compute.manager [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 22:58:19 user nova-compute[72766]: DEBUG nova.compute.manager [req-819561ea-b9da-41df-897a-691acdc9e45a req-8eb2f17a-8d9b-475f-b1eb-e2c2a56ebe3e service nova] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Received event network-vif-plugged-a886f590-4818-4e79-ad6c-785067fbff0d {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:58:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-819561ea-b9da-41df-897a-691acdc9e45a req-8eb2f17a-8d9b-475f-b1eb-e2c2a56ebe3e service nova] Acquiring lock "90b55775-2f14-4c80-b48a-b1eed2b570dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:58:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-819561ea-b9da-41df-897a-691acdc9e45a req-8eb2f17a-8d9b-475f-b1eb-e2c2a56ebe3e service nova] Lock "90b55775-2f14-4c80-b48a-b1eed2b570dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:58:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-819561ea-b9da-41df-897a-691acdc9e45a req-8eb2f17a-8d9b-475f-b1eb-e2c2a56ebe3e service nova] Lock "90b55775-2f14-4c80-b48a-b1eed2b570dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:58:19 user nova-compute[72766]: DEBUG nova.compute.manager [req-819561ea-b9da-41df-897a-691acdc9e45a req-8eb2f17a-8d9b-475f-b1eb-e2c2a56ebe3e service nova] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] No waiting events found dispatching network-vif-plugged-a886f590-4818-4e79-ad6c-785067fbff0d {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:58:19 user nova-compute[72766]: WARNING nova.compute.manager [req-819561ea-b9da-41df-897a-691acdc9e45a req-8eb2f17a-8d9b-475f-b1eb-e2c2a56ebe3e service nova] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Received unexpected event network-vif-plugged-a886f590-4818-4e79-ad6c-785067fbff0d for instance with vm_state active and task_state None.
Aug 14 22:58:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:19 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] COPY block job progress, current cursor: 519045120 final cursor: 1073741824 {{(pid=72766) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 22:58:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:58:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:58:19 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 22:58:19 user nova-compute[72766]: INFO nova.compute.claims [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Claim successful on node user
Aug 14 22:58:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:20 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:58:20 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:58:20 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=7295MB free_disk=25.69076919555664GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 22:58:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:58:20 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] COPY block job progress, current cursor: 772800512 final cursor: 1073741824 {{(pid=72766) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 22:58:20 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:58:20 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:58:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.087s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:58:20 user nova-compute[72766]: DEBUG nova.compute.manager [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 22:58:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.349s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:58:20 user nova-compute[72766]: DEBUG nova.compute.manager [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 22:58:20 user nova-compute[72766]: DEBUG nova.network.neutron [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 22:58:20 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 22:58:20 user nova-compute[72766]: DEBUG nova.compute.manager [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 22:58:20 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] COPY block job progress, current cursor: 942669824 final cursor: 1073741824 {{(pid=72766) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 22:58:20 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance b563c62d-d117-4bb5-9157-7387c51ed641 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:58:20 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:58:20 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 0850bb6c-6e3e-4007-8478-8eba53089158 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:58:20 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 90b55775-2f14-4c80-b48a-b1eed2b570dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:58:20 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance b55141bc-d426-4d35-8ae5-269ece19a793 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:58:20 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 33e6f8aa-bb0d-478d-b7b5-3334302476fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:58:20 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance a9d6011c-da14-4fcc-8e31-3063db57b2a6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:58:20 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance c3c0a004-8d70-4253-bf17-b83088e30031 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:58:20 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance bde3ff44-cdf8-4ef7-bb7d-50865129268f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:58:20 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 4d919875-5f24-4bed-bf26-cf437e0de3e2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:58:20 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 22:58:20 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 22:58:20 user nova-compute[72766]: DEBUG nova.policy [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd46f138a683742b09a91e1f10f085c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71798c25948f4c8cb02664413314a4e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 22:58:20 user nova-compute[72766]: INFO nova.virt.block_device [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Booting with volume cc05004f-3360-4071-bd51-ce172fb18886 at /dev/vda
Aug 14 22:58:20 user nova-compute[72766]: DEBUG os_brick.utils [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:58:20 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:20 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:20 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[1931efe5-aa54-403c-9cb6-491f1837a021]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:20 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:20 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:20 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[690f6c82-cca2-437b-837f-432d4e66ae54]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:20 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:20 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:20 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7cc758-6950-4991-8463-80ad2d5963a3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:20 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f390786-1dd1-4000-a9a6-555e6b8df2c4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:20 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:58:21 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 22:58:21 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[085c4001-fb8e-4533-ae63-2e9f2a03c5b2]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG os_brick.utils [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Updating existing volume attachment record: 8d77f532-f9a3-460b-86e1-079f4ac731c7 {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72766) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.746s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mVgSjQTR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:58:21 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:58:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[16436b6f-9813-436d-a498-b3d25887e7fb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1f6f55-954c-4358-8187-69bcb498b183]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)
Aug 14 22:58:21 user nova-compute[72766]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf (non-flash)
Aug 14 22:58:21 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)
Aug 14 22:58:21 user nova-compute[72766]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf (non-flash)
Aug 14 22:58:21 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff16c3bd900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e'): ({'sde'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Removing single pathed devices sde {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2dda10-4adc-472d-a1f8-99c73a351cb6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7c76c0-f3c5-4478-9a77-2d449f185077]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Flushing IO for device /dev/sde {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91bbd88-7363-4427-a993-dae0bd0005d0]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[759c1f64-a040-4100-acc1-77b621e7cfba]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] SCSI volumes sde have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a88aaa4-bb4c-4e19-862b-50a9ca7a54de]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d63192-91bd-4cd5-bcc4-34d7588747d2]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e, portal: 172.16.0.220,3260]
Aug 14 22:58:21 user nova-compute[72766]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e, portal: 172.16.0.220,3260] successful.
Aug 14 22:58:21 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG nova.network.neutron [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Successfully created port: bb47713e-54a8-4834-a78d-749c5f72f334 {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cff69ad-38de-4169-94e4-4b82b1b7654e]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] <== disconnect_volume: return (273ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG nova.compute.manager [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JshAerTH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '33e6f8aa-bb0d-478d-b7b5-3334302476fb', 'attached_at': '', 'detached_at': '', 'volume_id': '8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf', 'serial'} {{(pid=72766) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG nova.compute.manager [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] swap_volume: removing Cinder connection for volume 37f3ab46-4f0d-408f-a4e6-d634bc8e498e {{(pid=72766) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 14 22:58:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:22 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:58:22 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:58:22 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:58:22 user nova-compute[72766]: DEBUG nova.network.neutron [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Successfully updated port: bb47713e-54a8-4834-a78d-749c5f72f334 {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 22:58:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Acquiring lock "refresh_cache-4d919875-5f24-4bed-bf26-cf437e0de3e2" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:58:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Acquired lock "refresh_cache-4d919875-5f24-4bed-bf26-cf437e0de3e2" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:58:22 user nova-compute[72766]: DEBUG nova.network.neutron [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:58:22 user nova-compute[72766]: DEBUG nova.compute.manager [req-22de9e9f-ea16-4419-988e-7252b879e231 req-345a8205-5451-42e3-8edd-bd1e820a1cda service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Received event network-changed-bb47713e-54a8-4834-a78d-749c5f72f334 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:58:22 user nova-compute[72766]: DEBUG nova.compute.manager [req-22de9e9f-ea16-4419-988e-7252b879e231 req-345a8205-5451-42e3-8edd-bd1e820a1cda service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Refreshing instance network info cache due to event network-changed-bb47713e-54a8-4834-a78d-749c5f72f334. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:58:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-22de9e9f-ea16-4419-988e-7252b879e231 req-345a8205-5451-42e3-8edd-bd1e820a1cda service nova] Acquiring lock "refresh_cache-4d919875-5f24-4bed-bf26-cf437e0de3e2" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:58:22 user nova-compute[72766]: DEBUG nova.network.neutron [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 22:58:22 user nova-compute[72766]: DEBUG nova.compute.manager [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] swap_volume: Updating volume 37f3ab46-4f0d-408f-a4e6-d634bc8e498e BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "JshAerTH", "auth_password": "ivo7E9kys1jIBN", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf"}, "status": "reserved", "instance": "33e6f8aa-bb0d-478d-b7b5-3334302476fb", "attached_at": "", "detached_at": "", "volume_id": "8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf", "serial": "8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf', 'no_device': None, 'attachment_id': '5f9e380b-4f14-43b9-bcf0-1f87b9e2c667'} {{(pid=72766) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 14 22:58:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-29b26de3-22ae-494e-a435-b18d95ee6223 tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Lock "33e6f8aa-bb0d-478d-b7b5-3334302476fb" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 17.285s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:58:22 user nova-compute[72766]: DEBUG nova.network.neutron [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Updating instance_info_cache with network_info: [{"id": "bb47713e-54a8-4834-a78d-749c5f72f334", "address": "fa:16:3e:34:a4:4f", "network": {"id": "b151d906-14b7-466f-909c-18c6b9f1855d", "bridge": "br-int", "label": "tempest-TestShelveInstance-664463668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71798c25948f4c8cb02664413314a4e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb47713e-54", "ovs_interfaceid": "bb47713e-54a8-4834-a78d-749c5f72f334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:58:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Releasing lock "refresh_cache-4d919875-5f24-4bed-bf26-cf437e0de3e2" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:58:22 user nova-compute[72766]: DEBUG nova.compute.manager [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Instance network_info: |[{"id": "bb47713e-54a8-4834-a78d-749c5f72f334", "address": "fa:16:3e:34:a4:4f", "network": {"id": "b151d906-14b7-466f-909c-18c6b9f1855d", "bridge": "br-int", "label": "tempest-TestShelveInstance-664463668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71798c25948f4c8cb02664413314a4e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb47713e-54", "ovs_interfaceid": "bb47713e-54a8-4834-a78d-749c5f72f334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 22:58:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-22de9e9f-ea16-4419-988e-7252b879e231 req-345a8205-5451-42e3-8edd-bd1e820a1cda service nova] Acquired lock "refresh_cache-4d919875-5f24-4bed-bf26-cf437e0de3e2" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:58:22 user nova-compute[72766]: DEBUG nova.network.neutron [req-22de9e9f-ea16-4419-988e-7252b879e231 req-345a8205-5451-42e3-8edd-bd1e820a1cda service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Refreshing network info cache for port bb47713e-54a8-4834-a78d-749c5f72f334 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:58:23 user nova-compute[72766]: DEBUG nova.network.neutron [req-22de9e9f-ea16-4419-988e-7252b879e231 req-345a8205-5451-42e3-8edd-bd1e820a1cda service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Updated VIF entry in instance network info cache for port bb47713e-54a8-4834-a78d-749c5f72f334. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:58:23 user nova-compute[72766]: DEBUG nova.network.neutron [req-22de9e9f-ea16-4419-988e-7252b879e231 req-345a8205-5451-42e3-8edd-bd1e820a1cda service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Updating instance_info_cache with network_info: [{"id": "bb47713e-54a8-4834-a78d-749c5f72f334", "address": "fa:16:3e:34:a4:4f", "network": {"id": "b151d906-14b7-466f-909c-18c6b9f1855d", "bridge": "br-int", "label": "tempest-TestShelveInstance-664463668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71798c25948f4c8cb02664413314a4e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb47713e-54", "ovs_interfaceid": "bb47713e-54a8-4834-a78d-749c5f72f334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:58:23 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-22de9e9f-ea16-4419-988e-7252b879e231 req-345a8205-5451-42e3-8edd-bd1e820a1cda service nova] Releasing lock "refresh_cache-4d919875-5f24-4bed-bf26-cf437e0de3e2" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:58:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:23 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Acquiring lock "33e6f8aa-bb0d-478d-b7b5-3334302476fb" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:58:23 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Lock "33e6f8aa-bb0d-478d-b7b5-3334302476fb" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:58:23 user nova-compute[72766]: DEBUG os_brick.utils [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:58:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:23 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[429ce340-e4d5-440a-bf4e-eea189a05503]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:23 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[56dc5c45-c6e8-456a-a682-8eb27cb6839e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:23 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[df91a3cc-1d23-4e49-b235-8b419f2c6ae8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:23 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[f710c987-6c3a-4d0f-8a92-708ae495a5f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:58:23 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 22:58:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:58:23 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 22:58:23 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[16613327-757d-4f45-a6b8-7c147b83d39f]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:23 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 22:58:23 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 22:58:23 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 22:58:23 user nova-compute[72766]: DEBUG os_brick.utils [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:58:23 user nova-compute[72766]: INFO nova.compute.manager [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Swapping volume 8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf for 37f3ab46-4f0d-408f-a4e6-d634bc8e498e
Aug 14 22:58:26 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692053891.23333, 40cd301a-97f2-4f02-b091-f5a2bb1cd016 => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:58:26 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] VM Stopped (Lifecycle Event)
Aug 14 22:58:26 user nova-compute[72766]: DEBUG nova.compute.manager [None req-ade1a68d-865e-46a0-9b18-b5f9dfc4ea30 None None] [instance: 40cd301a-97f2-4f02-b091-f5a2bb1cd016] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:58:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG nova.compute.manager [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 22:58:30 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Creating image(s)
Aug 14 22:58:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Did not create local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Ensure instance console log exists: /opt/stack/data/nova/instances/4d919875-5f24-4bed-bf26-cf437e0de3e2/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Start _get_guest_xml network_info=[{"id": "bb47713e-54a8-4834-a78d-749c5f72f334", "address": "fa:16:3e:34:a4:4f", "network": {"id": "b151d906-14b7-466f-909c-18c6b9f1855d", "bridge": "br-int", "label": "tempest-TestShelveInstance-664463668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71798c25948f4c8cb02664413314a4e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb47713e-54", "ovs_interfaceid": "bb47713e-54a8-4834-a78d-749c5f72f334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': '8d77f532-f9a3-460b-86e1-079f4ac731c7', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvezkmys', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4d919875-5f24-4bed-bf26-cf437e0de3e2', 'attached_at': '', 'detached_at': '', 'volume_id': 'cc05004f-3360-4071-bd51-ce172fb18886', 'serial': 'cc05004f-3360-4071-bd51-ce172fb18886'}, 'volume_type': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 22:58:30 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:58:30 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:58:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvezkmys', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:58:30 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:58:30 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:58:30 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:58:30 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:58:30 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 22:58:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4b021f-2332-49bc-aa55-1a43a193a5a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 22:58:30 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ea4374-b3d0-4da6-8046-9cf630dc7853]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886] added
Aug 14 22:58:30 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c620c93f-1df2-45c1-99d7-25e791b87279]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb6d050-5421-4add-9bbd-c9e2ddeed169]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cvezkmys {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cvezkmys" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[5050e6be-f44f-4ed4-a421-2bea77e6bc4e]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cvezkmys'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71e7751-2d42-45a6-808e-87dfebcd047a]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[772fc8cc-cb10-48f7-be46-976d3d033909]: (4, ('tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf (non-flash)
Aug 14 22:58:30 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] iscsi session list stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf (non-flash)
Aug 14 22:58:30 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a587f8a4-7397-459b-bb81-d3058950fddc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886, portal: 172.16.0.220,3260]
Aug 14 22:58:30 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886, portal: 172.16.0.220,3260] successful.
Aug 14 22:58:30 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.041s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c27d58c-80b8-4837-a6fe-d2b0be387f9e]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd5a924-0b25-4f7c-b607-03e8ba95fedb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 22:58:30 user nova-compute[72766]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf (non-flash)
Aug 14 22:58:30 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 22:58:30 user nova-compute[72766]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf (non-flash)
Aug 14 22:58:30 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] HCTL ('34', '-', '-', 0) found on session 10 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f93667b-d0a9-4b61-9525-cdac6aa5410f]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:30 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Searching for a device in session 10 and hctl ['34', '*', '*', 0] yield: None {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:58:31 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Searching for a device in session 10 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:58:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvezkmys', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 22:58:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:58:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23039323238376166', 'path': '/dev/sdc'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:58:31 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039323238376166', 'path': '/dev/sdc'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 22:58:31 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:58:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1732259896',display_name='tempest-TestShelveInstance-server-1732259896',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1732259896',id=12,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJttuZNcmSPPc5p7oQDHUy8DHRRj8VmSdgjSZwlMP/Wog2Lw20nrGzoNtOerf71zO0Z5VMVyCvpGcPQV7yHBlJjzeBcaszN5MzjHSpERf4DytlGuAt9s2fAouYBU+yBHwA==',key_name='tempest-TestShelveInstance-1877498323',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71798c25948f4c8cb02664413314a4e1',ramdisk_id='',reservation_id='r-yvm2m86y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1305179191',owner_user_name='tempest-TestShelveInstance-1305179191-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:58:21Z,user_data=None,user_id='d46f138a683742b09a91e1f10f085c18',uuid=4d919875-5f24-4bed-bf26-cf437e0de3e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb47713e-54a8-4834-a78d-749c5f72f334", "address": "fa:16:3e:34:a4:4f", "network": {"id": "b151d906-14b7-466f-909c-18c6b9f1855d", "bridge": "br-int", "label": "tempest-TestShelveInstance-664463668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71798c25948f4c8cb02664413314a4e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb47713e-54", "ovs_interfaceid": "bb47713e-54a8-4834-a78d-749c5f72f334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 22:58:31 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Converting VIF {"id": "bb47713e-54a8-4834-a78d-749c5f72f334", "address": "fa:16:3e:34:a4:4f", "network": {"id": "b151d906-14b7-466f-909c-18c6b9f1855d", "bridge": "br-int", "label": "tempest-TestShelveInstance-664463668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71798c25948f4c8cb02664413314a4e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb47713e-54", "ovs_interfaceid": "bb47713e-54a8-4834-a78d-749c5f72f334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:58:31 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:a4:4f,bridge_name='br-int',has_traffic_filtering=True,id=bb47713e-54a8-4834-a78d-749c5f72f334,network=Network(b151d906-14b7-466f-909c-18c6b9f1855d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb47713e-54') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:58:31 user nova-compute[72766]: DEBUG nova.objects.instance [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Lazy-loading 'pci_devices' on Instance uuid 4d919875-5f24-4bed-bf26-cf437e0de3e2 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:58:31 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] End _get_guest_xml xml=<domain type="kvm">
Aug 14 22:58:31 user nova-compute[72766]:   <uuid>4d919875-5f24-4bed-bf26-cf437e0de3e2</uuid>
Aug 14 22:58:31 user nova-compute[72766]:   <name>instance-0000000c</name>
Aug 14 22:58:31 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 22:58:31 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 22:58:31 user nova-compute[72766]:   <metadata>
Aug 14 22:58:31 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:58:31 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 22:58:31 user nova-compute[72766]:       <nova:name>tempest-TestShelveInstance-server-1732259896</nova:name>
Aug 14 22:58:31 user nova-compute[72766]:       <nova:creationTime>2023-08-14 22:58:30</nova:creationTime>
Aug 14 22:58:31 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 22:58:31 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 22:58:31 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 22:58:31 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 22:58:31 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:58:31 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 22:58:31 user nova-compute[72766]:       </nova:flavor>
Aug 14 22:58:31 user nova-compute[72766]:       <nova:owner>
Aug 14 22:58:31 user nova-compute[72766]:         <nova:user uuid="d46f138a683742b09a91e1f10f085c18">tempest-TestShelveInstance-1305179191-project-member</nova:user>
Aug 14 22:58:31 user nova-compute[72766]:         <nova:project uuid="71798c25948f4c8cb02664413314a4e1">tempest-TestShelveInstance-1305179191</nova:project>
Aug 14 22:58:31 user nova-compute[72766]:       </nova:owner>
Aug 14 22:58:31 user nova-compute[72766]:       <nova:ports>
Aug 14 22:58:31 user nova-compute[72766]:         <nova:port uuid="bb47713e-54a8-4834-a78d-749c5f72f334">
Aug 14 22:58:31 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 22:58:31 user nova-compute[72766]:         </nova:port>
Aug 14 22:58:31 user nova-compute[72766]:       </nova:ports>
Aug 14 22:58:31 user nova-compute[72766]:     </nova:instance>
Aug 14 22:58:31 user nova-compute[72766]:   </metadata>
Aug 14 22:58:31 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 22:58:31 user nova-compute[72766]:     <system>
Aug 14 22:58:31 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 22:58:31 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 22:58:31 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 22:58:31 user nova-compute[72766]:       <entry name="serial">4d919875-5f24-4bed-bf26-cf437e0de3e2</entry>
Aug 14 22:58:31 user nova-compute[72766]:       <entry name="uuid">4d919875-5f24-4bed-bf26-cf437e0de3e2</entry>
Aug 14 22:58:31 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 22:58:31 user nova-compute[72766]:     </system>
Aug 14 22:58:31 user nova-compute[72766]:   </sysinfo>
Aug 14 22:58:31 user nova-compute[72766]:   <os>
Aug 14 22:58:31 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 22:58:31 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 22:58:31 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 22:58:31 user nova-compute[72766]:   </os>
Aug 14 22:58:31 user nova-compute[72766]:   <features>
Aug 14 22:58:31 user nova-compute[72766]:     <acpi/>
Aug 14 22:58:31 user nova-compute[72766]:     <apic/>
Aug 14 22:58:31 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 22:58:31 user nova-compute[72766]:   </features>
Aug 14 22:58:31 user nova-compute[72766]:   <clock offset="utc">
Aug 14 22:58:31 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 22:58:31 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 22:58:31 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 22:58:31 user nova-compute[72766]:   </clock>
Aug 14 22:58:31 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 22:58:31 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 22:58:31 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 22:58:31 user nova-compute[72766]:   </cpu>
Aug 14 22:58:31 user nova-compute[72766]:   <devices>
Aug 14 22:58:31 user nova-compute[72766]:     <disk type="block" device="disk">
Aug 14 22:58:31 user nova-compute[72766]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:58:31 user nova-compute[72766]:       <source dev="/dev/sdc"/>
Aug 14 22:58:31 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 22:58:31 user nova-compute[72766]:       <serial>cc05004f-3360-4071-bd51-ce172fb18886</serial>
Aug 14 22:58:31 user nova-compute[72766]:     </disk>
Aug 14 22:58:31 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 22:58:31 user nova-compute[72766]:       <mac address="fa:16:3e:34:a4:4f"/>
Aug 14 22:58:31 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 22:58:31 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 22:58:31 user nova-compute[72766]:       <target dev="tapbb47713e-54"/>
Aug 14 22:58:31 user nova-compute[72766]:     </interface>
Aug 14 22:58:31 user nova-compute[72766]:     <serial type="pty">
Aug 14 22:58:31 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/4d919875-5f24-4bed-bf26-cf437e0de3e2/console.log" append="off"/>
Aug 14 22:58:31 user nova-compute[72766]:     </serial>
Aug 14 22:58:31 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 22:58:31 user nova-compute[72766]:     <video>
Aug 14 22:58:31 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 22:58:31 user nova-compute[72766]:     </video>
Aug 14 22:58:31 user nova-compute[72766]:     <rng model="virtio">
Aug 14 22:58:31 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 22:58:31 user nova-compute[72766]:     </rng>
Aug 14 22:58:31 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 22:58:31 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 22:58:31 user nova-compute[72766]:       <stats period="10"/>
Aug 14 22:58:31 user nova-compute[72766]:     </memballoon>
Aug 14 22:58:31 user nova-compute[72766]:   </devices>
Aug 14 22:58:31 user nova-compute[72766]: </domain>
Aug 14 22:58:31 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 22:58:31 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:58:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1732259896',display_name='tempest-TestShelveInstance-server-1732259896',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1732259896',id=12,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJttuZNcmSPPc5p7oQDHUy8DHRRj8VmSdgjSZwlMP/Wog2Lw20nrGzoNtOerf71zO0Z5VMVyCvpGcPQV7yHBlJjzeBcaszN5MzjHSpERf4DytlGuAt9s2fAouYBU+yBHwA==',key_name='tempest-TestShelveInstance-1877498323',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71798c25948f4c8cb02664413314a4e1',ramdisk_id='',reservation_id='r-yvm2m86y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1305179191',owner_user_name='tempest-TestShelveInstance-1305179191-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:58:21Z,user_data=None,user_id='d46f138a683742b09a91e1f10f085c18',uuid=4d919875-5f24-4bed-bf26-cf437e0de3e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb47713e-54a8-4834-a78d-749c5f72f334", "address": "fa:16:3e:34:a4:4f", "network": {"id": "b151d906-14b7-466f-909c-18c6b9f1855d", "bridge": "br-int", "label": "tempest-TestShelveInstance-664463668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71798c25948f4c8cb02664413314a4e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb47713e-54", "ovs_interfaceid": "bb47713e-54a8-4834-a78d-749c5f72f334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 22:58:31 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Converting VIF {"id": "bb47713e-54a8-4834-a78d-749c5f72f334", "address": "fa:16:3e:34:a4:4f", "network": {"id": "b151d906-14b7-466f-909c-18c6b9f1855d", "bridge": "br-int", "label": "tempest-TestShelveInstance-664463668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71798c25948f4c8cb02664413314a4e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb47713e-54", "ovs_interfaceid": "bb47713e-54a8-4834-a78d-749c5f72f334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:58:31 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:a4:4f,bridge_name='br-int',has_traffic_filtering=True,id=bb47713e-54a8-4834-a78d-749c5f72f334,network=Network(b151d906-14b7-466f-909c-18c6b9f1855d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb47713e-54') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:58:31 user nova-compute[72766]: DEBUG os_vif [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:a4:4f,bridge_name='br-int',has_traffic_filtering=True,id=bb47713e-54a8-4834-a78d-749c5f72f334,network=Network(b151d906-14b7-466f-909c-18c6b9f1855d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb47713e-54') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 22:58:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:58:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 22:58:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbb47713e-54, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:58:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbb47713e-54, col_values=(('external_ids', {'iface-id': 'bb47713e-54a8-4834-a78d-749c5f72f334', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:a4:4f', 'vm-uuid': '4d919875-5f24-4bed-bf26-cf437e0de3e2'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:58:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:58:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:31 user nova-compute[72766]: INFO os_vif [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:a4:4f,bridge_name='br-int',has_traffic_filtering=True,id=bb47713e-54a8-4834-a78d-749c5f72f334,network=Network(b151d906-14b7-466f-909c-18c6b9f1855d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb47713e-54')
Aug 14 22:58:31 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:58:31 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] No VIF found with MAC fa:16:3e:34:a4:4f, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:58:32 user nova-compute[72766]: DEBUG nova.compute.manager [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mVgSjQTR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '33e6f8aa-bb0d-478d-b7b5-3334302476fb', 'attached_at': '', 'detached_at': '', 'volume_id': '37f3ab46-4f0d-408f-a4e6-d634bc8e498e', 'serial': '37f3ab46-4f0d-408f-a4e6-d634bc8e498e'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JshAerTH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf'}, 'status': 'reserved', 'instance': '33e6f8aa-bb0d-478d-b7b5-3334302476fb', 'attached_at': '', 'detached_at': '', 'volume_id': '8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf', 'serial'} {{(pid=72766) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 14 22:58:32 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 22:58:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mVgSjQTR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:58:32 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:58:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:58:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:58:32 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:58:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:58:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:58:32 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 22:58:32 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ad3944-e5c4-4083-8ff0-361cbc38eb5b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 22:58:32 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:32 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b4a261-dc15-4d2b-a2af-71ef3b2d2a4c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e] added
Aug 14 22:58:32 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:32 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b858aad-3e73-44a0-a320-e0e8b9fd74b0]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c4de7d-eb7b-411d-acda-3945b8f5031a]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mVgSjQTR {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mVgSjQTR" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[076d71b6-82c2-40e0-a312-a86508c245ae]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mVgSjQTR'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:33 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c07e74d-183b-442e-9252-14dd1bcc8828]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:33 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:33 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[407412ca-69ba-4d24-baa8-c282ec454c36]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:33 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 22:58:33 user nova-compute[72766]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf (non-flash)
Aug 14 22:58:33 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:58:33 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 22:58:33 user nova-compute[72766]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf (non-flash)
Aug 14 22:58:33 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:58:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:33 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7cb64a-071f-4860-b3f0-c30d48135b35]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:33 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e, portal: 172.16.0.220,3260]
Aug 14 22:58:33 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e, portal: 172.16.0.220,3260] successful.
Aug 14 22:58:33 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-df535beb-31e9-4b70-bc7e-4bbdd54c99c9 req-d9c9d2db-79fa-4234-8916-7b3502b0bc02 service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Received event network-vif-plugged-bb47713e-54a8-4834-a78d-749c5f72f334 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:58:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-df535beb-31e9-4b70-bc7e-4bbdd54c99c9 req-d9c9d2db-79fa-4234-8916-7b3502b0bc02 service nova] Acquiring lock "4d919875-5f24-4bed-bf26-cf437e0de3e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:58:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-df535beb-31e9-4b70-bc7e-4bbdd54c99c9 req-d9c9d2db-79fa-4234-8916-7b3502b0bc02 service nova] Lock "4d919875-5f24-4bed-bf26-cf437e0de3e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:58:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-df535beb-31e9-4b70-bc7e-4bbdd54c99c9 req-d9c9d2db-79fa-4234-8916-7b3502b0bc02 service nova] Lock "4d919875-5f24-4bed-bf26-cf437e0de3e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:58:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-df535beb-31e9-4b70-bc7e-4bbdd54c99c9 req-d9c9d2db-79fa-4234-8916-7b3502b0bc02 service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] No waiting events found dispatching network-vif-plugged-bb47713e-54a8-4834-a78d-749c5f72f334 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:58:33 user nova-compute[72766]: WARNING nova.compute.manager [req-df535beb-31e9-4b70-bc7e-4bbdd54c99c9 req-d9c9d2db-79fa-4234-8916-7b3502b0bc02 service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Received unexpected event network-vif-plugged-bb47713e-54a8-4834-a78d-749c5f72f334 for instance with vm_state building and task_state spawning.
Aug 14 22:58:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:33 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[46165ead-806f-4be9-9649-bbaf5d85dfdb]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:33 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:33 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[5912eaad-3015-4e60-b538-5d4a3fe720c7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:33 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 22:58:33 user nova-compute[72766]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)
Aug 14 22:58:33 user nova-compute[72766]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf (non-flash)
Aug 14 22:58:33 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:58:33 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 22:58:33 user nova-compute[72766]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)
Aug 14 22:58:33 user nova-compute[72766]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf (non-flash)
Aug 14 22:58:33 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:58:33 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:58:33 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 22:58:33 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] HCTL ('35', '-', '-', 0) found on session 11 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 22:58:33 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 22:58:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:33 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f53ab19-0ef7-4b65-8a1a-0f29cf3f4f7d]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:33 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Searching for a device in session 11 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:58:33 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mVgSjQTR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 22:58:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:34 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:58:34 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '26133383935666630', 'path': '/dev/sdd'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:58:34 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133383935666630', 'path': '/dev/sdd'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 22:58:34 user nova-compute[72766]: DEBUG nova.objects.instance [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Lazy-loading 'flavor' on Instance uuid 33e6f8aa-bb0d-478d-b7b5-3334302476fb {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:58:34 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72766) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 22:58:35 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] COPY block job progress, current cursor: 168820736 final cursor: 1073741824 {{(pid=72766) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 22:58:35 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692053915.180005, 4d919875-5f24-4bed-bf26-cf437e0de3e2 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:58:35 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] VM Resumed (Lifecycle Event)
Aug 14 22:58:35 user nova-compute[72766]: DEBUG nova.compute.manager [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 22:58:35 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 22:58:35 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Instance spawned successfully.
Aug 14 22:58:35 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 22:58:35 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:58:35 user nova-compute[72766]: DEBUG nova.compute.manager [req-65272180-4f7c-4a08-8aef-5eb9d2b44902 req-b87cc921-76b3-4e2c-bbd8-9d5826ccf07d service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Received event network-vif-plugged-bb47713e-54a8-4834-a78d-749c5f72f334 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:58:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-65272180-4f7c-4a08-8aef-5eb9d2b44902 req-b87cc921-76b3-4e2c-bbd8-9d5826ccf07d service nova] Acquiring lock "4d919875-5f24-4bed-bf26-cf437e0de3e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:58:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-65272180-4f7c-4a08-8aef-5eb9d2b44902 req-b87cc921-76b3-4e2c-bbd8-9d5826ccf07d service nova] Lock "4d919875-5f24-4bed-bf26-cf437e0de3e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:58:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-65272180-4f7c-4a08-8aef-5eb9d2b44902 req-b87cc921-76b3-4e2c-bbd8-9d5826ccf07d service nova] Lock "4d919875-5f24-4bed-bf26-cf437e0de3e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:58:35 user nova-compute[72766]: DEBUG nova.compute.manager [req-65272180-4f7c-4a08-8aef-5eb9d2b44902 req-b87cc921-76b3-4e2c-bbd8-9d5826ccf07d service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] No waiting events found dispatching network-vif-plugged-bb47713e-54a8-4834-a78d-749c5f72f334 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:58:35 user nova-compute[72766]: WARNING nova.compute.manager [req-65272180-4f7c-4a08-8aef-5eb9d2b44902 req-b87cc921-76b3-4e2c-bbd8-9d5826ccf07d service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Received unexpected event network-vif-plugged-bb47713e-54a8-4834-a78d-749c5f72f334 for instance with vm_state building and task_state spawning.
Aug 14 22:58:35 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:58:35 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:58:35 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:58:35 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:58:35 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:58:35 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:58:35 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:58:35 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:58:35 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692053915.1820672, 4d919875-5f24-4bed-bf26-cf437e0de3e2 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:58:35 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] VM Started (Lifecycle Event)
Aug 14 22:58:35 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:58:35 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:58:35 user nova-compute[72766]: INFO nova.compute.manager [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Took 5.24 seconds to spawn the instance on the hypervisor.
Aug 14 22:58:35 user nova-compute[72766]: DEBUG nova.compute.manager [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:58:35 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:58:35 user nova-compute[72766]: INFO nova.compute.manager [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Took 16.21 seconds to build instance.
Aug 14 22:58:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-564e9a2e-5dc6-4808-9b87-dd48b9064423 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Lock "4d919875-5f24-4bed-bf26-cf437e0de3e2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.392s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:58:35 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] COPY block job progress, current cursor: 346030080 final cursor: 1073741824 {{(pid=72766) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 22:58:36 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] COPY block job progress, current cursor: 517996544 final cursor: 1073741824 {{(pid=72766) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 22:58:36 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:36 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] COPY block job progress, current cursor: 673185792 final cursor: 1073741824 {{(pid=72766) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 22:58:37 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] COPY block job progress, current cursor: 829423616 final cursor: 1073741824 {{(pid=72766) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 22:58:37 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] COPY block job progress, current cursor: 995098624 final cursor: 1073741824 {{(pid=72766) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72766) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JshAerTH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf'}, None), 'kwargs': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:58:38 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:58:38 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b61f2fb-3a34-41a0-a729-195e89047736]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e7d975-9a6d-4374-be67-0743bfde2af4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 22:58:38 user nova-compute[72766]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)
Aug 14 22:58:38 user nova-compute[72766]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 22:58:38 user nova-compute[72766]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf (non-flash)
Aug 14 22:58:38 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 22:58:38 user nova-compute[72766]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)
Aug 14 22:58:38 user nova-compute[72766]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 22:58:38 user nova-compute[72766]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf (non-flash)
Aug 14 22:58:38 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff16c1396c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf'): ({'sdb'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Removing single pathed devices sdb {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbfc464-9f03-4edd-81a0-6f00aae4d0db]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb93889-75dd-44ec-9ee6-484fd470e115]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Flushing IO for device /dev/sdb {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[60702270-bfd6-40e4-9223-5e78d6e3613c]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[7865251a-21b8-4e69-bcae-4021cdb7ef44]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] SCSI volumes sdb have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a7178d-1b03-4a2e-a8ab-d7cc937d77af]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6575c0c-afce-4c5f-ae23-5d78d4d76747]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf, portal: 172.16.0.220,3260]
Aug 14 22:58:38 user nova-compute[72766]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf, portal: 172.16.0.220,3260] successful.
Aug 14 22:58:38 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[144c9182-d81d-49f8-9dab-5afcbe808473]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] <== disconnect_volume: return (332ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG nova.compute.manager [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mVgSjQTR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '33e6f8aa-bb0d-478d-b7b5-3334302476fb', 'attached_at': '', 'detached_at': '', 'volume_id': '37f3ab46-4f0d-408f-a4e6-d634bc8e498e', 'serial'} {{(pid=72766) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG nova.compute.manager [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] swap_volume: removing Cinder connection for volume 8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf {{(pid=72766) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 14 22:58:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:45 user nova-compute[72766]: DEBUG nova.compute.manager [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] swap_volume: Updating volume 8e7f2fd4-74da-4cf1-a6f5-bdb67899eabf BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "mVgSjQTR", "auth_password": "BJXNEZvmtOsAKb", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdd", "volume_id": "37f3ab46-4f0d-408f-a4e6-d634bc8e498e"}, "status": "reserved", "instance": "33e6f8aa-bb0d-478d-b7b5-3334302476fb", "attached_at": "", "detached_at": "", "volume_id": "37f3ab46-4f0d-408f-a4e6-d634bc8e498e", "serial": "37f3ab46-4f0d-408f-a4e6-d634bc8e498e"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '37f3ab46-4f0d-408f-a4e6-d634bc8e498e', 'no_device': None, 'attachment_id': 'bb341120-03af-49e0-8fee-a34801cbf66d'} {{(pid=72766) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 14 22:58:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-474bc221-3bf3-4ed4-bc25-9b0bf807237f tempest-TestVolumeSwap-257852425 tempest-TestVolumeSwap-257852425-project-admin] Lock "33e6f8aa-bb0d-478d-b7b5-3334302476fb" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 21.761s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:58:46 user nova-compute[72766]: DEBUG nova.compute.manager [req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 req-ffcd8b94-b9f5-47a0-9e3d-c85942bf35ba service nova] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Received event volume-reimaged-bdfde062-9b2c-45a4-be3a-eccc18e9cef9 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:58:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 req-ffcd8b94-b9f5-47a0-9e3d-c85942bf35ba service nova] Acquiring lock "a9d6011c-da14-4fcc-8e31-3063db57b2a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:58:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 req-ffcd8b94-b9f5-47a0-9e3d-c85942bf35ba service nova] Lock "a9d6011c-da14-4fcc-8e31-3063db57b2a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:58:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 req-ffcd8b94-b9f5-47a0-9e3d-c85942bf35ba service nova] Lock "a9d6011c-da14-4fcc-8e31-3063db57b2a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:58:46 user nova-compute[72766]: DEBUG nova.compute.manager [req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 req-ffcd8b94-b9f5-47a0-9e3d-c85942bf35ba service nova] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Processing event volume-reimaged-bdfde062-9b2c-45a4-be3a-eccc18e9cef9 {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 14 22:58:46 user nova-compute[72766]: DEBUG nova.compute.manager [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Instance event wait completed in 40 seconds for volume-reimaged {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 22:58:46 user nova-compute[72766]: INFO nova.virt.block_device [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Booting with volume bdfde062-9b2c-45a4-be3a-eccc18e9cef9 at /dev/vda
Aug 14 22:58:46 user nova-compute[72766]: DEBUG os_brick.utils [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:58:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:46 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[101ab3e3-3ff4-4734-aa1a-ba5b06658b96]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:46 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c246d3-0a25-49f0-af3c-1056932228b1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:46 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[78386d3a-27b2-4ad2-b8fe-2c18a1b35ce9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:46 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f82642-23ac-4fc0-a635-3d1613d1912e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:58:46 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 22:58:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:58:46 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 22:58:46 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7676dc5-2c76-4430-a44c-4df0f35dc8e2]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:46 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 22:58:46 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 22:58:46 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 22:58:46 user nova-compute[72766]: DEBUG os_brick.utils [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:58:46 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Updating existing volume attachment record: b9a63dec-ae41-46e3-a3a1-69e746b24ac3 {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 22:58:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-9b811744-ed65-4236-be67-6ba13ddeaa53 tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Acquiring lock "33e6f8aa-bb0d-478d-b7b5-3334302476fb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:58:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-9b811744-ed65-4236-be67-6ba13ddeaa53 tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Lock "33e6f8aa-bb0d-478d-b7b5-3334302476fb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:58:46 user nova-compute[72766]: INFO nova.compute.manager [None req-9b811744-ed65-4236-be67-6ba13ddeaa53 tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Detaching volume 37f3ab46-4f0d-408f-a4e6-d634bc8e498e
Aug 14 22:58:46 user nova-compute[72766]: INFO nova.virt.block_device [None req-9b811744-ed65-4236-be67-6ba13ddeaa53 tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Attempting to driver detach volume 37f3ab46-4f0d-408f-a4e6-d634bc8e498e from mountpoint /dev/vdb
Aug 14 22:58:46 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-9b811744-ed65-4236-be67-6ba13ddeaa53 tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Attempting to detach device vdb from instance 33e6f8aa-bb0d-478d-b7b5-3334302476fb from the persistent domain config. {{(pid=72766) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 22:58:46 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-9b811744-ed65-4236-be67-6ba13ddeaa53 tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 22:58:46 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:58:46 user nova-compute[72766]:   <source dev="/dev/sdd"/>
Aug 14 22:58:46 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:58:46 user nova-compute[72766]:   <serial>37f3ab46-4f0d-408f-a4e6-d634bc8e498e</serial>
Aug 14 22:58:46 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 22:58:46 user nova-compute[72766]: </disk>
Aug 14 22:58:46 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 22:58:46 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-9b811744-ed65-4236-be67-6ba13ddeaa53 tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Successfully detached device vdb from instance 33e6f8aa-bb0d-478d-b7b5-3334302476fb from the persistent domain config.
Aug 14 22:58:46 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-9b811744-ed65-4236-be67-6ba13ddeaa53 tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 33e6f8aa-bb0d-478d-b7b5-3334302476fb from the live domain config. {{(pid=72766) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 22:58:46 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-9b811744-ed65-4236-be67-6ba13ddeaa53 tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 22:58:46 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:58:46 user nova-compute[72766]:   <source dev="/dev/sdd"/>
Aug 14 22:58:46 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:58:46 user nova-compute[72766]:   <serial>37f3ab46-4f0d-408f-a4e6-d634bc8e498e</serial>
Aug 14 22:58:46 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 22:58:46 user nova-compute[72766]: </disk>
Aug 14 22:58:46 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Received event <DeviceRemovedEvent: 1692053927.3960164, 33e6f8aa-bb0d-478d-b7b5-3334302476fb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72766) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-9b811744-ed65-4236-be67-6ba13ddeaa53 tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 33e6f8aa-bb0d-478d-b7b5-3334302476fb {{(pid=72766) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 22:58:47 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-9b811744-ed65-4236-be67-6ba13ddeaa53 tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Successfully detached device vdb from instance 33e6f8aa-bb0d-478d-b7b5-3334302476fb from the live domain config.
Aug 14 22:58:47 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b811744-ed65-4236-be67-6ba13ddeaa53 tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b811744-ed65-4236-be67-6ba13ddeaa53 tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mVgSjQTR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': '37f3ab46-4f0d-408f-a4e6-d634bc8e498e'}, None), 'kwargs': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:58:47 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-9b811744-ed65-4236-be67-6ba13ddeaa53 tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:58:47 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-9b811744-ed65-4236-be67-6ba13ddeaa53 tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-9b811744-ed65-4236-be67-6ba13ddeaa53 tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b811744-ed65-4236-be67-6ba13ddeaa53 tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9eb1244-44e0-4f88-979a-542035a7a0ba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05b8ebe-da83-45d9-94a3-7a9f43b645dd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b811744-ed65-4236-be67-6ba13ddeaa53 tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 22:58:47 user nova-compute[72766]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)
Aug 14 22:58:47 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b811744-ed65-4236-be67-6ba13ddeaa53 tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 22:58:47 user nova-compute[72766]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e (non-flash)
Aug 14 22:58:47 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b811744-ed65-4236-be67-6ba13ddeaa53 tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff1740fcb80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e'): ({'sdd'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-9b811744-ed65-4236-be67-6ba13ddeaa53 tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Removing single pathed devices sdd {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[04dcaec2-a10a-488e-adc6-dd0ef805b22c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72f6e8e-6f94-486b-9f7e-a07f5c63517b]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-9b811744-ed65-4236-be67-6ba13ddeaa53 tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Flushing IO for device /dev/sdd {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ccc6ef-38ea-41e3-accd-84d7b5e6a152]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-9b811744-ed65-4236-be67-6ba13ddeaa53 tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d464b815-8ca1-4d1d-88ac-8787e954b6c6]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-9b811744-ed65-4236-be67-6ba13ddeaa53 tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-9b811744-ed65-4236-be67-6ba13ddeaa53 tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] SCSI volumes sdd have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b811744-ed65-4236-be67-6ba13ddeaa53 tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b36540-0d9c-46ba-8661-745754448659]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b811744-ed65-4236-be67-6ba13ddeaa53 tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e15733-6c22-4bf0-8a30-82ed446e38c8]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b811744-ed65-4236-be67-6ba13ddeaa53 tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e, portal: 172.16.0.220,3260]
Aug 14 22:58:47 user nova-compute[72766]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e, portal: 172.16.0.220,3260] successful.
Aug 14 22:58:47 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37f3ab46-4f0d-408f-a4e6-d634bc8e498e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6e1b2a-c0c4-448b-bc35-67d620e2f379]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b811744-ed65-4236-be67-6ba13ddeaa53 tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-9b811744-ed65-4236-be67-6ba13ddeaa53 tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b811744-ed65-4236-be67-6ba13ddeaa53 tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] <== disconnect_volume: return (297ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:58:47 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b811744-ed65-4236-be67-6ba13ddeaa53 tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 22:58:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:51 user nova-compute[72766]: DEBUG nova.compute.manager [req-a4774d3c-fcea-4d21-ac38-6f3e20c2f1ef req-b00a3ba4-e2e8-4154-ad44-889238d16030 service nova] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Received event network-changed-26e28590-b9de-41c5-809d-06e3458eca3f {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:58:51 user nova-compute[72766]: DEBUG nova.compute.manager [req-a4774d3c-fcea-4d21-ac38-6f3e20c2f1ef req-b00a3ba4-e2e8-4154-ad44-889238d16030 service nova] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Refreshing instance network info cache due to event network-changed-26e28590-b9de-41c5-809d-06e3458eca3f. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:58:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a4774d3c-fcea-4d21-ac38-6f3e20c2f1ef req-b00a3ba4-e2e8-4154-ad44-889238d16030 service nova] Acquiring lock "refresh_cache-c3c0a004-8d70-4253-bf17-b83088e30031" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:58:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a4774d3c-fcea-4d21-ac38-6f3e20c2f1ef req-b00a3ba4-e2e8-4154-ad44-889238d16030 service nova] Acquired lock "refresh_cache-c3c0a004-8d70-4253-bf17-b83088e30031" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:58:51 user nova-compute[72766]: DEBUG nova.network.neutron [req-a4774d3c-fcea-4d21-ac38-6f3e20c2f1ef req-b00a3ba4-e2e8-4154-ad44-889238d16030 service nova] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Refreshing network info cache for port 26e28590-b9de-41c5-809d-06e3458eca3f {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:58:51 user nova-compute[72766]: DEBUG nova.objects.instance [None req-9b811744-ed65-4236-be67-6ba13ddeaa53 tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Lazy-loading 'flavor' on Instance uuid 33e6f8aa-bb0d-478d-b7b5-3334302476fb {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:58:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-9b811744-ed65-4236-be67-6ba13ddeaa53 tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Lock "33e6f8aa-bb0d-478d-b7b5-3334302476fb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.081s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:58:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Acquiring lock "bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:58:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lock "bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:58:52 user nova-compute[72766]: DEBUG nova.compute.manager [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 22:58:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:58:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:58:52 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 22:58:52 user nova-compute[72766]: INFO nova.compute.claims [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Claim successful on node user
Aug 14 22:58:53 user nova-compute[72766]: DEBUG nova.network.neutron [req-a4774d3c-fcea-4d21-ac38-6f3e20c2f1ef req-b00a3ba4-e2e8-4154-ad44-889238d16030 service nova] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Updated VIF entry in instance network info cache for port 26e28590-b9de-41c5-809d-06e3458eca3f. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:58:53 user nova-compute[72766]: DEBUG nova.network.neutron [req-a4774d3c-fcea-4d21-ac38-6f3e20c2f1ef req-b00a3ba4-e2e8-4154-ad44-889238d16030 service nova] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Updating instance_info_cache with network_info: [{"id": "26e28590-b9de-41c5-809d-06e3458eca3f", "address": "fa:16:3e:96:85:b3", "network": {"id": "b74740ac-2ac1-45f5-8997-0e22050362e8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1094074502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2811d70e7d640739c6f7bf792ec33a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e28590-b9", "ovs_interfaceid": "26e28590-b9de-41c5-809d-06e3458eca3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:58:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a4774d3c-fcea-4d21-ac38-6f3e20c2f1ef req-b00a3ba4-e2e8-4154-ad44-889238d16030 service nova] Releasing lock "refresh_cache-c3c0a004-8d70-4253-bf17-b83088e30031" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:58:53 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:58:53 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:58:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.649s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:58:53 user nova-compute[72766]: DEBUG nova.compute.manager [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 22:58:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:53 user nova-compute[72766]: DEBUG nova.compute.manager [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 22:58:53 user nova-compute[72766]: DEBUG nova.network.neutron [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 22:58:53 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 22:58:53 user nova-compute[72766]: DEBUG nova.compute.manager [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 22:58:53 user nova-compute[72766]: DEBUG nova.compute.manager [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 22:58:53 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 22:58:53 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Creating image(s)
Aug 14 22:58:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Acquiring lock "/opt/stack/data/nova/instances/bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:58:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lock "/opt/stack/data/nova/instances/bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:58:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lock "/opt/stack/data/nova/instances/bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:58:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.207s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Acquiring lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:58:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:58:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:53 user nova-compute[72766]: DEBUG nova.policy [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd7df5fafd6ca47179dec9cd295c46233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a77920bef94526816c1a9c95531cb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 22:58:54 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.209s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:54 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a/disk 1073741824 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:54 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a/disk 1073741824" returned: 0 in 0.068s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:58:54 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:54 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.207s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:54 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a/disk. size=1073741824 {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 22:58:54 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:54 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:54 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Cannot resize image /opt/stack/data/nova/instances/bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a/disk to a smaller size. {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 22:58:54 user nova-compute[72766]: DEBUG nova.objects.instance [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lazy-loading 'migration_context' on Instance uuid bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:58:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 22:58:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Ensure instance console log exists: /opt/stack/data/nova/instances/bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 22:58:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:58:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:58:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:58:55 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:55 user nova-compute[72766]: DEBUG nova.network.neutron [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Successfully created port: ad1ca253-760e-4db4-864a-bef71de4c1b7 {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 22:58:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:56 user nova-compute[72766]: DEBUG nova.network.neutron [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Successfully updated port: ad1ca253-760e-4db4-864a-bef71de4c1b7 {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 22:58:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Acquiring lock "refresh_cache-bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:58:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Acquired lock "refresh_cache-bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:58:56 user nova-compute[72766]: DEBUG nova.network.neutron [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:58:56 user nova-compute[72766]: DEBUG nova.compute.manager [req-20b525fc-7c8b-4317-a2e6-fba1a8e96999 req-d8101ae7-cae5-4ee6-b778-b7c1fb98bec1 service nova] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Received event network-changed-ad1ca253-760e-4db4-864a-bef71de4c1b7 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:58:56 user nova-compute[72766]: DEBUG nova.compute.manager [req-20b525fc-7c8b-4317-a2e6-fba1a8e96999 req-d8101ae7-cae5-4ee6-b778-b7c1fb98bec1 service nova] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Refreshing instance network info cache due to event network-changed-ad1ca253-760e-4db4-864a-bef71de4c1b7. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:58:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-20b525fc-7c8b-4317-a2e6-fba1a8e96999 req-d8101ae7-cae5-4ee6-b778-b7c1fb98bec1 service nova] Acquiring lock "refresh_cache-bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:58:56 user nova-compute[72766]: DEBUG nova.network.neutron [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG nova.network.neutron [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Updating instance_info_cache with network_info: [{"id": "ad1ca253-760e-4db4-864a-bef71de4c1b7", "address": "fa:16:3e:a1:12:c3", "network": {"id": "9bdd38f5-9734-4c5a-8a1c-5296215e6944", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1610393487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61a77920bef94526816c1a9c95531cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1ca253-76", "ovs_interfaceid": "ad1ca253-760e-4db4-864a-bef71de4c1b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Releasing lock "refresh_cache-bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG nova.compute.manager [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Instance network_info: |[{"id": "ad1ca253-760e-4db4-864a-bef71de4c1b7", "address": "fa:16:3e:a1:12:c3", "network": {"id": "9bdd38f5-9734-4c5a-8a1c-5296215e6944", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1610393487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61a77920bef94526816c1a9c95531cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1ca253-76", "ovs_interfaceid": "ad1ca253-760e-4db4-864a-bef71de4c1b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-20b525fc-7c8b-4317-a2e6-fba1a8e96999 req-d8101ae7-cae5-4ee6-b778-b7c1fb98bec1 service nova] Acquired lock "refresh_cache-bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG nova.network.neutron [req-20b525fc-7c8b-4317-a2e6-fba1a8e96999 req-d8101ae7-cae5-4ee6-b778-b7c1fb98bec1 service nova] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Refreshing network info cache for port ad1ca253-760e-4db4-864a-bef71de4c1b7 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Start _get_guest_xml network_info=[{"id": "ad1ca253-760e-4db4-864a-bef71de4c1b7", "address": "fa:16:3e:a1:12:c3", "network": {"id": "9bdd38f5-9734-4c5a-8a1c-5296215e6944", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1610393487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61a77920bef94526816c1a9c95531cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1ca253-76", "ovs_interfaceid": "ad1ca253-760e-4db4-864a-bef71de4c1b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd2900d30-2c4c-4d57-9135-d45564c0c596'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 22:58:57 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:58:57 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:58:57 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:58:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1740119132',display_name='tempest-VolumesAdminNegativeTest-server-1740119132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1740119132',id=13,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61a77920bef94526816c1a9c95531cb2',ramdisk_id='',reservation_id='r-1lwxb7i5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1115082797',owner_user_name='tempest-VolumesAdminNegativeTest-1115082797-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:58:53Z,user_data=None,user_id='d7df5fafd6ca47179dec9cd295c46233',uuid=bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad1ca253-760e-4db4-864a-bef71de4c1b7", "address": "fa:16:3e:a1:12:c3", "network": {"id": "9bdd38f5-9734-4c5a-8a1c-5296215e6944", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1610393487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61a77920bef94526816c1a9c95531cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1ca253-76", "ovs_interfaceid": "ad1ca253-760e-4db4-864a-bef71de4c1b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Converting VIF {"id": "ad1ca253-760e-4db4-864a-bef71de4c1b7", "address": "fa:16:3e:a1:12:c3", "network": {"id": "9bdd38f5-9734-4c5a-8a1c-5296215e6944", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1610393487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61a77920bef94526816c1a9c95531cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1ca253-76", "ovs_interfaceid": "ad1ca253-760e-4db4-864a-bef71de4c1b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:12:c3,bridge_name='br-int',has_traffic_filtering=True,id=ad1ca253-760e-4db4-864a-bef71de4c1b7,network=Network(9bdd38f5-9734-4c5a-8a1c-5296215e6944),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad1ca253-76') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG nova.objects.instance [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lazy-loading 'pci_devices' on Instance uuid bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] End _get_guest_xml xml=<domain type="kvm">
Aug 14 22:58:57 user nova-compute[72766]:   <uuid>bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a</uuid>
Aug 14 22:58:57 user nova-compute[72766]:   <name>instance-0000000d</name>
Aug 14 22:58:57 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 22:58:57 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 22:58:57 user nova-compute[72766]:   <metadata>
Aug 14 22:58:57 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:58:57 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 22:58:57 user nova-compute[72766]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1740119132</nova:name>
Aug 14 22:58:57 user nova-compute[72766]:       <nova:creationTime>2023-08-14 22:58:57</nova:creationTime>
Aug 14 22:58:57 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 22:58:57 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 22:58:57 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 22:58:57 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 22:58:57 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:58:57 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 22:58:57 user nova-compute[72766]:       </nova:flavor>
Aug 14 22:58:57 user nova-compute[72766]:       <nova:owner>
Aug 14 22:58:57 user nova-compute[72766]:         <nova:user uuid="d7df5fafd6ca47179dec9cd295c46233">tempest-VolumesAdminNegativeTest-1115082797-project-member</nova:user>
Aug 14 22:58:57 user nova-compute[72766]:         <nova:project uuid="61a77920bef94526816c1a9c95531cb2">tempest-VolumesAdminNegativeTest-1115082797</nova:project>
Aug 14 22:58:57 user nova-compute[72766]:       </nova:owner>
Aug 14 22:58:57 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 22:58:57 user nova-compute[72766]:       <nova:ports>
Aug 14 22:58:57 user nova-compute[72766]:         <nova:port uuid="ad1ca253-760e-4db4-864a-bef71de4c1b7">
Aug 14 22:58:57 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 22:58:57 user nova-compute[72766]:         </nova:port>
Aug 14 22:58:57 user nova-compute[72766]:       </nova:ports>
Aug 14 22:58:57 user nova-compute[72766]:     </nova:instance>
Aug 14 22:58:57 user nova-compute[72766]:   </metadata>
Aug 14 22:58:57 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 22:58:57 user nova-compute[72766]:     <system>
Aug 14 22:58:57 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 22:58:57 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 22:58:57 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 22:58:57 user nova-compute[72766]:       <entry name="serial">bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a</entry>
Aug 14 22:58:57 user nova-compute[72766]:       <entry name="uuid">bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a</entry>
Aug 14 22:58:57 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 22:58:57 user nova-compute[72766]:     </system>
Aug 14 22:58:57 user nova-compute[72766]:   </sysinfo>
Aug 14 22:58:57 user nova-compute[72766]:   <os>
Aug 14 22:58:57 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 22:58:57 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 22:58:57 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 22:58:57 user nova-compute[72766]:   </os>
Aug 14 22:58:57 user nova-compute[72766]:   <features>
Aug 14 22:58:57 user nova-compute[72766]:     <acpi/>
Aug 14 22:58:57 user nova-compute[72766]:     <apic/>
Aug 14 22:58:57 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 22:58:57 user nova-compute[72766]:   </features>
Aug 14 22:58:57 user nova-compute[72766]:   <clock offset="utc">
Aug 14 22:58:57 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 22:58:57 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 22:58:57 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 22:58:57 user nova-compute[72766]:   </clock>
Aug 14 22:58:57 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 22:58:57 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 22:58:57 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 22:58:57 user nova-compute[72766]:   </cpu>
Aug 14 22:58:57 user nova-compute[72766]:   <devices>
Aug 14 22:58:57 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 22:58:57 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 22:58:57 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a/disk"/>
Aug 14 22:58:57 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 22:58:57 user nova-compute[72766]:     </disk>
Aug 14 22:58:57 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 22:58:57 user nova-compute[72766]:       <mac address="fa:16:3e:a1:12:c3"/>
Aug 14 22:58:57 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 22:58:57 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 22:58:57 user nova-compute[72766]:       <target dev="tapad1ca253-76"/>
Aug 14 22:58:57 user nova-compute[72766]:     </interface>
Aug 14 22:58:57 user nova-compute[72766]:     <serial type="pty">
Aug 14 22:58:57 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a/console.log" append="off"/>
Aug 14 22:58:57 user nova-compute[72766]:     </serial>
Aug 14 22:58:57 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 22:58:57 user nova-compute[72766]:     <video>
Aug 14 22:58:57 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 22:58:57 user nova-compute[72766]:     </video>
Aug 14 22:58:57 user nova-compute[72766]:     <rng model="virtio">
Aug 14 22:58:57 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 22:58:57 user nova-compute[72766]:     </rng>
Aug 14 22:58:57 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 22:58:57 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 22:58:57 user nova-compute[72766]:       <stats period="10"/>
Aug 14 22:58:57 user nova-compute[72766]:     </memballoon>
Aug 14 22:58:57 user nova-compute[72766]:   </devices>
Aug 14 22:58:57 user nova-compute[72766]: </domain>
Aug 14 22:58:57 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:58:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1740119132',display_name='tempest-VolumesAdminNegativeTest-server-1740119132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1740119132',id=13,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61a77920bef94526816c1a9c95531cb2',ramdisk_id='',reservation_id='r-1lwxb7i5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1115082797',owner_user_name='tempest-VolumesAdminNegativeTest-1115082797-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:58:53Z,user_data=None,user_id='d7df5fafd6ca47179dec9cd295c46233',uuid=bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad1ca253-760e-4db4-864a-bef71de4c1b7", "address": "fa:16:3e:a1:12:c3", "network": {"id": "9bdd38f5-9734-4c5a-8a1c-5296215e6944", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1610393487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61a77920bef94526816c1a9c95531cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1ca253-76", "ovs_interfaceid": "ad1ca253-760e-4db4-864a-bef71de4c1b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Converting VIF {"id": "ad1ca253-760e-4db4-864a-bef71de4c1b7", "address": "fa:16:3e:a1:12:c3", "network": {"id": "9bdd38f5-9734-4c5a-8a1c-5296215e6944", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1610393487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61a77920bef94526816c1a9c95531cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1ca253-76", "ovs_interfaceid": "ad1ca253-760e-4db4-864a-bef71de4c1b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:12:c3,bridge_name='br-int',has_traffic_filtering=True,id=ad1ca253-760e-4db4-864a-bef71de4c1b7,network=Network(9bdd38f5-9734-4c5a-8a1c-5296215e6944),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad1ca253-76') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG os_vif [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:12:c3,bridge_name='br-int',has_traffic_filtering=True,id=ad1ca253-760e-4db4-864a-bef71de4c1b7,network=Network(9bdd38f5-9734-4c5a-8a1c-5296215e6944),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad1ca253-76') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad1ca253-76, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapad1ca253-76, col_values=(('external_ids', {'iface-id': 'ad1ca253-760e-4db4-864a-bef71de4c1b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:12:c3', 'vm-uuid': 'bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:57 user nova-compute[72766]: INFO os_vif [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:12:c3,bridge_name='br-int',has_traffic_filtering=True,id=ad1ca253-760e-4db4-864a-bef71de4c1b7,network=Network(9bdd38f5-9734-4c5a-8a1c-5296215e6944),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad1ca253-76')
Aug 14 22:58:57 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] No VIF found with MAC fa:16:3e:a1:12:c3, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Acquiring lock "c3c0a004-8d70-4253-bf17-b83088e30031" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "c3c0a004-8d70-4253-bf17-b83088e30031" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG nova.objects.instance [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lazy-loading 'flavor' on Instance uuid c3c0a004-8d70-4253-bf17-b83088e30031 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "c3c0a004-8d70-4253-bf17-b83088e30031" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG nova.network.neutron [req-20b525fc-7c8b-4317-a2e6-fba1a8e96999 req-d8101ae7-cae5-4ee6-b778-b7c1fb98bec1 service nova] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Updated VIF entry in instance network info cache for port ad1ca253-760e-4db4-864a-bef71de4c1b7. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG nova.network.neutron [req-20b525fc-7c8b-4317-a2e6-fba1a8e96999 req-d8101ae7-cae5-4ee6-b778-b7c1fb98bec1 service nova] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Updating instance_info_cache with network_info: [{"id": "ad1ca253-760e-4db4-864a-bef71de4c1b7", "address": "fa:16:3e:a1:12:c3", "network": {"id": "9bdd38f5-9734-4c5a-8a1c-5296215e6944", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1610393487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61a77920bef94526816c1a9c95531cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1ca253-76", "ovs_interfaceid": "ad1ca253-760e-4db4-864a-bef71de4c1b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-20b525fc-7c8b-4317-a2e6-fba1a8e96999 req-d8101ae7-cae5-4ee6-b778-b7c1fb98bec1 service nova] Releasing lock "refresh_cache-bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Acquiring lock "c3c0a004-8d70-4253-bf17-b83088e30031" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "c3c0a004-8d70-4253-bf17-b83088e30031" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:58:57 user nova-compute[72766]: INFO nova.compute.manager [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Attaching volume 767365c4-d886-43b3-b85c-ddc641e27391 to /dev/vdb
Aug 14 22:58:57 user nova-compute[72766]: DEBUG os_brick.utils [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:57 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0efec7-8bf0-4eed-8fe1-565468c68e34]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:58 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[f703b9e1-0725-4e84-906f-c067a1d0c195]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:58:58 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3e22d3-ec63-4e82-9d3a-b00287ddb976]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:58 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c84e88-be29-4791-86f3-770ba0bd22a7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:58:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 22:58:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:58:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:58:58 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 22:58:58 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb671ce-cc69-4e0b-b17c-1d37933e7c62]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:58:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 22:58:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 22:58:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 22:58:58 user nova-compute[72766]: DEBUG os_brick.utils [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:58:58 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Updating existing volume attachment record: 4adc55f2-6fe9-4205-ac98-9f6f74db3a3e {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 22:58:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:58:59 user nova-compute[72766]: DEBUG nova.compute.manager [req-7df5b0da-5cc1-44e3-a646-dd771f34b3a3 req-ff4d6ce8-4e8e-43b7-84fb-1d92bc13a841 service nova] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Received event network-vif-plugged-ad1ca253-760e-4db4-864a-bef71de4c1b7 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:58:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7df5b0da-5cc1-44e3-a646-dd771f34b3a3 req-ff4d6ce8-4e8e-43b7-84fb-1d92bc13a841 service nova] Acquiring lock "bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:58:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7df5b0da-5cc1-44e3-a646-dd771f34b3a3 req-ff4d6ce8-4e8e-43b7-84fb-1d92bc13a841 service nova] Lock "bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:58:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7df5b0da-5cc1-44e3-a646-dd771f34b3a3 req-ff4d6ce8-4e8e-43b7-84fb-1d92bc13a841 service nova] Lock "bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:58:59 user nova-compute[72766]: DEBUG nova.compute.manager [req-7df5b0da-5cc1-44e3-a646-dd771f34b3a3 req-ff4d6ce8-4e8e-43b7-84fb-1d92bc13a841 service nova] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] No waiting events found dispatching network-vif-plugged-ad1ca253-760e-4db4-864a-bef71de4c1b7 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:58:59 user nova-compute[72766]: WARNING nova.compute.manager [req-7df5b0da-5cc1-44e3-a646-dd771f34b3a3 req-ff4d6ce8-4e8e-43b7-84fb-1d92bc13a841 service nova] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Received unexpected event network-vif-plugged-ad1ca253-760e-4db4-864a-bef71de4c1b7 for instance with vm_state building and task_state spawning.
Aug 14 22:59:01 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692053941.282875, bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:59:01 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] VM Resumed (Lifecycle Event)
Aug 14 22:59:01 user nova-compute[72766]: DEBUG nova.compute.manager [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 22:59:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 22:59:01 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Instance spawned successfully.
Aug 14 22:59:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 22:59:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:59:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:59:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:59:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:59:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:59:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:59:01 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:59:01 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:59:01 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:59:01 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692053941.2851188, bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:59:01 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] VM Started (Lifecycle Event)
Aug 14 22:59:01 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:59:01 user nova-compute[72766]: DEBUG nova.compute.manager [req-df575645-83c3-4c73-8a04-02994b7ef402 req-05030158-1574-4505-acb5-29ac2a2b8037 service nova] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Received event network-vif-plugged-ad1ca253-760e-4db4-864a-bef71de4c1b7 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:59:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-df575645-83c3-4c73-8a04-02994b7ef402 req-05030158-1574-4505-acb5-29ac2a2b8037 service nova] Acquiring lock "bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-df575645-83c3-4c73-8a04-02994b7ef402 req-05030158-1574-4505-acb5-29ac2a2b8037 service nova] Lock "bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-df575645-83c3-4c73-8a04-02994b7ef402 req-05030158-1574-4505-acb5-29ac2a2b8037 service nova] Lock "bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:01 user nova-compute[72766]: DEBUG nova.compute.manager [req-df575645-83c3-4c73-8a04-02994b7ef402 req-05030158-1574-4505-acb5-29ac2a2b8037 service nova] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] No waiting events found dispatching network-vif-plugged-ad1ca253-760e-4db4-864a-bef71de4c1b7 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:59:01 user nova-compute[72766]: WARNING nova.compute.manager [req-df575645-83c3-4c73-8a04-02994b7ef402 req-05030158-1574-4505-acb5-29ac2a2b8037 service nova] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Received unexpected event network-vif-plugged-ad1ca253-760e-4db4-864a-bef71de4c1b7 for instance with vm_state building and task_state spawning.
Aug 14 22:59:01 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:59:01 user nova-compute[72766]: INFO nova.compute.manager [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Took 7.86 seconds to spawn the instance on the hypervisor.
Aug 14 22:59:01 user nova-compute[72766]: DEBUG nova.compute.manager [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:59:01 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:59:01 user nova-compute[72766]: INFO nova.compute.manager [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Took 8.93 seconds to build instance.
Aug 14 22:59:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7cc81fdd-8910-4f0a-95f5-1df63fa1039f tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lock "bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.042s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 22:59:02 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Creating image(s)
Aug 14 22:59:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Did not create local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Ensure instance console log exists: /opt/stack/data/nova/instances/a9d6011c-da14-4fcc-8e31-3063db57b2a6/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Start _get_guest_xml network_info=[{"id": "abead9ae-b0f3-474a-b77a-91733d6d3543", "address": "fa:16:3e:c8:a4:ce", "network": {"id": "58367c0d-d2f6-441c-8a2f-310e045b9cf0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-296205787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2299692e42b74c9c85a255f80990e870", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabead9ae-b0", "ovs_interfaceid": "abead9ae-b0f3-474a-b77a-91733d6d3543", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': 'b9a63dec-ae41-46e3-a3a1-69e746b24ac3', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wjbIlVOW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a9d6011c-da14-4fcc-8e31-3063db57b2a6', 'attached_at': '', 'detached_at': '', 'volume_id': 'bdfde062-9b2c-45a4-be3a-eccc18e9cef9', 'serial': 'bdfde062-9b2c-45a4-be3a-eccc18e9cef9'}, 'volume_type': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 22:59:02 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 14 22:59:02 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 14 22:59:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG nova.objects.instance [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Lazy-loading 'vcpu_model' on Instance uuid a9d6011c-da14-4fcc-8e31-3063db57b2a6 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wjbIlVOW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:59:02 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 22:59:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:59:02 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 22:59:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:59:02 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 22:59:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed157ebf-eb6d-4109-8a08-45caf39ed7fc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 22:59:02 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb67e16e-50d7-422a-99c6-9fa4eb171a93]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9] added
Aug 14 22:59:02 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[824bd2d7-09ab-45bb-9635-ae0f11064711]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9192b09-057d-4c35-bf1a-81a3ae9c210a]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wjbIlVOW {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wjbIlVOW" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[83dbb811-76dd-4f86-bc03-401819994e91]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wjbIlVOW'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[488cd21f-8950-482f-9502-4d4bee02e4bc]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f2bb72-d978-4d70-ad5c-a6a84d3c6159]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 22:59:02 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 22:59:02 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[94eed716-0353-4fb9-99e0-b308b9f53af8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9, portal: 172.16.0.220,3260]
Aug 14 22:59:02 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9, portal: 172.16.0.220,3260] successful.
Aug 14 22:59:02 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c1e217-e70e-421e-b348-85c9d3733548]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[54de0d36-3561-47c2-9859-7d646d735437]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 22:59:02 user nova-compute[72766]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 22:59:02 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 22:59:02 user nova-compute[72766]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 22:59:02 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe5749e-2da9-4ea0-be88-e5d7236b25ec]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:59:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wjbIlVOW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 22:59:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-288efa8e-4723-4444-839a-32877235f0e5 tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Acquiring lock "b55141bc-d426-4d35-8ae5-269ece19a793" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-288efa8e-4723-4444-839a-32877235f0e5 tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Lock "b55141bc-d426-4d35-8ae5-269ece19a793" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-288efa8e-4723-4444-839a-32877235f0e5 tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Acquiring lock "b55141bc-d426-4d35-8ae5-269ece19a793-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-288efa8e-4723-4444-839a-32877235f0e5 tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Lock "b55141bc-d426-4d35-8ae5-269ece19a793-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-288efa8e-4723-4444-839a-32877235f0e5 tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Lock "b55141bc-d426-4d35-8ae5-269ece19a793-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:03 user nova-compute[72766]: INFO nova.compute.manager [None req-288efa8e-4723-4444-839a-32877235f0e5 tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Terminating instance
Aug 14 22:59:03 user nova-compute[72766]: DEBUG nova.compute.manager [None req-288efa8e-4723-4444-839a-32877235f0e5 tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 22:59:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:03 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:59:03 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '23265626139646563', 'path': '/dev/sdb'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:59:03 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265626139646563', 'path': '/dev/sdb'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 22:59:03 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T22:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1337014418',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-273402320',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPaXy9hxXbMdshWzbQLXVvz7nDESavIOLXia9W/DDo7wSvfhX1RXq42V2N0aLa9Nl7IVLmCAYxoggrECsnBwocK7ffwayiXoTZ4mdKpIHRx8EnNL76GFfNmkvMKW2r7fg==',key_name='tempest-keypair-855485889',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:56:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2299692e42b74c9c85a255f80990e870',ramdisk_id='',reservation_id='r-f401gegj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1913842238',owner_user_name='tempest-ServerActionsV293TestJSON-1913842238-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:58:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e0c74f355e34ec6b175e136f6401b20',uuid=a9d6011c-da14-4fcc-8e31-3063db57b2a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "abead9ae-b0f3-474a-b77a-91733d6d3543", "address": "fa:16:3e:c8:a4:ce", "network": {"id": "58367c0d-d2f6-441c-8a2f-310e045b9cf0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-296205787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2299692e42b74c9c85a255f80990e870", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabead9ae-b0", "ovs_interfaceid": "abead9ae-b0f3-474a-b77a-91733d6d3543", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 22:59:03 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Converting VIF {"id": "abead9ae-b0f3-474a-b77a-91733d6d3543", "address": "fa:16:3e:c8:a4:ce", "network": {"id": "58367c0d-d2f6-441c-8a2f-310e045b9cf0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-296205787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2299692e42b74c9c85a255f80990e870", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabead9ae-b0", "ovs_interfaceid": "abead9ae-b0f3-474a-b77a-91733d6d3543", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:59:03 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:a4:ce,bridge_name='br-int',has_traffic_filtering=True,id=abead9ae-b0f3-474a-b77a-91733d6d3543,network=Network(58367c0d-d2f6-441c-8a2f-310e045b9cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabead9ae-b0') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:59:03 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] End _get_guest_xml xml=<domain type="kvm">
Aug 14 22:59:03 user nova-compute[72766]:   <uuid>a9d6011c-da14-4fcc-8e31-3063db57b2a6</uuid>
Aug 14 22:59:03 user nova-compute[72766]:   <name>instance-00000009</name>
Aug 14 22:59:03 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 22:59:03 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 22:59:03 user nova-compute[72766]:   <metadata>
Aug 14 22:59:03 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:59:03 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 22:59:03 user nova-compute[72766]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1337014418</nova:name>
Aug 14 22:59:03 user nova-compute[72766]:       <nova:creationTime>2023-08-14 22:59:02</nova:creationTime>
Aug 14 22:59:03 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 22:59:03 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 22:59:03 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 22:59:03 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 22:59:03 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:59:03 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 22:59:03 user nova-compute[72766]:       </nova:flavor>
Aug 14 22:59:03 user nova-compute[72766]:       <nova:owner>
Aug 14 22:59:03 user nova-compute[72766]:         <nova:user uuid="7e0c74f355e34ec6b175e136f6401b20">tempest-ServerActionsV293TestJSON-1913842238-project-member</nova:user>
Aug 14 22:59:03 user nova-compute[72766]:         <nova:project uuid="2299692e42b74c9c85a255f80990e870">tempest-ServerActionsV293TestJSON-1913842238</nova:project>
Aug 14 22:59:03 user nova-compute[72766]:       </nova:owner>
Aug 14 22:59:03 user nova-compute[72766]:       <nova:ports>
Aug 14 22:59:03 user nova-compute[72766]:         <nova:port uuid="abead9ae-b0f3-474a-b77a-91733d6d3543">
Aug 14 22:59:03 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 22:59:03 user nova-compute[72766]:         </nova:port>
Aug 14 22:59:03 user nova-compute[72766]:       </nova:ports>
Aug 14 22:59:03 user nova-compute[72766]:     </nova:instance>
Aug 14 22:59:03 user nova-compute[72766]:   </metadata>
Aug 14 22:59:03 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 22:59:03 user nova-compute[72766]:     <system>
Aug 14 22:59:03 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 22:59:03 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 22:59:03 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 22:59:03 user nova-compute[72766]:       <entry name="serial">a9d6011c-da14-4fcc-8e31-3063db57b2a6</entry>
Aug 14 22:59:03 user nova-compute[72766]:       <entry name="uuid">a9d6011c-da14-4fcc-8e31-3063db57b2a6</entry>
Aug 14 22:59:03 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 22:59:03 user nova-compute[72766]:     </system>
Aug 14 22:59:03 user nova-compute[72766]:   </sysinfo>
Aug 14 22:59:03 user nova-compute[72766]:   <os>
Aug 14 22:59:03 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 22:59:03 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 22:59:03 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 22:59:03 user nova-compute[72766]:   </os>
Aug 14 22:59:03 user nova-compute[72766]:   <features>
Aug 14 22:59:03 user nova-compute[72766]:     <acpi/>
Aug 14 22:59:03 user nova-compute[72766]:     <apic/>
Aug 14 22:59:03 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 22:59:03 user nova-compute[72766]:   </features>
Aug 14 22:59:03 user nova-compute[72766]:   <clock offset="utc">
Aug 14 22:59:03 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 22:59:03 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 22:59:03 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 22:59:03 user nova-compute[72766]:   </clock>
Aug 14 22:59:03 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 22:59:03 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 22:59:03 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 22:59:03 user nova-compute[72766]:   </cpu>
Aug 14 22:59:03 user nova-compute[72766]:   <devices>
Aug 14 22:59:03 user nova-compute[72766]:     <disk type="block" device="disk">
Aug 14 22:59:03 user nova-compute[72766]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:59:03 user nova-compute[72766]:       <source dev="/dev/sdb"/>
Aug 14 22:59:03 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 22:59:03 user nova-compute[72766]:       <serial>bdfde062-9b2c-45a4-be3a-eccc18e9cef9</serial>
Aug 14 22:59:03 user nova-compute[72766]:     </disk>
Aug 14 22:59:03 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 22:59:03 user nova-compute[72766]:       <mac address="fa:16:3e:c8:a4:ce"/>
Aug 14 22:59:03 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 22:59:03 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 22:59:03 user nova-compute[72766]:       <target dev="tapabead9ae-b0"/>
Aug 14 22:59:03 user nova-compute[72766]:     </interface>
Aug 14 22:59:03 user nova-compute[72766]:     <serial type="pty">
Aug 14 22:59:03 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/a9d6011c-da14-4fcc-8e31-3063db57b2a6/console.log" append="off"/>
Aug 14 22:59:03 user nova-compute[72766]:     </serial>
Aug 14 22:59:03 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 22:59:03 user nova-compute[72766]:     <video>
Aug 14 22:59:03 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 22:59:03 user nova-compute[72766]:     </video>
Aug 14 22:59:03 user nova-compute[72766]:     <rng model="virtio">
Aug 14 22:59:03 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 22:59:03 user nova-compute[72766]:     </rng>
Aug 14 22:59:03 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 22:59:03 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 22:59:03 user nova-compute[72766]:       <stats period="10"/>
Aug 14 22:59:03 user nova-compute[72766]:     </memballoon>
Aug 14 22:59:03 user nova-compute[72766]:   </devices>
Aug 14 22:59:03 user nova-compute[72766]: </domain>
Aug 14 22:59:03 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 22:59:03 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T22:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1337014418',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-273402320',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPaXy9hxXbMdshWzbQLXVvz7nDESavIOLXia9W/DDo7wSvfhX1RXq42V2N0aLa9Nl7IVLmCAYxoggrECsnBwocK7ffwayiXoTZ4mdKpIHRx8EnNL76GFfNmkvMKW2r7fg==',key_name='tempest-keypair-855485889',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:56:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2299692e42b74c9c85a255f80990e870',ramdisk_id='',reservation_id='r-f401gegj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1913842238',owner_user_name='tempest-ServerActionsV293TestJSON-1913842238-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:58:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e0c74f355e34ec6b175e136f6401b20',uuid=a9d6011c-da14-4fcc-8e31-3063db57b2a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "abead9ae-b0f3-474a-b77a-91733d6d3543", "address": "fa:16:3e:c8:a4:ce", "network": {"id": "58367c0d-d2f6-441c-8a2f-310e045b9cf0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-296205787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2299692e42b74c9c85a255f80990e870", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabead9ae-b0", "ovs_interfaceid": "abead9ae-b0f3-474a-b77a-91733d6d3543", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 22:59:03 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Converting VIF {"id": "abead9ae-b0f3-474a-b77a-91733d6d3543", "address": "fa:16:3e:c8:a4:ce", "network": {"id": "58367c0d-d2f6-441c-8a2f-310e045b9cf0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-296205787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2299692e42b74c9c85a255f80990e870", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabead9ae-b0", "ovs_interfaceid": "abead9ae-b0f3-474a-b77a-91733d6d3543", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:59:03 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:a4:ce,bridge_name='br-int',has_traffic_filtering=True,id=abead9ae-b0f3-474a-b77a-91733d6d3543,network=Network(58367c0d-d2f6-441c-8a2f-310e045b9cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabead9ae-b0') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:59:03 user nova-compute[72766]: DEBUG os_vif [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:a4:ce,bridge_name='br-int',has_traffic_filtering=True,id=abead9ae-b0f3-474a-b77a-91733d6d3543,network=Network(58367c0d-d2f6-441c-8a2f-310e045b9cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabead9ae-b0') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 22:59:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:59:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 22:59:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapabead9ae-b0, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:59:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapabead9ae-b0, col_values=(('external_ids', {'iface-id': 'abead9ae-b0f3-474a-b77a-91733d6d3543', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:a4:ce', 'vm-uuid': 'a9d6011c-da14-4fcc-8e31-3063db57b2a6'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:59:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:59:03 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Instance destroyed successfully.
Aug 14 22:59:03 user nova-compute[72766]: DEBUG nova.objects.instance [None req-288efa8e-4723-4444-839a-32877235f0e5 tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Lazy-loading 'resources' on Instance uuid b55141bc-d426-4d35-8ae5-269ece19a793 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:59:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:03 user nova-compute[72766]: INFO os_vif [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:a4:ce,bridge_name='br-int',has_traffic_filtering=True,id=abead9ae-b0f3-474a-b77a-91733d6d3543,network=Network(58367c0d-d2f6-441c-8a2f-310e045b9cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabead9ae-b0')
Aug 14 22:59:03 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-288efa8e-4723-4444-839a-32877235f0e5 tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:55:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1447188578',display_name='tempest-VolumesAssistedSnapshotsTest-server-1447188578',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1447188578',id=7,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEIgCLOQgouALAtgNT17letDNZPJ9xLFFnymZzS2ccKSk7R31HiuQIYQogsLkqcRPyRXFu22ZkVFiX8t8a7t2JieZMfz2vc1u6hCWa4M8g+nNouh2YDMv/HLPReSWBDlA==',key_name='tempest-keypair-722593446',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:56:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='da868713db654a55b759f16167c88297',ramdisk_id='',reservation_id='r-9g5ubyz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-720458683',owner_user_name='tempest-VolumesAssistedSnapshotsTest-720458683-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:56:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22c19a1dd8414aa4bdb57ef938185873',uuid=b55141bc-d426-4d35-8ae5-269ece19a793,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3eb61059-fbcd-4dbc-9a10-81aed042e936", "address": "fa:16:3e:b5:ed:a3", "network": {"id": "0ebb9d77-2a5a-4ef1-923e-bd683ccc798c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-8258803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da868713db654a55b759f16167c88297", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb61059-fb", "ovs_interfaceid": "3eb61059-fbcd-4dbc-9a10-81aed042e936", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 22:59:03 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-288efa8e-4723-4444-839a-32877235f0e5 tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Converting VIF {"id": "3eb61059-fbcd-4dbc-9a10-81aed042e936", "address": "fa:16:3e:b5:ed:a3", "network": {"id": "0ebb9d77-2a5a-4ef1-923e-bd683ccc798c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-8258803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da868713db654a55b759f16167c88297", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb61059-fb", "ovs_interfaceid": "3eb61059-fbcd-4dbc-9a10-81aed042e936", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:59:03 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-288efa8e-4723-4444-839a-32877235f0e5 tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:ed:a3,bridge_name='br-int',has_traffic_filtering=True,id=3eb61059-fbcd-4dbc-9a10-81aed042e936,network=Network(0ebb9d77-2a5a-4ef1-923e-bd683ccc798c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eb61059-fb') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:59:03 user nova-compute[72766]: DEBUG os_vif [None req-288efa8e-4723-4444-839a-32877235f0e5 tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:ed:a3,bridge_name='br-int',has_traffic_filtering=True,id=3eb61059-fbcd-4dbc-9a10-81aed042e936,network=Network(0ebb9d77-2a5a-4ef1-923e-bd683ccc798c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eb61059-fb') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 22:59:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3eb61059-fb, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:59:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:59:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:03 user nova-compute[72766]: INFO os_vif [None req-288efa8e-4723-4444-839a-32877235f0e5 tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:ed:a3,bridge_name='br-int',has_traffic_filtering=True,id=3eb61059-fbcd-4dbc-9a10-81aed042e936,network=Network(0ebb9d77-2a5a-4ef1-923e-bd683ccc798c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eb61059-fb')
Aug 14 22:59:03 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-288efa8e-4723-4444-839a-32877235f0e5 tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Deleting instance files /opt/stack/data/nova/instances/b55141bc-d426-4d35-8ae5-269ece19a793_del
Aug 14 22:59:03 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-288efa8e-4723-4444-839a-32877235f0e5 tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Deletion of /opt/stack/data/nova/instances/b55141bc-d426-4d35-8ae5-269ece19a793_del complete
Aug 14 22:59:03 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:59:03 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] No VIF found with MAC fa:16:3e:c8:a4:ce, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:59:04 user nova-compute[72766]: INFO nova.compute.manager [None req-288efa8e-4723-4444-839a-32877235f0e5 tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Took 1.02 seconds to destroy the instance on the hypervisor.
Aug 14 22:59:04 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-288efa8e-4723-4444-839a-32877235f0e5 tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 22:59:04 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 22:59:04 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 22:59:05 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:59:05 user nova-compute[72766]: DEBUG nova.compute.manager [req-e4c8a5f5-4edc-4e59-b378-5cfdfa8b5cbf req-607e8ebb-1a4c-4f28-b380-0753efaf9712 service nova] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Received event network-vif-deleted-3eb61059-fbcd-4dbc-9a10-81aed042e936 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:59:05 user nova-compute[72766]: INFO nova.compute.manager [req-e4c8a5f5-4edc-4e59-b378-5cfdfa8b5cbf req-607e8ebb-1a4c-4f28-b380-0753efaf9712 service nova] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Neutron deleted interface 3eb61059-fbcd-4dbc-9a10-81aed042e936; detaching it from the instance and deleting it from the info cache
Aug 14 22:59:05 user nova-compute[72766]: DEBUG nova.network.neutron [req-e4c8a5f5-4edc-4e59-b378-5cfdfa8b5cbf req-607e8ebb-1a4c-4f28-b380-0753efaf9712 service nova] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:59:05 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Took 1.48 seconds to deallocate network for instance.
Aug 14 22:59:05 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:05 user nova-compute[72766]: DEBUG nova.compute.manager [req-e4c8a5f5-4edc-4e59-b378-5cfdfa8b5cbf req-607e8ebb-1a4c-4f28-b380-0753efaf9712 service nova] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Detach interface failed, port_id=3eb61059-fbcd-4dbc-9a10-81aed042e936, reason: Instance b55141bc-d426-4d35-8ae5-269ece19a793 could not be found. {{(pid=72766) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 22:59:05 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:05 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5aa7050b-2006-4f63-8f50-10639dbfc8c7 tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Acquiring lock "bde3ff44-cdf8-4ef7-bb7d-50865129268f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5aa7050b-2006-4f63-8f50-10639dbfc8c7 tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Lock "bde3ff44-cdf8-4ef7-bb7d-50865129268f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5aa7050b-2006-4f63-8f50-10639dbfc8c7 tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Acquiring lock "bde3ff44-cdf8-4ef7-bb7d-50865129268f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5aa7050b-2006-4f63-8f50-10639dbfc8c7 tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Lock "bde3ff44-cdf8-4ef7-bb7d-50865129268f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5aa7050b-2006-4f63-8f50-10639dbfc8c7 tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Lock "bde3ff44-cdf8-4ef7-bb7d-50865129268f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:05 user nova-compute[72766]: INFO nova.compute.manager [None req-5aa7050b-2006-4f63-8f50-10639dbfc8c7 tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Terminating instance
Aug 14 22:59:05 user nova-compute[72766]: DEBUG nova.compute.manager [None req-5aa7050b-2006-4f63-8f50-10639dbfc8c7 tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 22:59:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-288efa8e-4723-4444-839a-32877235f0e5 tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-288efa8e-4723-4444-839a-32877235f0e5 tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:05 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:05 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:06 user nova-compute[72766]: DEBUG nova.compute.manager [req-e54a660b-dadf-4e72-9ce5-eced6bb549b9 req-3c0702bf-b45f-44bc-83d6-69d647fed5bf service nova] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Received event network-vif-unplugged-bcaf8075-d371-4fcb-a6af-88b9a81dfeb8 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:59:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e54a660b-dadf-4e72-9ce5-eced6bb549b9 req-3c0702bf-b45f-44bc-83d6-69d647fed5bf service nova] Acquiring lock "bde3ff44-cdf8-4ef7-bb7d-50865129268f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e54a660b-dadf-4e72-9ce5-eced6bb549b9 req-3c0702bf-b45f-44bc-83d6-69d647fed5bf service nova] Lock "bde3ff44-cdf8-4ef7-bb7d-50865129268f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e54a660b-dadf-4e72-9ce5-eced6bb549b9 req-3c0702bf-b45f-44bc-83d6-69d647fed5bf service nova] Lock "bde3ff44-cdf8-4ef7-bb7d-50865129268f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:06 user nova-compute[72766]: DEBUG nova.compute.manager [req-e54a660b-dadf-4e72-9ce5-eced6bb549b9 req-3c0702bf-b45f-44bc-83d6-69d647fed5bf service nova] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] No waiting events found dispatching network-vif-unplugged-bcaf8075-d371-4fcb-a6af-88b9a81dfeb8 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:59:06 user nova-compute[72766]: DEBUG nova.compute.manager [req-e54a660b-dadf-4e72-9ce5-eced6bb549b9 req-3c0702bf-b45f-44bc-83d6-69d647fed5bf service nova] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Received event network-vif-unplugged-bcaf8075-d371-4fcb-a6af-88b9a81dfeb8 for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 22:59:06 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-288efa8e-4723-4444-839a-32877235f0e5 tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:59:06 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-288efa8e-4723-4444-839a-32877235f0e5 tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:59:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-288efa8e-4723-4444-839a-32877235f0e5 tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.856s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:06 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-288efa8e-4723-4444-839a-32877235f0e5 tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Deleted allocations for instance b55141bc-d426-4d35-8ae5-269ece19a793
Aug 14 22:59:06 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:06 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Instance destroyed successfully.
Aug 14 22:59:06 user nova-compute[72766]: DEBUG nova.objects.instance [None req-5aa7050b-2006-4f63-8f50-10639dbfc8c7 tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Lazy-loading 'resources' on Instance uuid bde3ff44-cdf8-4ef7-bb7d-50865129268f {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:59:06 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:06 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-5aa7050b-2006-4f63-8f50-10639dbfc8c7 tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:57:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1192671324',display_name='tempest-ServersNegativeTestJSON-server-1192671324',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1192671324',id=11,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:57:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='142137ab929f4e5289b06319af10751b',ramdisk_id='',reservation_id='r-hgl817p6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-968182857',owner_user_name='tempest-ServersNegativeTestJSON-968182857-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:57:25Z,user_data=None,user_id='4701a1ef84d94ce99ec55e44c1df9032',uuid=bde3ff44-cdf8-4ef7-bb7d-50865129268f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bcaf8075-d371-4fcb-a6af-88b9a81dfeb8", "address": "fa:16:3e:6f:52:c5", "network": {"id": "5464d98e-0483-4d6d-895b-b51c50c0cfd9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-581355694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142137ab929f4e5289b06319af10751b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcaf8075-d3", "ovs_interfaceid": "bcaf8075-d371-4fcb-a6af-88b9a81dfeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 22:59:06 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-5aa7050b-2006-4f63-8f50-10639dbfc8c7 tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Converting VIF {"id": "bcaf8075-d371-4fcb-a6af-88b9a81dfeb8", "address": "fa:16:3e:6f:52:c5", "network": {"id": "5464d98e-0483-4d6d-895b-b51c50c0cfd9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-581355694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142137ab929f4e5289b06319af10751b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcaf8075-d3", "ovs_interfaceid": "bcaf8075-d371-4fcb-a6af-88b9a81dfeb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:59:06 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-5aa7050b-2006-4f63-8f50-10639dbfc8c7 tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:52:c5,bridge_name='br-int',has_traffic_filtering=True,id=bcaf8075-d371-4fcb-a6af-88b9a81dfeb8,network=Network(5464d98e-0483-4d6d-895b-b51c50c0cfd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcaf8075-d3') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:59:06 user nova-compute[72766]: DEBUG os_vif [None req-5aa7050b-2006-4f63-8f50-10639dbfc8c7 tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:52:c5,bridge_name='br-int',has_traffic_filtering=True,id=bcaf8075-d371-4fcb-a6af-88b9a81dfeb8,network=Network(5464d98e-0483-4d6d-895b-b51c50c0cfd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcaf8075-d3') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 22:59:06 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:06 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbcaf8075-d3, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:59:06 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:06 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:59:06 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:06 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:06 user nova-compute[72766]: INFO os_vif [None req-5aa7050b-2006-4f63-8f50-10639dbfc8c7 tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:52:c5,bridge_name='br-int',has_traffic_filtering=True,id=bcaf8075-d371-4fcb-a6af-88b9a81dfeb8,network=Network(5464d98e-0483-4d6d-895b-b51c50c0cfd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcaf8075-d3')
Aug 14 22:59:06 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-5aa7050b-2006-4f63-8f50-10639dbfc8c7 tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Deleting instance files /opt/stack/data/nova/instances/bde3ff44-cdf8-4ef7-bb7d-50865129268f_del
Aug 14 22:59:06 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-5aa7050b-2006-4f63-8f50-10639dbfc8c7 tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Deletion of /opt/stack/data/nova/instances/bde3ff44-cdf8-4ef7-bb7d-50865129268f_del complete
Aug 14 22:59:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-288efa8e-4723-4444-839a-32877235f0e5 tempest-VolumesAssistedSnapshotsTest-720458683 tempest-VolumesAssistedSnapshotsTest-720458683-project-member] Lock "b55141bc-d426-4d35-8ae5-269ece19a793" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.796s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:06 user nova-compute[72766]: INFO nova.compute.manager [None req-5aa7050b-2006-4f63-8f50-10639dbfc8c7 tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Took 1.26 seconds to destroy the instance on the hypervisor.
Aug 14 22:59:06 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-5aa7050b-2006-4f63-8f50-10639dbfc8c7 tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 22:59:06 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 22:59:06 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 22:59:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:07 user nova-compute[72766]: DEBUG nova.compute.manager [req-edc1b234-f0e7-4928-b4fd-6afcc2d7fd66 req-733f3a89-fb02-4ec6-979d-f4518f195ae8 service nova] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Received event network-vif-plugged-abead9ae-b0f3-474a-b77a-91733d6d3543 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:59:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-edc1b234-f0e7-4928-b4fd-6afcc2d7fd66 req-733f3a89-fb02-4ec6-979d-f4518f195ae8 service nova] Acquiring lock "a9d6011c-da14-4fcc-8e31-3063db57b2a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-edc1b234-f0e7-4928-b4fd-6afcc2d7fd66 req-733f3a89-fb02-4ec6-979d-f4518f195ae8 service nova] Lock "a9d6011c-da14-4fcc-8e31-3063db57b2a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-edc1b234-f0e7-4928-b4fd-6afcc2d7fd66 req-733f3a89-fb02-4ec6-979d-f4518f195ae8 service nova] Lock "a9d6011c-da14-4fcc-8e31-3063db57b2a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:07 user nova-compute[72766]: DEBUG nova.compute.manager [req-edc1b234-f0e7-4928-b4fd-6afcc2d7fd66 req-733f3a89-fb02-4ec6-979d-f4518f195ae8 service nova] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] No waiting events found dispatching network-vif-plugged-abead9ae-b0f3-474a-b77a-91733d6d3543 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:59:07 user nova-compute[72766]: WARNING nova.compute.manager [req-edc1b234-f0e7-4928-b4fd-6afcc2d7fd66 req-733f3a89-fb02-4ec6-979d-f4518f195ae8 service nova] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Received unexpected event network-vif-plugged-abead9ae-b0f3-474a-b77a-91733d6d3543 for instance with vm_state active and task_state rebuild_spawning.
Aug 14 22:59:07 user nova-compute[72766]: DEBUG nova.compute.manager [req-edc1b234-f0e7-4928-b4fd-6afcc2d7fd66 req-733f3a89-fb02-4ec6-979d-f4518f195ae8 service nova] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Received event network-vif-plugged-abead9ae-b0f3-474a-b77a-91733d6d3543 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:59:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-edc1b234-f0e7-4928-b4fd-6afcc2d7fd66 req-733f3a89-fb02-4ec6-979d-f4518f195ae8 service nova] Acquiring lock "a9d6011c-da14-4fcc-8e31-3063db57b2a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-edc1b234-f0e7-4928-b4fd-6afcc2d7fd66 req-733f3a89-fb02-4ec6-979d-f4518f195ae8 service nova] Lock "a9d6011c-da14-4fcc-8e31-3063db57b2a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-edc1b234-f0e7-4928-b4fd-6afcc2d7fd66 req-733f3a89-fb02-4ec6-979d-f4518f195ae8 service nova] Lock "a9d6011c-da14-4fcc-8e31-3063db57b2a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:07 user nova-compute[72766]: DEBUG nova.compute.manager [req-edc1b234-f0e7-4928-b4fd-6afcc2d7fd66 req-733f3a89-fb02-4ec6-979d-f4518f195ae8 service nova] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] No waiting events found dispatching network-vif-plugged-abead9ae-b0f3-474a-b77a-91733d6d3543 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:59:07 user nova-compute[72766]: WARNING nova.compute.manager [req-edc1b234-f0e7-4928-b4fd-6afcc2d7fd66 req-733f3a89-fb02-4ec6-979d-f4518f195ae8 service nova] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Received unexpected event network-vif-plugged-abead9ae-b0f3-474a-b77a-91733d6d3543 for instance with vm_state active and task_state rebuild_spawning.
Aug 14 22:59:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d66c902c-4e69-4f40-89d8-770572afec34 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Acquiring lock "90b55775-2f14-4c80-b48a-b1eed2b570dc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d66c902c-4e69-4f40-89d8-770572afec34 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Lock "90b55775-2f14-4c80-b48a-b1eed2b570dc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d66c902c-4e69-4f40-89d8-770572afec34 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Acquiring lock "90b55775-2f14-4c80-b48a-b1eed2b570dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d66c902c-4e69-4f40-89d8-770572afec34 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Lock "90b55775-2f14-4c80-b48a-b1eed2b570dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d66c902c-4e69-4f40-89d8-770572afec34 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Lock "90b55775-2f14-4c80-b48a-b1eed2b570dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.003s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:07 user nova-compute[72766]: INFO nova.compute.manager [None req-d66c902c-4e69-4f40-89d8-770572afec34 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Terminating instance
Aug 14 22:59:07 user nova-compute[72766]: DEBUG nova.compute.manager [None req-d66c902c-4e69-4f40-89d8-770572afec34 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 22:59:07 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:59:07 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Took 0.78 seconds to deallocate network for instance.
Aug 14 22:59:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5aa7050b-2006-4f63-8f50-10639dbfc8c7 tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5aa7050b-2006-4f63-8f50-10639dbfc8c7 tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:08 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-5aa7050b-2006-4f63-8f50-10639dbfc8c7 tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:59:08 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-5aa7050b-2006-4f63-8f50-10639dbfc8c7 tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:59:08 user nova-compute[72766]: DEBUG nova.compute.manager [req-f9cdc62e-7cfc-4a87-a032-b051aac37cbb req-32ed708d-b0fc-4a9e-bf98-dc50cdc684ef service nova] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Received event network-vif-plugged-bcaf8075-d371-4fcb-a6af-88b9a81dfeb8 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:59:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f9cdc62e-7cfc-4a87-a032-b051aac37cbb req-32ed708d-b0fc-4a9e-bf98-dc50cdc684ef service nova] Acquiring lock "bde3ff44-cdf8-4ef7-bb7d-50865129268f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f9cdc62e-7cfc-4a87-a032-b051aac37cbb req-32ed708d-b0fc-4a9e-bf98-dc50cdc684ef service nova] Lock "bde3ff44-cdf8-4ef7-bb7d-50865129268f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f9cdc62e-7cfc-4a87-a032-b051aac37cbb req-32ed708d-b0fc-4a9e-bf98-dc50cdc684ef service nova] Lock "bde3ff44-cdf8-4ef7-bb7d-50865129268f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:08 user nova-compute[72766]: DEBUG nova.compute.manager [req-f9cdc62e-7cfc-4a87-a032-b051aac37cbb req-32ed708d-b0fc-4a9e-bf98-dc50cdc684ef service nova] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] No waiting events found dispatching network-vif-plugged-bcaf8075-d371-4fcb-a6af-88b9a81dfeb8 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:59:08 user nova-compute[72766]: WARNING nova.compute.manager [req-f9cdc62e-7cfc-4a87-a032-b051aac37cbb req-32ed708d-b0fc-4a9e-bf98-dc50cdc684ef service nova] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Received unexpected event network-vif-plugged-bcaf8075-d371-4fcb-a6af-88b9a81dfeb8 for instance with vm_state deleted and task_state None.
Aug 14 22:59:08 user nova-compute[72766]: DEBUG nova.compute.manager [req-f9cdc62e-7cfc-4a87-a032-b051aac37cbb req-32ed708d-b0fc-4a9e-bf98-dc50cdc684ef service nova] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Received event network-vif-unplugged-58e0b222-3a0a-40d3-ad60-e92985bd3584 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:59:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f9cdc62e-7cfc-4a87-a032-b051aac37cbb req-32ed708d-b0fc-4a9e-bf98-dc50cdc684ef service nova] Acquiring lock "90b55775-2f14-4c80-b48a-b1eed2b570dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f9cdc62e-7cfc-4a87-a032-b051aac37cbb req-32ed708d-b0fc-4a9e-bf98-dc50cdc684ef service nova] Lock "90b55775-2f14-4c80-b48a-b1eed2b570dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f9cdc62e-7cfc-4a87-a032-b051aac37cbb req-32ed708d-b0fc-4a9e-bf98-dc50cdc684ef service nova] Lock "90b55775-2f14-4c80-b48a-b1eed2b570dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:08 user nova-compute[72766]: DEBUG nova.compute.manager [req-f9cdc62e-7cfc-4a87-a032-b051aac37cbb req-32ed708d-b0fc-4a9e-bf98-dc50cdc684ef service nova] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] No waiting events found dispatching network-vif-unplugged-58e0b222-3a0a-40d3-ad60-e92985bd3584 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:59:08 user nova-compute[72766]: DEBUG nova.compute.manager [req-f9cdc62e-7cfc-4a87-a032-b051aac37cbb req-32ed708d-b0fc-4a9e-bf98-dc50cdc684ef service nova] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Received event network-vif-unplugged-58e0b222-3a0a-40d3-ad60-e92985bd3584 for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 22:59:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5aa7050b-2006-4f63-8f50-10639dbfc8c7 tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.505s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:08 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-5aa7050b-2006-4f63-8f50-10639dbfc8c7 tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Deleted allocations for instance bde3ff44-cdf8-4ef7-bb7d-50865129268f
Aug 14 22:59:08 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Instance destroyed successfully.
Aug 14 22:59:08 user nova-compute[72766]: DEBUG nova.objects.instance [None req-d66c902c-4e69-4f40-89d8-770572afec34 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Lazy-loading 'resources' on Instance uuid 90b55775-2f14-4c80-b48a-b1eed2b570dc {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:59:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-d66c902c-4e69-4f40-89d8-770572afec34 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T22:55:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-359420211',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-359420211',id=6,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8cq16Tr/aSGWtJWb/xfeRNJOb+B6LjH5taG4rznYJbzp5KjGb+MpXm0+8Y+Xs3FuiWq9fVeEhIpGtH4iqY05CSFniUjByOF+zxj8vXJaj8j0+QLFR098sJu8pYQ2V7Ow==',key_name='tempest-keypair-975754438',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:56:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d841b7f732a743658e035777c8629c50',ramdisk_id='',reservation_id='r-iogn86da',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1079325823',owner_user_name='tempest-TaggedAttachmentsTest-1079325823-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adf9d286eb5749e7a5278af949ca1a9f',uuid=90b55775-2f14-4c80-b48a-b1eed2b570dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58e0b222-3a0a-40d3-ad60-e92985bd3584", "address": "fa:16:3e:5e:2c:02", "network": {"id": "6f03ef5e-cea3-4538-9f91-e35f756665a1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1408762454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d841b7f732a743658e035777c8629c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e0b222-3a", "ovs_interfaceid": "58e0b222-3a0a-40d3-ad60-e92985bd3584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 22:59:08 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-d66c902c-4e69-4f40-89d8-770572afec34 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Converting VIF {"id": "58e0b222-3a0a-40d3-ad60-e92985bd3584", "address": "fa:16:3e:5e:2c:02", "network": {"id": "6f03ef5e-cea3-4538-9f91-e35f756665a1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1408762454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d841b7f732a743658e035777c8629c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e0b222-3a", "ovs_interfaceid": "58e0b222-3a0a-40d3-ad60-e92985bd3584", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:59:08 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-d66c902c-4e69-4f40-89d8-770572afec34 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:2c:02,bridge_name='br-int',has_traffic_filtering=True,id=58e0b222-3a0a-40d3-ad60-e92985bd3584,network=Network(6f03ef5e-cea3-4538-9f91-e35f756665a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58e0b222-3a') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:59:08 user nova-compute[72766]: DEBUG os_vif [None req-d66c902c-4e69-4f40-89d8-770572afec34 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:2c:02,bridge_name='br-int',has_traffic_filtering=True,id=58e0b222-3a0a-40d3-ad60-e92985bd3584,network=Network(6f03ef5e-cea3-4538-9f91-e35f756665a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58e0b222-3a') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 22:59:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap58e0b222-3a, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:59:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:59:08 user nova-compute[72766]: INFO os_vif [None req-d66c902c-4e69-4f40-89d8-770572afec34 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:2c:02,bridge_name='br-int',has_traffic_filtering=True,id=58e0b222-3a0a-40d3-ad60-e92985bd3584,network=Network(6f03ef5e-cea3-4538-9f91-e35f756665a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58e0b222-3a')
Aug 14 22:59:08 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-d66c902c-4e69-4f40-89d8-770572afec34 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Deleting instance files /opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc_del
Aug 14 22:59:08 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-d66c902c-4e69-4f40-89d8-770572afec34 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Deletion of /opt/stack/data/nova/instances/90b55775-2f14-4c80-b48a-b1eed2b570dc_del complete
Aug 14 22:59:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5aa7050b-2006-4f63-8f50-10639dbfc8c7 tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Lock "bde3ff44-cdf8-4ef7-bb7d-50865129268f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.007s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:08 user nova-compute[72766]: INFO nova.compute.manager [None req-d66c902c-4e69-4f40-89d8-770572afec34 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Took 1.12 seconds to destroy the instance on the hypervisor.
Aug 14 22:59:08 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-d66c902c-4e69-4f40-89d8-770572afec34 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 22:59:08 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 22:59:08 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 22:59:08 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692053948.744783, a9d6011c-da14-4fcc-8e31-3063db57b2a6 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:59:08 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] VM Resumed (Lifecycle Event)
Aug 14 22:59:08 user nova-compute[72766]: DEBUG nova.compute.manager [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 22:59:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 22:59:08 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Instance spawned successfully.
Aug 14 22:59:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 22:59:08 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:59:08 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:59:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:59:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:59:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:59:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:59:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:59:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:59:08 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 14 22:59:08 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692053948.748009, a9d6011c-da14-4fcc-8e31-3063db57b2a6 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:59:08 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] VM Started (Lifecycle Event)
Aug 14 22:59:08 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:59:08 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:59:08 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 14 22:59:08 user nova-compute[72766]: DEBUG nova.compute.manager [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:59:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:09 user nova-compute[72766]: DEBUG nova.objects.instance [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72766) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 14 22:59:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-688b36b2-9d13-40b9-98e9-ba20cb2bb577 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.111s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:09 user nova-compute[72766]: DEBUG nova.compute.manager [req-76880a3c-0051-4e34-8342-8d2fc12eb9f5 req-9d8ad0d5-8634-45e7-baff-f3f17bd3f44a service nova] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Received event network-vif-deleted-bcaf8075-d371-4fcb-a6af-88b9a81dfeb8 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:59:09 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:59:09 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Took 1.21 seconds to deallocate network for instance.
Aug 14 22:59:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d66c902c-4e69-4f40-89d8-770572afec34 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d66c902c-4e69-4f40-89d8-770572afec34 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:10 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:10 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-d66c902c-4e69-4f40-89d8-770572afec34 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:59:10 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-d66c902c-4e69-4f40-89d8-770572afec34 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:59:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d66c902c-4e69-4f40-89d8-770572afec34 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.404s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:10 user nova-compute[72766]: DEBUG nova.compute.manager [req-4baed70e-1afb-41db-bb7b-1e917f9d2447 req-d028ca48-6fdf-46b4-a150-2176f4fe4e94 service nova] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Received event network-vif-plugged-58e0b222-3a0a-40d3-ad60-e92985bd3584 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:59:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-4baed70e-1afb-41db-bb7b-1e917f9d2447 req-d028ca48-6fdf-46b4-a150-2176f4fe4e94 service nova] Acquiring lock "90b55775-2f14-4c80-b48a-b1eed2b570dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-4baed70e-1afb-41db-bb7b-1e917f9d2447 req-d028ca48-6fdf-46b4-a150-2176f4fe4e94 service nova] Lock "90b55775-2f14-4c80-b48a-b1eed2b570dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-4baed70e-1afb-41db-bb7b-1e917f9d2447 req-d028ca48-6fdf-46b4-a150-2176f4fe4e94 service nova] Lock "90b55775-2f14-4c80-b48a-b1eed2b570dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:10 user nova-compute[72766]: DEBUG nova.compute.manager [req-4baed70e-1afb-41db-bb7b-1e917f9d2447 req-d028ca48-6fdf-46b4-a150-2176f4fe4e94 service nova] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] No waiting events found dispatching network-vif-plugged-58e0b222-3a0a-40d3-ad60-e92985bd3584 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:59:10 user nova-compute[72766]: WARNING nova.compute.manager [req-4baed70e-1afb-41db-bb7b-1e917f9d2447 req-d028ca48-6fdf-46b4-a150-2176f4fe4e94 service nova] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Received unexpected event network-vif-plugged-58e0b222-3a0a-40d3-ad60-e92985bd3584 for instance with vm_state deleted and task_state None.
Aug 14 22:59:10 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-d66c902c-4e69-4f40-89d8-770572afec34 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Deleted allocations for instance 90b55775-2f14-4c80-b48a-b1eed2b570dc
Aug 14 22:59:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d66c902c-4e69-4f40-89d8-770572afec34 tempest-TaggedAttachmentsTest-1079325823 tempest-TaggedAttachmentsTest-1079325823-project-member] Lock "90b55775-2f14-4c80-b48a-b1eed2b570dc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.973s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Acquiring lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:10 user nova-compute[72766]: DEBUG nova.objects.instance [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lazy-loading 'flavor' on Instance uuid 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:59:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Acquiring lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:10 user nova-compute[72766]: INFO nova.compute.manager [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Attaching volume b5405a72-4678-4dd0-a1b6-67ec1f44c492 to /dev/vdb
Aug 14 22:59:11 user nova-compute[72766]: DEBUG os_brick.utils [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:59:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:11 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[63dacb8b-836f-47e3-a778-a9d8377bb9d6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:11 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b80393-ae4b-448e-a425-b7c2cf08dd27]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:11 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45ad9bd-0cd2-4e0a-af57-676cf4d5ec95]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:11 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d20d11-510a-4fc8-993c-66a705383736]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:59:11 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 22:59:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:59:11 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 22:59:11 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f153ad-b419-4bf1-aa0e-151ff66929db]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:11 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 22:59:11 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 22:59:11 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 22:59:11 user nova-compute[72766]: DEBUG os_brick.utils [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:59:11 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Updating existing volume attachment record: 0868ed31-5075-411e-8902-0d4dccd15391 {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 22:59:11 user nova-compute[72766]: DEBUG nova.compute.manager [req-3e48867d-7a56-475c-bb6c-a60013f309f4 req-4795b59f-7381-45a1-bbec-1a68f6647e1c service nova] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Received event network-vif-deleted-58e0b222-3a0a-40d3-ad60-e92985bd3584 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:59:12 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:59:12 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:59:12 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 22:59:12 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-0850bb6c-6e3e-4007-8478-8eba53089158" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:59:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-0850bb6c-6e3e-4007-8478-8eba53089158" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:59:12 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qIuwcSsg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:59:13 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:59:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:59:13 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:59:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:59:13 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 22:59:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391 -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[31093c90-289d-4181-ad12-9835dd6c6045]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 22:59:13 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391 -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a5a5c1-de68-4828-8680-de6e4f123d33]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391] added
Aug 14 22:59:13 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f84758-ee8b-468a-b385-1c7a506cf0c1]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[de810954-e30f-4510-a902-36861439a478]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qIuwcSsg {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qIuwcSsg" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec731b3-9915-4166-b3ca-cb98be8d93cc]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qIuwcSsg'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[350ce451-1d55-40ed-b5d2-0cb016f54ca7]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8a3f0f-0b35-4853-aa88-3a2bf39d1b6c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 22:59:13 user nova-compute[72766]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 22:59:13 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 22:59:13 user nova-compute[72766]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 22:59:13 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391 -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[446c0436-359e-43c1-af41-5d03b3d23217]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391, portal: 172.16.0.220,3260]
Aug 14 22:59:13 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391, portal: 172.16.0.220,3260] successful.
Aug 14 22:59:13 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[00be0578-92fe-4bbd-9056-a93635e71b97]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee365b09-56c7-4b71-a829-343586b581c9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 22:59:13 user nova-compute[72766]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 22:59:13 user nova-compute[72766]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391 (non-flash)
Aug 14 22:59:13 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 22:59:13 user nova-compute[72766]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 22:59:13 user nova-compute[72766]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391 (non-flash)
Aug 14 22:59:13 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] HCTL ('35', '-', '-', 0) found on session 14 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b57a15-77c3-4ad0-9b39-26d33d552a78]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Searching for a device in session 14 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qIuwcSsg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Updating instance_info_cache with network_info: [{"id": "9c7ce835-f163-4f4a-bd47-26d5e06ff451", "address": "fa:16:3e:38:75:a9", "network": {"id": "9bdd38f5-9734-4c5a-8a1c-5296215e6944", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1610393487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61a77920bef94526816c1a9c95531cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7ce835-f1", "ovs_interfaceid": "9c7ce835-f163-4f4a-bd47-26d5e06ff451", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-0850bb6c-6e3e-4007-8478-8eba53089158" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:59:13 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:59:14 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:59:14 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '26132396162323437', 'path': '/dev/sdd'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:59:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26132396162323437', 'path': '/dev/sdd'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 22:59:14 user nova-compute[72766]: DEBUG nova.objects.instance [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lazy-loading 'flavor' on Instance uuid c3c0a004-8d70-4253-bf17-b83088e30031 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:59:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 22:59:14 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:59:14 user nova-compute[72766]:   <source dev="/dev/sdd"/>
Aug 14 22:59:14 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:59:14 user nova-compute[72766]:   <serial>767365c4-d886-43b3-b85c-ddc641e27391</serial>
Aug 14 22:59:14 user nova-compute[72766]: </disk>
Aug 14 22:59:14 user nova-compute[72766]:  {{(pid=72766) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 22:59:15 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:59:15 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:59:15 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] No VIF found with MAC fa:16:3e:96:85:b3, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:59:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ff86f64e-2d97-4d65-9723-2135b4e248da tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "c3c0a004-8d70-4253-bf17-b83088e30031" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.332s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:15 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:59:15 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:59:15 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 22:59:16 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:59:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:16 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 22:59:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33e6f8aa-bb0d-478d-b7b5-3334302476fb/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Acquiring lock "c02e6fd7-e712-45da-b35b-2fe21675e2f1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Lock "c02e6fd7-e712-45da-b35b-2fe21675e2f1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:17 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 22:59:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33e6f8aa-bb0d-478d-b7b5-3334302476fb/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33e6f8aa-bb0d-478d-b7b5-3334302476fb/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:17 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 22:59:17 user nova-compute[72766]: INFO nova.compute.claims [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Claim successful on node user
Aug 14 22:59:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33e6f8aa-bb0d-478d-b7b5-3334302476fb/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:18 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:18 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0850bb6c-6e3e-4007-8478-8eba53089158/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:18 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:59:18 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:59:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.662s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:18 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 22:59:18 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 22:59:18 user nova-compute[72766]: DEBUG nova.network.neutron [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 22:59:18 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 22:59:18 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0850bb6c-6e3e-4007-8478-8eba53089158/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:18 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0850bb6c-6e3e-4007-8478-8eba53089158/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:18 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 22:59:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:18 user nova-compute[72766]: DEBUG nova.policy [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e26e35b2602f410a8413983d0fb53713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2a15ce46cf545a8bd6e8e93f12a70a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 22:59:18 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0850bb6c-6e3e-4007-8478-8eba53089158/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:18 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:59:18 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:18 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 22:59:18 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 22:59:18 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Creating image(s)
Aug 14 22:59:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Acquiring lock "/opt/stack/data/nova/instances/c02e6fd7-e712-45da-b35b-2fe21675e2f1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Lock "/opt/stack/data/nova/instances/c02e6fd7-e712-45da-b35b-2fe21675e2f1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Lock "/opt/stack/data/nova/instances/c02e6fd7-e712-45da-b35b-2fe21675e2f1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:18 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:18 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:18 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:18 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.198s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Acquiring lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:18 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:18 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692053943.9009213, b55141bc-d426-4d35-8ae5-269ece19a793 => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:59:18 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] VM Stopped (Lifecycle Event)
Aug 14 22:59:18 user nova-compute[72766]: DEBUG nova.compute.manager [None req-2d879c4c-261f-405f-9da6-d7e89d7ecee3 None None] [instance: b55141bc-d426-4d35-8ae5-269ece19a793] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:59:18 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:18 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:59:18 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.233s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/c02e6fd7-e712-45da-b35b-2fe21675e2f1/disk 1073741824 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/c02e6fd7-e712-45da-b35b-2fe21675e2f1/disk 1073741824" returned: 0 in 0.057s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.195s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:19 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c02e6fd7-e712-45da-b35b-2fe21675e2f1/disk. size=1073741824 {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 22:59:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c02e6fd7-e712-45da-b35b-2fe21675e2f1/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c02e6fd7-e712-45da-b35b-2fe21675e2f1/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:19 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Cannot resize image /opt/stack/data/nova/instances/c02e6fd7-e712-45da-b35b-2fe21675e2f1/disk to a smaller size. {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 22:59:19 user nova-compute[72766]: DEBUG nova.objects.instance [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Lazy-loading 'migration_context' on Instance uuid c02e6fd7-e712-45da-b35b-2fe21675e2f1 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:59:19 user nova-compute[72766]: DEBUG nova.network.neutron [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Successfully created port: 3b9abe2a-2056-403c-bc2e-97bff0d04648 {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 22:59:19 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 22:59:19 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Ensure instance console log exists: /opt/stack/data/nova/instances/c02e6fd7-e712-45da-b35b-2fe21675e2f1/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 22:59:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:19 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 22:59:20 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:59:20 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:59:20 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=7473MB free_disk=25.783557891845703GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 22:59:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:20 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance b563c62d-d117-4bb5-9157-7387c51ed641 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:59:20 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:59:20 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 0850bb6c-6e3e-4007-8478-8eba53089158 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:59:20 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 33e6f8aa-bb0d-478d-b7b5-3334302476fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:59:20 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance a9d6011c-da14-4fcc-8e31-3063db57b2a6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:59:20 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance c3c0a004-8d70-4253-bf17-b83088e30031 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:59:20 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 4d919875-5f24-4bed-bf26-cf437e0de3e2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:59:20 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:59:20 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance c02e6fd7-e712-45da-b35b-2fe21675e2f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 22:59:20 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 22:59:20 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 22:59:20 user nova-compute[72766]: DEBUG nova.network.neutron [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Successfully updated port: 3b9abe2a-2056-403c-bc2e-97bff0d04648 {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 22:59:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Acquiring lock "refresh_cache-c02e6fd7-e712-45da-b35b-2fe21675e2f1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:59:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Acquired lock "refresh_cache-c02e6fd7-e712-45da-b35b-2fe21675e2f1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:59:20 user nova-compute[72766]: DEBUG nova.network.neutron [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:59:20 user nova-compute[72766]: DEBUG nova.compute.manager [req-1f08dec4-c53e-477e-a44f-16bd372c7a4e req-7dc561d9-547c-4ae0-aff3-4d3af74c28a8 service nova] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Received event network-changed-3b9abe2a-2056-403c-bc2e-97bff0d04648 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:59:20 user nova-compute[72766]: DEBUG nova.compute.manager [req-1f08dec4-c53e-477e-a44f-16bd372c7a4e req-7dc561d9-547c-4ae0-aff3-4d3af74c28a8 service nova] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Refreshing instance network info cache due to event network-changed-3b9abe2a-2056-403c-bc2e-97bff0d04648. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:59:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-1f08dec4-c53e-477e-a44f-16bd372c7a4e req-7dc561d9-547c-4ae0-aff3-4d3af74c28a8 service nova] Acquiring lock "refresh_cache-c02e6fd7-e712-45da-b35b-2fe21675e2f1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:59:20 user nova-compute[72766]: DEBUG nova.network.neutron [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 22:59:20 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:59:20 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:59:20 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 22:59:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.543s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG nova.network.neutron [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Updating instance_info_cache with network_info: [{"id": "3b9abe2a-2056-403c-bc2e-97bff0d04648", "address": "fa:16:3e:3e:c1:d6", "network": {"id": "4b9625cb-278d-447f-8309-577dc3b6532f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2056420710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2a15ce46cf545a8bd6e8e93f12a70a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9abe2a-20", "ovs_interfaceid": "3b9abe2a-2056-403c-bc2e-97bff0d04648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Releasing lock "refresh_cache-c02e6fd7-e712-45da-b35b-2fe21675e2f1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Instance network_info: |[{"id": "3b9abe2a-2056-403c-bc2e-97bff0d04648", "address": "fa:16:3e:3e:c1:d6", "network": {"id": "4b9625cb-278d-447f-8309-577dc3b6532f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2056420710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2a15ce46cf545a8bd6e8e93f12a70a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9abe2a-20", "ovs_interfaceid": "3b9abe2a-2056-403c-bc2e-97bff0d04648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-1f08dec4-c53e-477e-a44f-16bd372c7a4e req-7dc561d9-547c-4ae0-aff3-4d3af74c28a8 service nova] Acquired lock "refresh_cache-c02e6fd7-e712-45da-b35b-2fe21675e2f1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG nova.network.neutron [req-1f08dec4-c53e-477e-a44f-16bd372c7a4e req-7dc561d9-547c-4ae0-aff3-4d3af74c28a8 service nova] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Refreshing network info cache for port 3b9abe2a-2056-403c-bc2e-97bff0d04648 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Start _get_guest_xml network_info=[{"id": "3b9abe2a-2056-403c-bc2e-97bff0d04648", "address": "fa:16:3e:3e:c1:d6", "network": {"id": "4b9625cb-278d-447f-8309-577dc3b6532f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2056420710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2a15ce46cf545a8bd6e8e93f12a70a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9abe2a-20", "ovs_interfaceid": "3b9abe2a-2056-403c-bc2e-97bff0d04648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd2900d30-2c4c-4d57-9135-d45564c0c596'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 22:59:21 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:59:21 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:59:21 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:59:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1422095618',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1422095618',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1422095',id=14,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONbY82+U/9BcNjMdo40EaVwa0DpR5h1vDX0P/Ya84vCD2XbpAUyitlCJcfLeDX4n4mnNgYV5y3bOzqPPLq8c5lbVlYH1FS9MmdG7Z3Mt1aUQfK4l3JRciswuFpedGQN5Q==',key_name='tempest-keypair-1608943488',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2a15ce46cf545a8bd6e8e93f12a70a2',ramdisk_id='',reservation_id='r-yx0g0cyv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-767657021',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:59:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e26e35b2602f410a8413983d0fb53713',uuid=c02e6fd7-e712-45da-b35b-2fe21675e2f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b9abe2a-2056-403c-bc2e-97bff0d04648", "address": "fa:16:3e:3e:c1:d6", "network": {"id": "4b9625cb-278d-447f-8309-577dc3b6532f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2056420710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2a15ce46cf545a8bd6e8e93f12a70a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9abe2a-20", "ovs_interfaceid": "3b9abe2a-2056-403c-bc2e-97bff0d04648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Converting VIF {"id": "3b9abe2a-2056-403c-bc2e-97bff0d04648", "address": "fa:16:3e:3e:c1:d6", "network": {"id": "4b9625cb-278d-447f-8309-577dc3b6532f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2056420710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2a15ce46cf545a8bd6e8e93f12a70a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9abe2a-20", "ovs_interfaceid": "3b9abe2a-2056-403c-bc2e-97bff0d04648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:c1:d6,bridge_name='br-int',has_traffic_filtering=True,id=3b9abe2a-2056-403c-bc2e-97bff0d04648,network=Network(4b9625cb-278d-447f-8309-577dc3b6532f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b9abe2a-20') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG nova.objects.instance [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Lazy-loading 'pci_devices' on Instance uuid c02e6fd7-e712-45da-b35b-2fe21675e2f1 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] End _get_guest_xml xml=<domain type="kvm">
Aug 14 22:59:21 user nova-compute[72766]:   <uuid>c02e6fd7-e712-45da-b35b-2fe21675e2f1</uuid>
Aug 14 22:59:21 user nova-compute[72766]:   <name>instance-0000000e</name>
Aug 14 22:59:21 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 22:59:21 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 22:59:21 user nova-compute[72766]:   <metadata>
Aug 14 22:59:21 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:59:21 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 22:59:21 user nova-compute[72766]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1422095618</nova:name>
Aug 14 22:59:21 user nova-compute[72766]:       <nova:creationTime>2023-08-14 22:59:21</nova:creationTime>
Aug 14 22:59:21 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 22:59:21 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 22:59:21 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 22:59:21 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 22:59:21 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:59:21 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 22:59:21 user nova-compute[72766]:       </nova:flavor>
Aug 14 22:59:21 user nova-compute[72766]:       <nova:owner>
Aug 14 22:59:21 user nova-compute[72766]:         <nova:user uuid="e26e35b2602f410a8413983d0fb53713">tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member</nova:user>
Aug 14 22:59:21 user nova-compute[72766]:         <nova:project uuid="c2a15ce46cf545a8bd6e8e93f12a70a2">tempest-TestServerVolumeAttachScenarioOldVersion-767657021</nova:project>
Aug 14 22:59:21 user nova-compute[72766]:       </nova:owner>
Aug 14 22:59:21 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 22:59:21 user nova-compute[72766]:       <nova:ports>
Aug 14 22:59:21 user nova-compute[72766]:         <nova:port uuid="3b9abe2a-2056-403c-bc2e-97bff0d04648">
Aug 14 22:59:21 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 22:59:21 user nova-compute[72766]:         </nova:port>
Aug 14 22:59:21 user nova-compute[72766]:       </nova:ports>
Aug 14 22:59:21 user nova-compute[72766]:     </nova:instance>
Aug 14 22:59:21 user nova-compute[72766]:   </metadata>
Aug 14 22:59:21 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 22:59:21 user nova-compute[72766]:     <system>
Aug 14 22:59:21 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 22:59:21 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 22:59:21 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 22:59:21 user nova-compute[72766]:       <entry name="serial">c02e6fd7-e712-45da-b35b-2fe21675e2f1</entry>
Aug 14 22:59:21 user nova-compute[72766]:       <entry name="uuid">c02e6fd7-e712-45da-b35b-2fe21675e2f1</entry>
Aug 14 22:59:21 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 22:59:21 user nova-compute[72766]:     </system>
Aug 14 22:59:21 user nova-compute[72766]:   </sysinfo>
Aug 14 22:59:21 user nova-compute[72766]:   <os>
Aug 14 22:59:21 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 22:59:21 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 22:59:21 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 22:59:21 user nova-compute[72766]:   </os>
Aug 14 22:59:21 user nova-compute[72766]:   <features>
Aug 14 22:59:21 user nova-compute[72766]:     <acpi/>
Aug 14 22:59:21 user nova-compute[72766]:     <apic/>
Aug 14 22:59:21 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 22:59:21 user nova-compute[72766]:   </features>
Aug 14 22:59:21 user nova-compute[72766]:   <clock offset="utc">
Aug 14 22:59:21 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 22:59:21 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 22:59:21 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 22:59:21 user nova-compute[72766]:   </clock>
Aug 14 22:59:21 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 22:59:21 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 22:59:21 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 22:59:21 user nova-compute[72766]:   </cpu>
Aug 14 22:59:21 user nova-compute[72766]:   <devices>
Aug 14 22:59:21 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 22:59:21 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 22:59:21 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/c02e6fd7-e712-45da-b35b-2fe21675e2f1/disk"/>
Aug 14 22:59:21 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 22:59:21 user nova-compute[72766]:     </disk>
Aug 14 22:59:21 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 22:59:21 user nova-compute[72766]:       <mac address="fa:16:3e:3e:c1:d6"/>
Aug 14 22:59:21 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 22:59:21 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 22:59:21 user nova-compute[72766]:       <target dev="tap3b9abe2a-20"/>
Aug 14 22:59:21 user nova-compute[72766]:     </interface>
Aug 14 22:59:21 user nova-compute[72766]:     <serial type="pty">
Aug 14 22:59:21 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/c02e6fd7-e712-45da-b35b-2fe21675e2f1/console.log" append="off"/>
Aug 14 22:59:21 user nova-compute[72766]:     </serial>
Aug 14 22:59:21 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 22:59:21 user nova-compute[72766]:     <video>
Aug 14 22:59:21 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 22:59:21 user nova-compute[72766]:     </video>
Aug 14 22:59:21 user nova-compute[72766]:     <rng model="virtio">
Aug 14 22:59:21 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 22:59:21 user nova-compute[72766]:     </rng>
Aug 14 22:59:21 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 22:59:21 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 22:59:21 user nova-compute[72766]:       <stats period="10"/>
Aug 14 22:59:21 user nova-compute[72766]:     </memballoon>
Aug 14 22:59:21 user nova-compute[72766]:   </devices>
Aug 14 22:59:21 user nova-compute[72766]: </domain>
Aug 14 22:59:21 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:59:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1422095618',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1422095618',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1422095',id=14,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONbY82+U/9BcNjMdo40EaVwa0DpR5h1vDX0P/Ya84vCD2XbpAUyitlCJcfLeDX4n4mnNgYV5y3bOzqPPLq8c5lbVlYH1FS9MmdG7Z3Mt1aUQfK4l3JRciswuFpedGQN5Q==',key_name='tempest-keypair-1608943488',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2a15ce46cf545a8bd6e8e93f12a70a2',ramdisk_id='',reservation_id='r-yx0g0cyv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-767657021',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:59:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e26e35b2602f410a8413983d0fb53713',uuid=c02e6fd7-e712-45da-b35b-2fe21675e2f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b9abe2a-2056-403c-bc2e-97bff0d04648", "address": "fa:16:3e:3e:c1:d6", "network": {"id": "4b9625cb-278d-447f-8309-577dc3b6532f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2056420710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2a15ce46cf545a8bd6e8e93f12a70a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9abe2a-20", "ovs_interfaceid": "3b9abe2a-2056-403c-bc2e-97bff0d04648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Converting VIF {"id": "3b9abe2a-2056-403c-bc2e-97bff0d04648", "address": "fa:16:3e:3e:c1:d6", "network": {"id": "4b9625cb-278d-447f-8309-577dc3b6532f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2056420710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2a15ce46cf545a8bd6e8e93f12a70a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9abe2a-20", "ovs_interfaceid": "3b9abe2a-2056-403c-bc2e-97bff0d04648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:c1:d6,bridge_name='br-int',has_traffic_filtering=True,id=3b9abe2a-2056-403c-bc2e-97bff0d04648,network=Network(4b9625cb-278d-447f-8309-577dc3b6532f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b9abe2a-20') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG os_vif [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:c1:d6,bridge_name='br-int',has_traffic_filtering=True,id=3b9abe2a-2056-403c-bc2e-97bff0d04648,network=Network(4b9625cb-278d-447f-8309-577dc3b6532f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b9abe2a-20') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b9abe2a-20, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3b9abe2a-20, col_values=(('external_ids', {'iface-id': '3b9abe2a-2056-403c-bc2e-97bff0d04648', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:c1:d6', 'vm-uuid': 'c02e6fd7-e712-45da-b35b-2fe21675e2f1'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:21 user nova-compute[72766]: INFO os_vif [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:c1:d6,bridge_name='br-int',has_traffic_filtering=True,id=3b9abe2a-2056-403c-bc2e-97bff0d04648,network=Network(4b9625cb-278d-447f-8309-577dc3b6532f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b9abe2a-20')
Aug 14 22:59:21 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] No VIF found with MAC fa:16:3e:3e:c1:d6, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692053946.5735865, bde3ff44-cdf8-4ef7-bb7d-50865129268f => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:59:21 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] VM Stopped (Lifecycle Event)
Aug 14 22:59:21 user nova-compute[72766]: DEBUG nova.compute.manager [None req-209c033a-f662-46f0-a3b8-a6dcc86ead56 None None] [instance: bde3ff44-cdf8-4ef7-bb7d-50865129268f] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG nova.network.neutron [req-1f08dec4-c53e-477e-a44f-16bd372c7a4e req-7dc561d9-547c-4ae0-aff3-4d3af74c28a8 service nova] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Updated VIF entry in instance network info cache for port 3b9abe2a-2056-403c-bc2e-97bff0d04648. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG nova.network.neutron [req-1f08dec4-c53e-477e-a44f-16bd372c7a4e req-7dc561d9-547c-4ae0-aff3-4d3af74c28a8 service nova] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Updating instance_info_cache with network_info: [{"id": "3b9abe2a-2056-403c-bc2e-97bff0d04648", "address": "fa:16:3e:3e:c1:d6", "network": {"id": "4b9625cb-278d-447f-8309-577dc3b6532f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2056420710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2a15ce46cf545a8bd6e8e93f12a70a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9abe2a-20", "ovs_interfaceid": "3b9abe2a-2056-403c-bc2e-97bff0d04648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-1f08dec4-c53e-477e-a44f-16bd372c7a4e req-7dc561d9-547c-4ae0-aff3-4d3af74c28a8 service nova] Releasing lock "refresh_cache-c02e6fd7-e712-45da-b35b-2fe21675e2f1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:59:21 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 22:59:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:23 user nova-compute[72766]: DEBUG nova.compute.manager [req-883b657e-8852-43dd-8e62-91a6f85315a0 req-a44594cd-8a37-4238-8f9d-668ccd48e11e service nova] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Received event network-vif-plugged-3b9abe2a-2056-403c-bc2e-97bff0d04648 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:59:23 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-883b657e-8852-43dd-8e62-91a6f85315a0 req-a44594cd-8a37-4238-8f9d-668ccd48e11e service nova] Acquiring lock "c02e6fd7-e712-45da-b35b-2fe21675e2f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:23 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-883b657e-8852-43dd-8e62-91a6f85315a0 req-a44594cd-8a37-4238-8f9d-668ccd48e11e service nova] Lock "c02e6fd7-e712-45da-b35b-2fe21675e2f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:23 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-883b657e-8852-43dd-8e62-91a6f85315a0 req-a44594cd-8a37-4238-8f9d-668ccd48e11e service nova] Lock "c02e6fd7-e712-45da-b35b-2fe21675e2f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:23 user nova-compute[72766]: DEBUG nova.compute.manager [req-883b657e-8852-43dd-8e62-91a6f85315a0 req-a44594cd-8a37-4238-8f9d-668ccd48e11e service nova] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] No waiting events found dispatching network-vif-plugged-3b9abe2a-2056-403c-bc2e-97bff0d04648 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:59:23 user nova-compute[72766]: WARNING nova.compute.manager [req-883b657e-8852-43dd-8e62-91a6f85315a0 req-a44594cd-8a37-4238-8f9d-668ccd48e11e service nova] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Received unexpected event network-vif-plugged-3b9abe2a-2056-403c-bc2e-97bff0d04648 for instance with vm_state building and task_state spawning.
Aug 14 22:59:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:23 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692053948.4941726, 90b55775-2f14-4c80-b48a-b1eed2b570dc => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:59:23 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] VM Stopped (Lifecycle Event)
Aug 14 22:59:23 user nova-compute[72766]: DEBUG nova.compute.manager [None req-6b2905cf-45a1-4f04-9e5d-6a9d94be1f95 None None] [instance: 90b55775-2f14-4c80-b48a-b1eed2b570dc] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:59:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DxudpZVQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:59:24 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:59:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:59:24 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:59:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:59:24 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 22:59:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[812dee9c-2ec4-4b1e-8d8a-b5c49b1949a3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 22:59:24 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b480ae9e-26dd-4a7b-8501-6f23fa40171d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492] added
Aug 14 22:59:24 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31e66e1-48f3-4552-b9b7-2e99b660f095]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73087c6-7587-4c48-95b3-90b6298e162a]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DxudpZVQ {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DxudpZVQ" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[01792ffb-e11d-4e28-b6e3-e8cd35a5011a]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DxudpZVQ'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6d9066-2ce9-436c-b7ab-e87d2492b8b2]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2e04db-fcd1-47e8-953c-507db33af4af]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 22:59:24 user nova-compute[72766]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 22:59:24 user nova-compute[72766]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391 (non-flash)
Aug 14 22:59:24 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 22:59:24 user nova-compute[72766]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 22:59:24 user nova-compute[72766]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391 (non-flash)
Aug 14 22:59:24 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a8d46e-c63f-462c-b2b0-1996a09d8483]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492, portal: 172.16.0.220,3260]
Aug 14 22:59:24 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492, portal: 172.16.0.220,3260] successful.
Aug 14 22:59:24 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0557900-40dd-4d45-8180-075866a79e97]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10915ec-dd93-4164-93c2-8fbb87467916]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 22:59:24 user nova-compute[72766]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 22:59:24 user nova-compute[72766]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391 (non-flash)
Aug 14 22:59:24 user nova-compute[72766]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)
Aug 14 22:59:24 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 22:59:24 user nova-compute[72766]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 22:59:24 user nova-compute[72766]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391 (non-flash)
Aug 14 22:59:24 user nova-compute[72766]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)
Aug 14 22:59:24 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] HCTL ('36', '-', '-', 0) found on session 15 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[66cb953e-c168-4ec1-9a21-be97a83062a7]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:24 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Searching for a device in session 15 and hctl ['36', '*', '*', 0] yield: None {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:59:25 user nova-compute[72766]: DEBUG nova.compute.manager [req-9e79c559-8f3d-4426-bbd7-2e67ce32167e req-96f57dee-3696-4a3f-b076-eceb8f98f38e service nova] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Received event network-vif-plugged-3b9abe2a-2056-403c-bc2e-97bff0d04648 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:59:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9e79c559-8f3d-4426-bbd7-2e67ce32167e req-96f57dee-3696-4a3f-b076-eceb8f98f38e service nova] Acquiring lock "c02e6fd7-e712-45da-b35b-2fe21675e2f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9e79c559-8f3d-4426-bbd7-2e67ce32167e req-96f57dee-3696-4a3f-b076-eceb8f98f38e service nova] Lock "c02e6fd7-e712-45da-b35b-2fe21675e2f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9e79c559-8f3d-4426-bbd7-2e67ce32167e req-96f57dee-3696-4a3f-b076-eceb8f98f38e service nova] Lock "c02e6fd7-e712-45da-b35b-2fe21675e2f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:25 user nova-compute[72766]: DEBUG nova.compute.manager [req-9e79c559-8f3d-4426-bbd7-2e67ce32167e req-96f57dee-3696-4a3f-b076-eceb8f98f38e service nova] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] No waiting events found dispatching network-vif-plugged-3b9abe2a-2056-403c-bc2e-97bff0d04648 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:59:25 user nova-compute[72766]: WARNING nova.compute.manager [req-9e79c559-8f3d-4426-bbd7-2e67ce32167e req-96f57dee-3696-4a3f-b076-eceb8f98f38e service nova] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Received unexpected event network-vif-plugged-3b9abe2a-2056-403c-bc2e-97bff0d04648 for instance with vm_state building and task_state spawning.
Aug 14 22:59:25 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Searching for a device in session 15 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:59:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DxudpZVQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 22:59:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:59:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '26261353432653561', 'path': '/dev/sde'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:59:25 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261353432653561', 'path': '/dev/sde'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 22:59:25 user nova-compute[72766]: DEBUG nova.objects.instance [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lazy-loading 'flavor' on Instance uuid 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:59:25 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 22:59:25 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:59:25 user nova-compute[72766]:   <source dev="/dev/sde"/>
Aug 14 22:59:25 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:59:25 user nova-compute[72766]:   <serial>b5405a72-4678-4dd0-a1b6-67ec1f44c492</serial>
Aug 14 22:59:25 user nova-compute[72766]: </disk>
Aug 14 22:59:25 user nova-compute[72766]:  {{(pid=72766) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 22:59:25 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692053965.5042331, c02e6fd7-e712-45da-b35b-2fe21675e2f1 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:59:25 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] VM Resumed (Lifecycle Event)
Aug 14 22:59:25 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 22:59:25 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 22:59:25 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:59:25 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Instance spawned successfully.
Aug 14 22:59:25 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 22:59:25 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:59:25 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:59:25 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:59:25 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:59:25 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:59:25 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:59:25 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:59:25 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:59:25 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692053965.507676, c02e6fd7-e712-45da-b35b-2fe21675e2f1 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:59:25 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] VM Started (Lifecycle Event)
Aug 14 22:59:25 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:59:25 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:59:25 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:59:25 user nova-compute[72766]: INFO nova.compute.manager [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Took 7.15 seconds to spawn the instance on the hypervisor.
Aug 14 22:59:25 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:59:25 user nova-compute[72766]: INFO nova.compute.manager [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Took 8.37 seconds to build instance.
Aug 14 22:59:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f567cf33-59f6-4d0a-ac14-7368e2e49b4d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Lock "c02e6fd7-e712-45da-b35b-2fe21675e2f1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.563s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:26 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:59:26 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:59:26 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] No VIF found with MAC fa:16:3e:88:35:14, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:59:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b3d8e14a-8c4c-446c-b8bf-d2bfe3549609 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.272s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:27 user nova-compute[72766]: INFO nova.compute.manager [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Rescuing
Aug 14 22:59:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Acquiring lock "refresh_cache-87712dfd-d67b-4e5e-a75d-ca2dd7c764b1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:59:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Acquired lock "refresh_cache-87712dfd-d67b-4e5e-a75d-ca2dd7c764b1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:59:27 user nova-compute[72766]: DEBUG nova.network.neutron [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:59:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:28 user nova-compute[72766]: DEBUG nova.network.neutron [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Updating instance_info_cache with network_info: [{"id": "baa7e0c2-91d4-4077-8405-abb537475df2", "address": "fa:16:3e:88:35:14", "network": {"id": "aff4f146-97db-4102-abf1-6528e74cad55", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1894452367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6942d31258304de68c9f7f8bb9304acb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa7e0c2-91", "ovs_interfaceid": "baa7e0c2-91d4-4077-8405-abb537475df2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:59:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Releasing lock "refresh_cache-87712dfd-d67b-4e5e-a75d-ca2dd7c764b1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:59:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Acquiring lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:28 user nova-compute[72766]: DEBUG nova.compute.manager [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 22:59:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:28 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 22:59:28 user nova-compute[72766]: INFO nova.compute.claims [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Claim successful on node user
Aug 14 22:59:29 user nova-compute[72766]: DEBUG nova.compute.manager [req-c55134a8-71cb-43c6-8bd8-1dd62e783ad3 req-bf3db1b6-e7c7-4c54-806d-15556425ff3a service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Received event network-vif-unplugged-baa7e0c2-91d4-4077-8405-abb537475df2 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:59:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-c55134a8-71cb-43c6-8bd8-1dd62e783ad3 req-bf3db1b6-e7c7-4c54-806d-15556425ff3a service nova] Acquiring lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-c55134a8-71cb-43c6-8bd8-1dd62e783ad3 req-bf3db1b6-e7c7-4c54-806d-15556425ff3a service nova] Lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-c55134a8-71cb-43c6-8bd8-1dd62e783ad3 req-bf3db1b6-e7c7-4c54-806d-15556425ff3a service nova] Lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:29 user nova-compute[72766]: DEBUG nova.compute.manager [req-c55134a8-71cb-43c6-8bd8-1dd62e783ad3 req-bf3db1b6-e7c7-4c54-806d-15556425ff3a service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] No waiting events found dispatching network-vif-unplugged-baa7e0c2-91d4-4077-8405-abb537475df2 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:59:29 user nova-compute[72766]: WARNING nova.compute.manager [req-c55134a8-71cb-43c6-8bd8-1dd62e783ad3 req-bf3db1b6-e7c7-4c54-806d-15556425ff3a service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Received unexpected event network-vif-unplugged-baa7e0c2-91d4-4077-8405-abb537475df2 for instance with vm_state active and task_state rescuing.
Aug 14 22:59:29 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:59:29 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:59:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.513s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:29 user nova-compute[72766]: DEBUG nova.compute.manager [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 22:59:29 user nova-compute[72766]: DEBUG nova.compute.manager [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 22:59:29 user nova-compute[72766]: DEBUG nova.network.neutron [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 22:59:29 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 22:59:29 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Instance destroyed successfully.
Aug 14 22:59:29 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Attempting a stable device rescue
Aug 14 22:59:29 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=72766) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 22:59:29 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Instance directory exists: not creating {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 22:59:29 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Creating image(s)
Aug 14 22:59:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Acquiring lock "/opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lock "/opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lock "/opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:29 user nova-compute[72766]: DEBUG nova.objects.instance [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lazy-loading 'trusted_certs' on Instance uuid 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:59:29 user nova-compute[72766]: DEBUG nova.compute.manager [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 22:59:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Acquiring lock "ed84c228178df78cc27ca3feae12a0d9dacc52d8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lock "ed84c228178df78cc27ca3feae12a0d9dacc52d8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:29 user nova-compute[72766]: INFO nova.virt.block_device [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Booting with volume cf11e175-5cef-45e6-94a6-0198c4db16ba at /dev/vda
Aug 14 22:59:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed84c228178df78cc27ca3feae12a0d9dacc52d8.part --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:30 user nova-compute[72766]: DEBUG os_brick.utils [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:59:30 user nova-compute[72766]: DEBUG nova.policy [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb06afcc445148a9aaba54ee872cd38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa34f06852ad4fc9aaa9f542232d711b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 22:59:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:30 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5e7486-8add-439e-99d7-43ec1e10f19e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.028s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:30 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ca607c-ce5e-4fe1-8a45-1ac09e03e739]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.032s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:30 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c544cb3-5dd6-4abd-8a42-c92a2213bd49]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:30 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[202d9e43-c3a0-4699-b050-683407b4256a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:59:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 22:59:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed84c228178df78cc27ca3feae12a0d9dacc52d8.part --force-share --output=json" returned: 0 in 0.224s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:31 user nova-compute[72766]: DEBUG nova.virt.images [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] bf6f4f48-d558-4b8a-8153-f8d46f79527e was qcow2, converting to raw {{(pid=72766) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 22:59:31 user nova-compute[72766]: DEBUG nova.privsep.utils [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72766) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 22:59:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ed84c228178df78cc27ca3feae12a0d9dacc52d8.part /opt/stack/data/nova/instances/_base/ed84c228178df78cc27ca3feae12a0d9dacc52d8.converted {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:59:31 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 22:59:31 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf279311-5b24-4c17-94c7-61426a38e188]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 22:59:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 22:59:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 22:59:31 user nova-compute[72766]: DEBUG os_brick.utils [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] <== get_connector_properties: return (211ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:59:31 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Updating existing volume attachment record: b108d5b9-f03d-4b7d-8d99-6df063551e65 {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 22:59:31 user nova-compute[72766]: DEBUG nova.compute.manager [req-7c7f9a20-51f1-403a-a4f8-3d04ccdab5bc req-8da3d043-a75f-4f11-a16e-abfb4ffabba0 service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Received event network-vif-plugged-baa7e0c2-91d4-4077-8405-abb537475df2 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:59:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7c7f9a20-51f1-403a-a4f8-3d04ccdab5bc req-8da3d043-a75f-4f11-a16e-abfb4ffabba0 service nova] Acquiring lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7c7f9a20-51f1-403a-a4f8-3d04ccdab5bc req-8da3d043-a75f-4f11-a16e-abfb4ffabba0 service nova] Lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7c7f9a20-51f1-403a-a4f8-3d04ccdab5bc req-8da3d043-a75f-4f11-a16e-abfb4ffabba0 service nova] Lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:31 user nova-compute[72766]: DEBUG nova.compute.manager [req-7c7f9a20-51f1-403a-a4f8-3d04ccdab5bc req-8da3d043-a75f-4f11-a16e-abfb4ffabba0 service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] No waiting events found dispatching network-vif-plugged-baa7e0c2-91d4-4077-8405-abb537475df2 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:59:31 user nova-compute[72766]: WARNING nova.compute.manager [req-7c7f9a20-51f1-403a-a4f8-3d04ccdab5bc req-8da3d043-a75f-4f11-a16e-abfb4ffabba0 service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Received unexpected event network-vif-plugged-baa7e0c2-91d4-4077-8405-abb537475df2 for instance with vm_state active and task_state rescuing.
Aug 14 22:59:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ed84c228178df78cc27ca3feae12a0d9dacc52d8.part /opt/stack/data/nova/instances/_base/ed84c228178df78cc27ca3feae12a0d9dacc52d8.converted" returned: 0 in 0.333s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed84c228178df78cc27ca3feae12a0d9dacc52d8.converted --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed84c228178df78cc27ca3feae12a0d9dacc52d8.converted --force-share --output=json" returned: 0 in 0.232s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lock "ed84c228178df78cc27ca3feae12a0d9dacc52d8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.981s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Acquiring lock "ed84c228178df78cc27ca3feae12a0d9dacc52d8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lock "ed84c228178df78cc27ca3feae12a0d9dacc52d8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed84c228178df78cc27ca3feae12a0d9dacc52d8 --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:31 user nova-compute[72766]: DEBUG nova.network.neutron [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Successfully created port: 098834fb-ad7d-4032-9f2c-28b8a206d4c4 {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 22:59:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ed84c228178df78cc27ca3feae12a0d9dacc52d8 --force-share --output=json" returned: 0 in 0.260s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed84c228178df78cc27ca3feae12a0d9dacc52d8,backing_fmt=raw /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk.rescue {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ed84c228178df78cc27ca3feae12a0d9dacc52d8,backing_fmt=raw /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk.rescue" returned: 0 in 0.058s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lock "ed84c228178df78cc27ca3feae12a0d9dacc52d8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.325s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:31 user nova-compute[72766]: DEBUG nova.objects.instance [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lazy-loading 'migration_context' on Instance uuid 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Start _get_guest_xml network_info=[{"id": "baa7e0c2-91d4-4077-8405-abb537475df2", "address": "fa:16:3e:88:35:14", "network": {"id": "aff4f146-97db-4102-abf1-6528e74cad55", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1894452367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1894452367-network", "vif_mac": "fa:16:3e:88:35:14"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6942d31258304de68c9f7f8bb9304acb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa7e0c2-91", "ovs_interfaceid": "baa7e0c2-91d4-4077-8405-abb537475df2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bf6f4f48-d558-4b8a-8153-f8d46f79527e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd2900d30-2c4c-4d57-9135-d45564c0c596'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '0868ed31-5075-411e-8902-0d4dccd15391', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DxudpZVQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '87712dfd-d67b-4e5e-a75d-ca2dd7c764b1', 'attached_at': '', 'detached_at': '', 'volume_id': 'b5405a72-4678-4dd0-a1b6-67ec1f44c492', 'serial': 'b5405a72-4678-4dd0-a1b6-67ec1f44c492'}, 'volume_type': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG nova.objects.instance [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lazy-loading 'resources' on Instance uuid 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG nova.objects.instance [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lazy-loading 'numa_topology' on Instance uuid 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:59:32 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:59:32 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:59:32 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG nova.objects.instance [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lazy-loading 'vcpu_model' on Instance uuid 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DxudpZVQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:59:32 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:59:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:59:32 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:59:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:59:32 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 22:59:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45b9cfe-3ad8-4d75-ab19-7de3a6a86c7c]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = DxudpZVQ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 14 22:59:32 user nova-compute[72766]: node.name = iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492
Aug 14 22:59:32 user nova-compute[72766]: node.tpgt = -1
Aug 14 22:59:32 user nova-compute[72766]: node.startup = automatic
Aug 14 22:59:32 user nova-compute[72766]: node.leading_login = No
Aug 14 22:59:32 user nova-compute[72766]: iface.iscsi_ifacename = default
Aug 14 22:59:32 user nova-compute[72766]: iface.net_ifacename = <empty>
Aug 14 22:59:32 user nova-compute[72766]: iface.ipaddress = <empty>
Aug 14 22:59:32 user nova-compute[72766]: iface.prefix_len = 0
Aug 14 22:59:32 user nova-compute[72766]: iface.hwaddress = <empty>
Aug 14 22:59:32 user nova-compute[72766]: iface.transport_name = tcp
Aug 14 22:59:32 user nova-compute[72766]: iface.initiatorname = <empty>
Aug 14 22:59:32 user nova-compute[72766]: iface.state = <empty>
Aug 14 22:59:32 user nova-compute[72766]: iface.vlan_id = 0
Aug 14 22:59:32 user nova-compute[72766]: iface.vlan_priority = 0
Aug 14 22:59:32 user nova-compute[72766]: iface.vlan_state = <empty>
Aug 14 22:59:32 user nova-compute[72766]: iface.iface_num = 0
Aug 14 22:59:32 user nova-compute[72766]: iface.mtu = 0
Aug 14 22:59:32 user nova-compute[72766]: iface.port = 0
Aug 14 22:59:32 user nova-compute[72766]: iface.bootproto = <empty>
Aug 14 22:59:32 user nova-compute[72766]: iface.subnet_mask = <empty>
Aug 14 22:59:32 user nova-compute[72766]: iface.gateway = <empty>
Aug 14 22:59:32 user nova-compute[72766]: iface.dhcp_alt_client_id_state = <empty>
Aug 14 22:59:32 user nova-compute[72766]: iface.dhcp_alt_client_id = <empty>
Aug 14 22:59:32 user nova-compute[72766]: iface.dhcp_dns = <empty>
Aug 14 22:59:32 user nova-compute[72766]: iface.dhcp_learn_iqn = <empty>
Aug 14 22:59:32 user nova-compute[72766]: iface.dhcp_req_vendor_id_state = <empty>
Aug 14 22:59:32 user nova-compute[72766]: iface.dhcp_vendor_id_state = <empty>
Aug 14 22:59:32 user nova-compute[72766]: iface.dhcp_vendor_id = <empty>
Aug 14 22:59:32 user nova-compute[72766]: iface.dhcp_slp_da = <empty>
Aug 14 22:59:32 user nova-compute[72766]: iface.fragmentation = <empty>
Aug 14 22:59:32 user nova-compute[72766]: iface.gratuitous_arp = <empty>
Aug 14 22:59:32 user nova-compute[72766]: iface.incoming_forwarding = <empty>
Aug 14 22:59:32 user nova-compute[72766]: iface.tos_state = <empty>
Aug 14 22:59:32 user nova-compute[72766]: iface.tos = 0
Aug 14 22:59:32 user nova-compute[72766]: iface.ttl = 0
Aug 14 22:59:32 user nova-compute[72766]: iface.delayed_ack = <empty>
Aug 14 22:59:32 user nova-compute[72766]: iface.tcp_nagle = <empty>
Aug 14 22:59:32 user nova-compute[72766]: iface.tcp_wsf_state = <empty>
Aug 14 22:59:32 user nova-compute[72766]: iface.tcp_wsf = 0
Aug 14 22:59:32 user nova-compute[72766]: iface.tcp_timer_scale = 0
Aug 14 22:59:32 user nova-compute[72766]: iface.tcp_timestamp = <empty>
Aug 14 22:59:32 user nova-compute[72766]: iface.redirect = <empty>
Aug 14 22:59:32 user nova-compute[72766]: iface.def_task_mgmt_timeout = 0
Aug 14 22:59:32 user nova-compute[72766]: iface.header_digest = <empty>
Aug 14 22:59:32 user nova-compute[72766]: iface.data_digest = <empty>
Aug 14 22:59:32 user nova-compute[72766]: iface.immediate_data = <empty>
Aug 14 22:59:32 user nova-compute[72766]: iface.initial_r2t = <empty>
Aug 14 22:59:32 user nova-compute[72766]: iface.data_seq_inorder = <empty>
Aug 14 22:59:32 user nova-compute[72766]: iface.data_pdu_inorder = <empty>
Aug 14 22:59:32 user nova-compute[72766]: iface.erl = 0
Aug 14 22:59:32 user nova-compute[72766]: iface.max_receive_data_len = 0
Aug 14 22:59:32 user nova-compute[72766]: iface.first_burst_len = 0
Aug 14 22:59:32 user nova-compute[72766]: iface.max_outstanding_r2t = 0
Aug 14 22:59:32 user nova-compute[72766]: iface.max_burst_len = 0
Aug 14 22:59:32 user nova-compute[72766]: iface.chap_auth = <empty>
Aug 14 22:59:32 user nova-compute[72766]: iface.bidi_chap = <empty>
Aug 14 22:59:32 user nova-compute[72766]: iface.strict_login_compliance = <empty>
Aug 14 22:59:32 user nova-compute[72766]: iface.discovery_auth = <empty>
Aug 14 22:59:32 user nova-compute[72766]: iface.discovery_logout = <empty>
Aug 14 22:59:32 user nova-compute[72766]: node.discovery_address = <empty>
Aug 14 22:59:32 user nova-compute[72766]: node.discovery_port = 0
Aug 14 22:59:32 user nova-compute[72766]: node.discovery_type = static
Aug 14 22:59:32 user nova-compute[72766]: node.session.initial_cmdsn = 0
Aug 14 22:59:32 user nova-compute[72766]: node.session.initial_login_retry_max = 8
Aug 14 22:59:32 user nova-compute[72766]: node.session.xmit_thread_priority = -20
Aug 14 22:59:32 user nova-compute[72766]: node.session.cmds_max = 128
Aug 14 22:59:32 user nova-compute[72766]: node.session.queue_depth = 32
Aug 14 22:59:32 user nova-compute[72766]: node.session.nr_sessions = 1
Aug 14 22:59:32 user nova-compute[72766]: node.session.auth.authmethod = CHAP
Aug 14 22:59:32 user nova-compute[72766]: node.session.auth.username = DxudpZVQ
Aug 14 22:59:32 user nova-compute[72766]: node.session.auth.password = ***
Aug 14 22:59:32 user nova-compute[72766]: node.session.auth.username_in = <empty>
Aug 14 22:59:32 user nova-compute[72766]: node.session.auth.password_in = <empty>
Aug 14 22:59:32 user nova-compute[72766]: node.session.auth.chap_algs = MD5
Aug 14 22:59:32 user nova-compute[72766]: node.session.timeo.replacement_timeout = 120
Aug 14 22:59:32 user nova-compute[72766]: node.session.err_timeo.abort_timeout = 15
Aug 14 22:59:32 user nova-compute[72766]: node.session.err_timeo.lu_reset_timeout = 30
Aug 14 22:59:32 user nova-compute[72766]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 14 22:59:32 user nova-compute[72766]: node.session.err_timeo.host_reset_timeout = 60
Aug 14 22:59:32 user nova-compute[72766]: node.session.iscsi.FastAbort = Yes
Aug 14 22:59:32 user nova-compute[72766]: node.session.iscsi.InitialR2T = No
Aug 14 22:59:32 user nova-compute[72766]: node.session.iscsi.ImmediateData = Yes
Aug 14 22:59:32 user nova-compute[72766]: node.session.iscsi.FirstBurstLength = 262144
Aug 14 22:59:32 user nova-compute[72766]: node.session.iscsi.MaxBurstLength = 16776192
Aug 14 22:59:32 user nova-compute[72766]: node.session.iscsi.DefaultTime2Retain = 0
Aug 14 22:59:32 user nova-compute[72766]: node.session.iscsi.DefaultTime2Wait = 2
Aug 14 22:59:32 user nova-compute[72766]: node.session.iscsi.MaxConnections = 1
Aug 14 22:59:32 user nova-compute[72766]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 14 22:59:32 user nova-compute[72766]: node.session.iscsi.ERL = 0
Aug 14 22:59:32 user nova-compute[72766]: node.session.scan = manual
Aug 14 22:59:32 user nova-compute[72766]: node.session.reopen_max = 0
Aug 14 22:59:32 user nova-compute[72766]: node.conn[0].address = 172.16.0.220
Aug 14 22:59:32 user nova-compute[72766]: node.conn[0].port = 3260
Aug 14 22:59:32 user nova-compute[72766]: node.conn[0].startup = manual
Aug 14 22:59:32 user nova-compute[72766]: node.conn[0].tcp.window_size = 524288
Aug 14 22:59:32 user nova-compute[72766]: node.conn[0].tcp.type_of_service = 0
Aug 14 22:59:32 user nova-compute[72766]: node.conn[0].timeo.logout_timeout = 15
Aug 14 22:59:32 user nova-compute[72766]: node.conn[0].timeo.login_timeout = 15
Aug 14 22:59:32 user nova-compute[72766]: node.conn[0].timeo.auth_timeout = 45
Aug 14 22:59:32 user nova-compute[72766]: node.conn[0].timeo.noop_out_interval = 5
Aug 14 22:59:32 user nova-compute[72766]: node.conn[0].timeo.noop_out_timeout = 5
Aug 14 22:59:32 user nova-compute[72766]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 14 22:59:32 user nova-compute[72766]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 14 22:59:32 user nova-compute[72766]: node.conn[0].iscsi.HeaderDigest = None
Aug 14 22:59:32 user nova-compute[72766]: node.conn[0].iscsi.DataDigest = None
Aug 14 22:59:32 user nova-compute[72766]: node.conn[0].iscsi.IFMarker = No
Aug 14 22:59:32 user nova-compute[72766]: node.conn[0].iscsi.OFMarker = No
Aug 14 22:59:32 user nova-compute[72766]: # END RECORD
Aug 14 22:59:32 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c6c447-96e9-42d3-af44-45652045c030]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f97290-e262-4015-82bd-024e580f8570]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DxudpZVQ {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DxudpZVQ" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3d53ca-fc2c-4392-b5cc-e013d8a1c94f]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DxudpZVQ'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[241c9659-d2ab-438f-bed8-4a5c9a8d4068]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[491780e7-982b-4b58-ae7b-9bf5a737c9f7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 22:59:32 user nova-compute[72766]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 22:59:32 user nova-compute[72766]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391 (non-flash)
Aug 14 22:59:32 user nova-compute[72766]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)
Aug 14 22:59:32 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 22:59:32 user nova-compute[72766]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 22:59:32 user nova-compute[72766]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391 (non-flash)
Aug 14 22:59:32 user nova-compute[72766]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)
Aug 14 22:59:32 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.173s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] HCTL ('36', '0', '0', 0) found on session 15 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ec5709-e42d-40b5-9758-f60c1fcae0c8]: (4, ('0 0 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Searching for a device in session 15 and hctl ('36', '0', '0', 0) yield: sde {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DxudpZVQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.207s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] <== connect_volume: return (208ms) {'type': 'block', 'scsi_wwn': '26261353432653561', 'path': '/dev/sde'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261353432653561', 'path': '/dev/sde'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:55:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-315419637',display_name='tempest-ServerStableDeviceRescueTest-server-315419637',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-315419637',id=3,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBo4nGfM00D0QCYyQV/cI8aNR3E6ibpD8xD1rxYRn2nwO6hDolWgvqHNcTgNVefuExGkBWELmMo7h+sXUj+Cy6+nJ0NZHfxWlgzBRlgC0eaAYciav7rLbA5/A+RXO8R0rg==',key_name='tempest-keypair-255768832',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:55:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6942d31258304de68c9f7f8bb9304acb',ramdisk_id='',reservation_id='r-ry04k9s6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1332966635',owner_user_name='tempest-ServerStableDeviceRescueTest-1332966635-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:57:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76b70ec93e9c47d7a4c224fb05c52fbf',uuid=87712dfd-d67b-4e5e-a75d-ca2dd7c764b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "baa7e0c2-91d4-4077-8405-abb537475df2", "address": "fa:16:3e:88:35:14", "network": {"id": "aff4f146-97db-4102-abf1-6528e74cad55", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1894452367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1894452367-network", "vif_mac": "fa:16:3e:88:35:14"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6942d31258304de68c9f7f8bb9304acb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa7e0c2-91", "ovs_interfaceid": "baa7e0c2-91d4-4077-8405-abb537475df2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Converting VIF {"id": "baa7e0c2-91d4-4077-8405-abb537475df2", "address": "fa:16:3e:88:35:14", "network": {"id": "aff4f146-97db-4102-abf1-6528e74cad55", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1894452367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1894452367-network", "vif_mac": "fa:16:3e:88:35:14"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6942d31258304de68c9f7f8bb9304acb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa7e0c2-91", "ovs_interfaceid": "baa7e0c2-91d4-4077-8405-abb537475df2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:35:14,bridge_name='br-int',has_traffic_filtering=True,id=baa7e0c2-91d4-4077-8405-abb537475df2,network=Network(aff4f146-97db-4102-abf1-6528e74cad55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaa7e0c2-91') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG nova.objects.instance [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lazy-loading 'pci_devices' on Instance uuid 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] End _get_guest_xml xml=<domain type="kvm">
Aug 14 22:59:32 user nova-compute[72766]:   <uuid>87712dfd-d67b-4e5e-a75d-ca2dd7c764b1</uuid>
Aug 14 22:59:32 user nova-compute[72766]:   <name>instance-00000003</name>
Aug 14 22:59:32 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 22:59:32 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 22:59:32 user nova-compute[72766]:   <metadata>
Aug 14 22:59:32 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:59:32 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 22:59:32 user nova-compute[72766]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-315419637</nova:name>
Aug 14 22:59:32 user nova-compute[72766]:       <nova:creationTime>2023-08-14 22:59:32</nova:creationTime>
Aug 14 22:59:32 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 22:59:32 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 22:59:32 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 22:59:32 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 22:59:32 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:59:32 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 22:59:32 user nova-compute[72766]:       </nova:flavor>
Aug 14 22:59:32 user nova-compute[72766]:       <nova:owner>
Aug 14 22:59:32 user nova-compute[72766]:         <nova:user uuid="76b70ec93e9c47d7a4c224fb05c52fbf">tempest-ServerStableDeviceRescueTest-1332966635-project-member</nova:user>
Aug 14 22:59:32 user nova-compute[72766]:         <nova:project uuid="6942d31258304de68c9f7f8bb9304acb">tempest-ServerStableDeviceRescueTest-1332966635</nova:project>
Aug 14 22:59:32 user nova-compute[72766]:       </nova:owner>
Aug 14 22:59:32 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 22:59:32 user nova-compute[72766]:       <nova:ports>
Aug 14 22:59:32 user nova-compute[72766]:         <nova:port uuid="baa7e0c2-91d4-4077-8405-abb537475df2">
Aug 14 22:59:32 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 22:59:32 user nova-compute[72766]:         </nova:port>
Aug 14 22:59:32 user nova-compute[72766]:       </nova:ports>
Aug 14 22:59:32 user nova-compute[72766]:     </nova:instance>
Aug 14 22:59:32 user nova-compute[72766]:   </metadata>
Aug 14 22:59:32 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 22:59:32 user nova-compute[72766]:     <system>
Aug 14 22:59:32 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 22:59:32 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 22:59:32 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 22:59:32 user nova-compute[72766]:       <entry name="serial">87712dfd-d67b-4e5e-a75d-ca2dd7c764b1</entry>
Aug 14 22:59:32 user nova-compute[72766]:       <entry name="uuid">87712dfd-d67b-4e5e-a75d-ca2dd7c764b1</entry>
Aug 14 22:59:32 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 22:59:32 user nova-compute[72766]:     </system>
Aug 14 22:59:32 user nova-compute[72766]:   </sysinfo>
Aug 14 22:59:32 user nova-compute[72766]:   <os>
Aug 14 22:59:32 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 22:59:32 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 22:59:32 user nova-compute[72766]:   </os>
Aug 14 22:59:32 user nova-compute[72766]:   <features>
Aug 14 22:59:32 user nova-compute[72766]:     <acpi/>
Aug 14 22:59:32 user nova-compute[72766]:     <apic/>
Aug 14 22:59:32 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 22:59:32 user nova-compute[72766]:   </features>
Aug 14 22:59:32 user nova-compute[72766]:   <clock offset="utc">
Aug 14 22:59:32 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 22:59:32 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 22:59:32 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 22:59:32 user nova-compute[72766]:   </clock>
Aug 14 22:59:32 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 22:59:32 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 22:59:32 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 22:59:32 user nova-compute[72766]:   </cpu>
Aug 14 22:59:32 user nova-compute[72766]:   <devices>
Aug 14 22:59:32 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 22:59:32 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 22:59:32 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk"/>
Aug 14 22:59:32 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 22:59:32 user nova-compute[72766]:     </disk>
Aug 14 22:59:32 user nova-compute[72766]:     <disk type="block" device="disk">
Aug 14 22:59:32 user nova-compute[72766]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:59:32 user nova-compute[72766]:       <source dev="/dev/sde"/>
Aug 14 22:59:32 user nova-compute[72766]:       <target dev="vdb" bus="virtio"/>
Aug 14 22:59:32 user nova-compute[72766]:       <serial>b5405a72-4678-4dd0-a1b6-67ec1f44c492</serial>
Aug 14 22:59:32 user nova-compute[72766]:     </disk>
Aug 14 22:59:32 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 22:59:32 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 22:59:32 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk.rescue"/>
Aug 14 22:59:32 user nova-compute[72766]:       <target dev="vdc" bus="virtio"/>
Aug 14 22:59:32 user nova-compute[72766]:       <boot order="1"/>
Aug 14 22:59:32 user nova-compute[72766]:     </disk>
Aug 14 22:59:32 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 22:59:32 user nova-compute[72766]:       <mac address="fa:16:3e:88:35:14"/>
Aug 14 22:59:32 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 22:59:32 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 22:59:32 user nova-compute[72766]:       <target dev="tapbaa7e0c2-91"/>
Aug 14 22:59:32 user nova-compute[72766]:     </interface>
Aug 14 22:59:32 user nova-compute[72766]:     <serial type="pty">
Aug 14 22:59:32 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/console.log" append="off"/>
Aug 14 22:59:32 user nova-compute[72766]:     </serial>
Aug 14 22:59:32 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 22:59:32 user nova-compute[72766]:     <video>
Aug 14 22:59:32 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 22:59:32 user nova-compute[72766]:     </video>
Aug 14 22:59:32 user nova-compute[72766]:     <rng model="virtio">
Aug 14 22:59:32 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 22:59:32 user nova-compute[72766]:     </rng>
Aug 14 22:59:32 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 22:59:32 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 22:59:32 user nova-compute[72766]:       <stats period="10"/>
Aug 14 22:59:32 user nova-compute[72766]:     </memballoon>
Aug 14 22:59:32 user nova-compute[72766]:   </devices>
Aug 14 22:59:32 user nova-compute[72766]: </domain>
Aug 14 22:59:32 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 22:59:32 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Instance destroyed successfully.
Aug 14 22:59:32 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] No VIF found with MAC fa:16:3e:88:35:14, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:59:32 user nova-compute[72766]: DEBUG nova.network.neutron [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Successfully created port: 0d0642a2-a76e-4de1-956c-fb58280caec3 {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 22:59:33 user nova-compute[72766]: DEBUG nova.network.neutron [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Successfully created port: a9ba4ad3-e5eb-436a-8514-567d511f1999 {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 22:59:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:34 user nova-compute[72766]: DEBUG nova.compute.manager [req-5a91f0df-1ac0-46f6-a3a2-5f34eb41a9a2 req-c577744c-1aed-46fd-9452-70908f0619a2 service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Received event network-vif-plugged-baa7e0c2-91d4-4077-8405-abb537475df2 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:59:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-5a91f0df-1ac0-46f6-a3a2-5f34eb41a9a2 req-c577744c-1aed-46fd-9452-70908f0619a2 service nova] Acquiring lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-5a91f0df-1ac0-46f6-a3a2-5f34eb41a9a2 req-c577744c-1aed-46fd-9452-70908f0619a2 service nova] Lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-5a91f0df-1ac0-46f6-a3a2-5f34eb41a9a2 req-c577744c-1aed-46fd-9452-70908f0619a2 service nova] Lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:34 user nova-compute[72766]: DEBUG nova.compute.manager [req-5a91f0df-1ac0-46f6-a3a2-5f34eb41a9a2 req-c577744c-1aed-46fd-9452-70908f0619a2 service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] No waiting events found dispatching network-vif-plugged-baa7e0c2-91d4-4077-8405-abb537475df2 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:59:34 user nova-compute[72766]: WARNING nova.compute.manager [req-5a91f0df-1ac0-46f6-a3a2-5f34eb41a9a2 req-c577744c-1aed-46fd-9452-70908f0619a2 service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Received unexpected event network-vif-plugged-baa7e0c2-91d4-4077-8405-abb537475df2 for instance with vm_state active and task_state rescuing.
Aug 14 22:59:34 user nova-compute[72766]: DEBUG nova.network.neutron [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Successfully created port: 2774a932-7806-4c06-a128-e067a3072ebc {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 22:59:35 user nova-compute[72766]: DEBUG nova.network.neutron [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Successfully created port: 0c7d05ab-1414-4892-a28e-18b3816a1040 {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 22:59:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:36 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:36 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Removed pending event for 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1 due to event {{(pid=72766) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 22:59:36 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692053976.5534241, 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:59:36 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] VM Resumed (Lifecycle Event)
Aug 14 22:59:36 user nova-compute[72766]: DEBUG nova.compute.manager [None req-824d3600-6923-4610-9511-7cc6768faee5 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:59:36 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:59:36 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:59:36 user nova-compute[72766]: DEBUG nova.network.neutron [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Successfully updated port: 098834fb-ad7d-4032-9f2c-28b8a206d4c4 {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 22:59:36 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 22:59:36 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692053976.555543, 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:59:36 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] VM Started (Lifecycle Event)
Aug 14 22:59:36 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:59:36 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:59:36 user nova-compute[72766]: DEBUG nova.compute.manager [req-f870557c-7447-4a0c-ae8a-8553e9e3b8a9 req-48494317-4e29-40be-a9f4-ec131fc94281 service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Received event network-vif-plugged-baa7e0c2-91d4-4077-8405-abb537475df2 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:59:36 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f870557c-7447-4a0c-ae8a-8553e9e3b8a9 req-48494317-4e29-40be-a9f4-ec131fc94281 service nova] Acquiring lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:36 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f870557c-7447-4a0c-ae8a-8553e9e3b8a9 req-48494317-4e29-40be-a9f4-ec131fc94281 service nova] Lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:36 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f870557c-7447-4a0c-ae8a-8553e9e3b8a9 req-48494317-4e29-40be-a9f4-ec131fc94281 service nova] Lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:36 user nova-compute[72766]: DEBUG nova.compute.manager [req-f870557c-7447-4a0c-ae8a-8553e9e3b8a9 req-48494317-4e29-40be-a9f4-ec131fc94281 service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] No waiting events found dispatching network-vif-plugged-baa7e0c2-91d4-4077-8405-abb537475df2 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:59:36 user nova-compute[72766]: WARNING nova.compute.manager [req-f870557c-7447-4a0c-ae8a-8553e9e3b8a9 req-48494317-4e29-40be-a9f4-ec131fc94281 service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Received unexpected event network-vif-plugged-baa7e0c2-91d4-4077-8405-abb537475df2 for instance with vm_state rescued and task_state None.
Aug 14 22:59:36 user nova-compute[72766]: DEBUG nova.compute.manager [req-f870557c-7447-4a0c-ae8a-8553e9e3b8a9 req-48494317-4e29-40be-a9f4-ec131fc94281 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-changed-098834fb-ad7d-4032-9f2c-28b8a206d4c4 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:59:36 user nova-compute[72766]: DEBUG nova.compute.manager [req-f870557c-7447-4a0c-ae8a-8553e9e3b8a9 req-48494317-4e29-40be-a9f4-ec131fc94281 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Refreshing instance network info cache due to event network-changed-098834fb-ad7d-4032-9f2c-28b8a206d4c4. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:59:36 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f870557c-7447-4a0c-ae8a-8553e9e3b8a9 req-48494317-4e29-40be-a9f4-ec131fc94281 service nova] Acquiring lock "refresh_cache-e503ad35-1d9e-47d8-9a25-58e2a503ff02" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:59:36 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f870557c-7447-4a0c-ae8a-8553e9e3b8a9 req-48494317-4e29-40be-a9f4-ec131fc94281 service nova] Acquired lock "refresh_cache-e503ad35-1d9e-47d8-9a25-58e2a503ff02" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:59:36 user nova-compute[72766]: DEBUG nova.network.neutron [req-f870557c-7447-4a0c-ae8a-8553e9e3b8a9 req-48494317-4e29-40be-a9f4-ec131fc94281 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Refreshing network info cache for port 098834fb-ad7d-4032-9f2c-28b8a206d4c4 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:59:37 user nova-compute[72766]: DEBUG nova.network.neutron [req-f870557c-7447-4a0c-ae8a-8553e9e3b8a9 req-48494317-4e29-40be-a9f4-ec131fc94281 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 22:59:37 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ef882af6-e0fe-474f-ab0b-f56a66c4df5e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Acquiring lock "33e6f8aa-bb0d-478d-b7b5-3334302476fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:37 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ef882af6-e0fe-474f-ab0b-f56a66c4df5e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Lock "33e6f8aa-bb0d-478d-b7b5-3334302476fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:37 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ef882af6-e0fe-474f-ab0b-f56a66c4df5e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Acquiring lock "33e6f8aa-bb0d-478d-b7b5-3334302476fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:37 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ef882af6-e0fe-474f-ab0b-f56a66c4df5e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Lock "33e6f8aa-bb0d-478d-b7b5-3334302476fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:37 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ef882af6-e0fe-474f-ab0b-f56a66c4df5e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Lock "33e6f8aa-bb0d-478d-b7b5-3334302476fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:37 user nova-compute[72766]: INFO nova.compute.manager [None req-ef882af6-e0fe-474f-ab0b-f56a66c4df5e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Terminating instance
Aug 14 22:59:37 user nova-compute[72766]: DEBUG nova.compute.manager [None req-ef882af6-e0fe-474f-ab0b-f56a66c4df5e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 22:59:37 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:37 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:37 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:37 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:37 user nova-compute[72766]: DEBUG nova.network.neutron [req-f870557c-7447-4a0c-ae8a-8553e9e3b8a9 req-48494317-4e29-40be-a9f4-ec131fc94281 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:59:37 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f870557c-7447-4a0c-ae8a-8553e9e3b8a9 req-48494317-4e29-40be-a9f4-ec131fc94281 service nova] Releasing lock "refresh_cache-e503ad35-1d9e-47d8-9a25-58e2a503ff02" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:59:37 user nova-compute[72766]: DEBUG nova.network.neutron [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Successfully updated port: 4ad9f734-e280-4596-a00e-672de5d6ecb6 {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 22:59:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:38 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Instance destroyed successfully.
Aug 14 22:59:38 user nova-compute[72766]: DEBUG nova.objects.instance [None req-ef882af6-e0fe-474f-ab0b-f56a66c4df5e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Lazy-loading 'resources' on Instance uuid 33e6f8aa-bb0d-478d-b7b5-3334302476fb {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:59:38 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-ef882af6-e0fe-474f-ab0b-f56a66c4df5e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:55:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2066569469',display_name='tempest-TestVolumeSwap-server-2066569469',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2066569469',id=8,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKDecC6LOCTIDSHf+bGtHd82oVY7YTZ/rwmghiUc+dvaQaBUj59VHwqfdpQWbNdeqp2hsPtXJvYRgsJQVnD6PI53tjwd1U2uDPvcdF6uSDJffvmt1+bk3Opv0aNzfAvyw==',key_name='tempest-keypair-1372605118',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:56:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5740ddd945a1401b98aafaa1cbae8c13',ramdisk_id='',reservation_id='r-8km08n7q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-826809882',owner_user_name='tempest-TestVolumeSwap-826809882-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:56:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74108c91a9be4bf1b51dc5f7b3f80087',uuid=33e6f8aa-bb0d-478d-b7b5-3334302476fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a214a31-3ef2-4a37-b0fa-c27a86be068c", "address": "fa:16:3e:bb:06:dd", "network": {"id": "411e3c7b-1261-4661-91a6-12630b932df7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-230148116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5740ddd945a1401b98aafaa1cbae8c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a214a31-3e", "ovs_interfaceid": "9a214a31-3ef2-4a37-b0fa-c27a86be068c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 22:59:38 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-ef882af6-e0fe-474f-ab0b-f56a66c4df5e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Converting VIF {"id": "9a214a31-3ef2-4a37-b0fa-c27a86be068c", "address": "fa:16:3e:bb:06:dd", "network": {"id": "411e3c7b-1261-4661-91a6-12630b932df7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-230148116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5740ddd945a1401b98aafaa1cbae8c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a214a31-3e", "ovs_interfaceid": "9a214a31-3ef2-4a37-b0fa-c27a86be068c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:59:38 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-ef882af6-e0fe-474f-ab0b-f56a66c4df5e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:06:dd,bridge_name='br-int',has_traffic_filtering=True,id=9a214a31-3ef2-4a37-b0fa-c27a86be068c,network=Network(411e3c7b-1261-4661-91a6-12630b932df7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a214a31-3e') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:59:38 user nova-compute[72766]: DEBUG os_vif [None req-ef882af6-e0fe-474f-ab0b-f56a66c4df5e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:06:dd,bridge_name='br-int',has_traffic_filtering=True,id=9a214a31-3ef2-4a37-b0fa-c27a86be068c,network=Network(411e3c7b-1261-4661-91a6-12630b932df7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a214a31-3e') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 22:59:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a214a31-3e, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:59:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:59:38 user nova-compute[72766]: INFO os_vif [None req-ef882af6-e0fe-474f-ab0b-f56a66c4df5e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:06:dd,bridge_name='br-int',has_traffic_filtering=True,id=9a214a31-3ef2-4a37-b0fa-c27a86be068c,network=Network(411e3c7b-1261-4661-91a6-12630b932df7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a214a31-3e')
Aug 14 22:59:38 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-ef882af6-e0fe-474f-ab0b-f56a66c4df5e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Deleting instance files /opt/stack/data/nova/instances/33e6f8aa-bb0d-478d-b7b5-3334302476fb_del
Aug 14 22:59:38 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-ef882af6-e0fe-474f-ab0b-f56a66c4df5e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Deletion of /opt/stack/data/nova/instances/33e6f8aa-bb0d-478d-b7b5-3334302476fb_del complete
Aug 14 22:59:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:38 user nova-compute[72766]: INFO nova.compute.manager [None req-ef882af6-e0fe-474f-ab0b-f56a66c4df5e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Took 1.09 seconds to destroy the instance on the hypervisor.
Aug 14 22:59:38 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-ef882af6-e0fe-474f-ab0b-f56a66c4df5e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 22:59:38 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 22:59:38 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 22:59:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:39 user nova-compute[72766]: DEBUG nova.compute.manager [req-05c5760d-45e0-4380-9e3f-25c487eff088 req-e3ac665b-eb43-4c7a-bd0d-0ae0886283d8 service nova] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Received event network-vif-unplugged-9a214a31-3ef2-4a37-b0fa-c27a86be068c {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:59:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-05c5760d-45e0-4380-9e3f-25c487eff088 req-e3ac665b-eb43-4c7a-bd0d-0ae0886283d8 service nova] Acquiring lock "33e6f8aa-bb0d-478d-b7b5-3334302476fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-05c5760d-45e0-4380-9e3f-25c487eff088 req-e3ac665b-eb43-4c7a-bd0d-0ae0886283d8 service nova] Lock "33e6f8aa-bb0d-478d-b7b5-3334302476fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-05c5760d-45e0-4380-9e3f-25c487eff088 req-e3ac665b-eb43-4c7a-bd0d-0ae0886283d8 service nova] Lock "33e6f8aa-bb0d-478d-b7b5-3334302476fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:39 user nova-compute[72766]: DEBUG nova.compute.manager [req-05c5760d-45e0-4380-9e3f-25c487eff088 req-e3ac665b-eb43-4c7a-bd0d-0ae0886283d8 service nova] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] No waiting events found dispatching network-vif-unplugged-9a214a31-3ef2-4a37-b0fa-c27a86be068c {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:59:39 user nova-compute[72766]: DEBUG nova.compute.manager [req-05c5760d-45e0-4380-9e3f-25c487eff088 req-e3ac665b-eb43-4c7a-bd0d-0ae0886283d8 service nova] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Received event network-vif-unplugged-9a214a31-3ef2-4a37-b0fa-c27a86be068c for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 22:59:39 user nova-compute[72766]: DEBUG nova.compute.manager [req-05c5760d-45e0-4380-9e3f-25c487eff088 req-e3ac665b-eb43-4c7a-bd0d-0ae0886283d8 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-changed-4ad9f734-e280-4596-a00e-672de5d6ecb6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:59:39 user nova-compute[72766]: DEBUG nova.compute.manager [req-05c5760d-45e0-4380-9e3f-25c487eff088 req-e3ac665b-eb43-4c7a-bd0d-0ae0886283d8 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Refreshing instance network info cache due to event network-changed-4ad9f734-e280-4596-a00e-672de5d6ecb6. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:59:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-05c5760d-45e0-4380-9e3f-25c487eff088 req-e3ac665b-eb43-4c7a-bd0d-0ae0886283d8 service nova] Acquiring lock "refresh_cache-e503ad35-1d9e-47d8-9a25-58e2a503ff02" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:59:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-05c5760d-45e0-4380-9e3f-25c487eff088 req-e3ac665b-eb43-4c7a-bd0d-0ae0886283d8 service nova] Acquired lock "refresh_cache-e503ad35-1d9e-47d8-9a25-58e2a503ff02" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:59:39 user nova-compute[72766]: DEBUG nova.network.neutron [req-05c5760d-45e0-4380-9e3f-25c487eff088 req-e3ac665b-eb43-4c7a-bd0d-0ae0886283d8 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Refreshing network info cache for port 4ad9f734-e280-4596-a00e-672de5d6ecb6 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:59:39 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:39 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:39 user nova-compute[72766]: DEBUG nova.network.neutron [req-05c5760d-45e0-4380-9e3f-25c487eff088 req-e3ac665b-eb43-4c7a-bd0d-0ae0886283d8 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 22:59:39 user nova-compute[72766]: DEBUG nova.network.neutron [req-05c5760d-45e0-4380-9e3f-25c487eff088 req-e3ac665b-eb43-4c7a-bd0d-0ae0886283d8 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:59:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-05c5760d-45e0-4380-9e3f-25c487eff088 req-e3ac665b-eb43-4c7a-bd0d-0ae0886283d8 service nova] Releasing lock "refresh_cache-e503ad35-1d9e-47d8-9a25-58e2a503ff02" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:59:39 user nova-compute[72766]: DEBUG nova.compute.manager [req-05c5760d-45e0-4380-9e3f-25c487eff088 req-e3ac665b-eb43-4c7a-bd0d-0ae0886283d8 service nova] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Received event network-vif-plugged-9a214a31-3ef2-4a37-b0fa-c27a86be068c {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:59:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-05c5760d-45e0-4380-9e3f-25c487eff088 req-e3ac665b-eb43-4c7a-bd0d-0ae0886283d8 service nova] Acquiring lock "33e6f8aa-bb0d-478d-b7b5-3334302476fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-05c5760d-45e0-4380-9e3f-25c487eff088 req-e3ac665b-eb43-4c7a-bd0d-0ae0886283d8 service nova] Lock "33e6f8aa-bb0d-478d-b7b5-3334302476fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-05c5760d-45e0-4380-9e3f-25c487eff088 req-e3ac665b-eb43-4c7a-bd0d-0ae0886283d8 service nova] Lock "33e6f8aa-bb0d-478d-b7b5-3334302476fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:39 user nova-compute[72766]: DEBUG nova.compute.manager [req-05c5760d-45e0-4380-9e3f-25c487eff088 req-e3ac665b-eb43-4c7a-bd0d-0ae0886283d8 service nova] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] No waiting events found dispatching network-vif-plugged-9a214a31-3ef2-4a37-b0fa-c27a86be068c {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:59:39 user nova-compute[72766]: WARNING nova.compute.manager [req-05c5760d-45e0-4380-9e3f-25c487eff088 req-e3ac665b-eb43-4c7a-bd0d-0ae0886283d8 service nova] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Received unexpected event network-vif-plugged-9a214a31-3ef2-4a37-b0fa-c27a86be068c for instance with vm_state active and task_state deleting.
Aug 14 22:59:39 user nova-compute[72766]: DEBUG nova.compute.manager [req-05c5760d-45e0-4380-9e3f-25c487eff088 req-e3ac665b-eb43-4c7a-bd0d-0ae0886283d8 service nova] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Received event network-vif-plugged-9a214a31-3ef2-4a37-b0fa-c27a86be068c {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:59:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-05c5760d-45e0-4380-9e3f-25c487eff088 req-e3ac665b-eb43-4c7a-bd0d-0ae0886283d8 service nova] Acquiring lock "33e6f8aa-bb0d-478d-b7b5-3334302476fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-05c5760d-45e0-4380-9e3f-25c487eff088 req-e3ac665b-eb43-4c7a-bd0d-0ae0886283d8 service nova] Lock "33e6f8aa-bb0d-478d-b7b5-3334302476fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-05c5760d-45e0-4380-9e3f-25c487eff088 req-e3ac665b-eb43-4c7a-bd0d-0ae0886283d8 service nova] Lock "33e6f8aa-bb0d-478d-b7b5-3334302476fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:39 user nova-compute[72766]: DEBUG nova.compute.manager [req-05c5760d-45e0-4380-9e3f-25c487eff088 req-e3ac665b-eb43-4c7a-bd0d-0ae0886283d8 service nova] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] No waiting events found dispatching network-vif-plugged-9a214a31-3ef2-4a37-b0fa-c27a86be068c {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:59:39 user nova-compute[72766]: WARNING nova.compute.manager [req-05c5760d-45e0-4380-9e3f-25c487eff088 req-e3ac665b-eb43-4c7a-bd0d-0ae0886283d8 service nova] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Received unexpected event network-vif-plugged-9a214a31-3ef2-4a37-b0fa-c27a86be068c for instance with vm_state active and task_state deleting.
Aug 14 22:59:39 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:59:39 user nova-compute[72766]: DEBUG nova.compute.manager [req-be54b656-51e4-41b3-9a2a-87cbb93893af req-39e63dd5-cce8-484b-bdd4-e81e75f9585d service nova] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Received event network-vif-deleted-9a214a31-3ef2-4a37-b0fa-c27a86be068c {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:59:39 user nova-compute[72766]: INFO nova.compute.manager [req-be54b656-51e4-41b3-9a2a-87cbb93893af req-39e63dd5-cce8-484b-bdd4-e81e75f9585d service nova] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Neutron deleted interface 9a214a31-3ef2-4a37-b0fa-c27a86be068c; detaching it from the instance and deleting it from the info cache
Aug 14 22:59:39 user nova-compute[72766]: DEBUG nova.network.neutron [req-be54b656-51e4-41b3-9a2a-87cbb93893af req-39e63dd5-cce8-484b-bdd4-e81e75f9585d service nova] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:59:39 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Took 1.59 seconds to deallocate network for instance.
Aug 14 22:59:39 user nova-compute[72766]: DEBUG nova.compute.manager [req-be54b656-51e4-41b3-9a2a-87cbb93893af req-39e63dd5-cce8-484b-bdd4-e81e75f9585d service nova] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Detach interface failed, port_id=9a214a31-3ef2-4a37-b0fa-c27a86be068c, reason: Instance 33e6f8aa-bb0d-478d-b7b5-3334302476fb could not be found. {{(pid=72766) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 22:59:39 user nova-compute[72766]: DEBUG nova.network.neutron [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Successfully updated port: 5d0ea097-96cd-4d3b-8815-346a488703d2 {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 22:59:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ef882af6-e0fe-474f-ab0b-f56a66c4df5e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ef882af6-e0fe-474f-ab0b-f56a66c4df5e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:40 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-ef882af6-e0fe-474f-ab0b-f56a66c4df5e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:59:40 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-ef882af6-e0fe-474f-ab0b-f56a66c4df5e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:59:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ef882af6-e0fe-474f-ab0b-f56a66c4df5e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.444s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:40 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-ef882af6-e0fe-474f-ab0b-f56a66c4df5e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Deleted allocations for instance 33e6f8aa-bb0d-478d-b7b5-3334302476fb
Aug 14 22:59:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ef882af6-e0fe-474f-ab0b-f56a66c4df5e tempest-TestVolumeSwap-826809882 tempest-TestVolumeSwap-826809882-project-member] Lock "33e6f8aa-bb0d-478d-b7b5-3334302476fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.420s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:41 user nova-compute[72766]: DEBUG nova.compute.manager [req-f9372c31-86db-471f-8447-94249e04a53f req-690a449c-f774-44df-b2ca-5355da03a68c service nova] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Received event network-vif-plugged-9a214a31-3ef2-4a37-b0fa-c27a86be068c {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:59:41 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f9372c31-86db-471f-8447-94249e04a53f req-690a449c-f774-44df-b2ca-5355da03a68c service nova] Acquiring lock "33e6f8aa-bb0d-478d-b7b5-3334302476fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:41 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f9372c31-86db-471f-8447-94249e04a53f req-690a449c-f774-44df-b2ca-5355da03a68c service nova] Lock "33e6f8aa-bb0d-478d-b7b5-3334302476fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:41 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f9372c31-86db-471f-8447-94249e04a53f req-690a449c-f774-44df-b2ca-5355da03a68c service nova] Lock "33e6f8aa-bb0d-478d-b7b5-3334302476fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:41 user nova-compute[72766]: DEBUG nova.compute.manager [req-f9372c31-86db-471f-8447-94249e04a53f req-690a449c-f774-44df-b2ca-5355da03a68c service nova] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] No waiting events found dispatching network-vif-plugged-9a214a31-3ef2-4a37-b0fa-c27a86be068c {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:59:41 user nova-compute[72766]: WARNING nova.compute.manager [req-f9372c31-86db-471f-8447-94249e04a53f req-690a449c-f774-44df-b2ca-5355da03a68c service nova] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Received unexpected event network-vif-plugged-9a214a31-3ef2-4a37-b0fa-c27a86be068c for instance with vm_state deleted and task_state None.
Aug 14 22:59:41 user nova-compute[72766]: DEBUG nova.compute.manager [req-f9372c31-86db-471f-8447-94249e04a53f req-690a449c-f774-44df-b2ca-5355da03a68c service nova] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Received event network-vif-plugged-9a214a31-3ef2-4a37-b0fa-c27a86be068c {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:59:41 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f9372c31-86db-471f-8447-94249e04a53f req-690a449c-f774-44df-b2ca-5355da03a68c service nova] Acquiring lock "33e6f8aa-bb0d-478d-b7b5-3334302476fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:41 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f9372c31-86db-471f-8447-94249e04a53f req-690a449c-f774-44df-b2ca-5355da03a68c service nova] Lock "33e6f8aa-bb0d-478d-b7b5-3334302476fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:41 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f9372c31-86db-471f-8447-94249e04a53f req-690a449c-f774-44df-b2ca-5355da03a68c service nova] Lock "33e6f8aa-bb0d-478d-b7b5-3334302476fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:41 user nova-compute[72766]: DEBUG nova.compute.manager [req-f9372c31-86db-471f-8447-94249e04a53f req-690a449c-f774-44df-b2ca-5355da03a68c service nova] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] No waiting events found dispatching network-vif-plugged-9a214a31-3ef2-4a37-b0fa-c27a86be068c {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:59:41 user nova-compute[72766]: WARNING nova.compute.manager [req-f9372c31-86db-471f-8447-94249e04a53f req-690a449c-f774-44df-b2ca-5355da03a68c service nova] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Received unexpected event network-vif-plugged-9a214a31-3ef2-4a37-b0fa-c27a86be068c for instance with vm_state deleted and task_state None.
Aug 14 22:59:41 user nova-compute[72766]: DEBUG nova.compute.manager [req-f9372c31-86db-471f-8447-94249e04a53f req-690a449c-f774-44df-b2ca-5355da03a68c service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-changed-5d0ea097-96cd-4d3b-8815-346a488703d2 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:59:41 user nova-compute[72766]: DEBUG nova.compute.manager [req-f9372c31-86db-471f-8447-94249e04a53f req-690a449c-f774-44df-b2ca-5355da03a68c service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Refreshing instance network info cache due to event network-changed-5d0ea097-96cd-4d3b-8815-346a488703d2. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:59:41 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f9372c31-86db-471f-8447-94249e04a53f req-690a449c-f774-44df-b2ca-5355da03a68c service nova] Acquiring lock "refresh_cache-e503ad35-1d9e-47d8-9a25-58e2a503ff02" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:59:41 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f9372c31-86db-471f-8447-94249e04a53f req-690a449c-f774-44df-b2ca-5355da03a68c service nova] Acquired lock "refresh_cache-e503ad35-1d9e-47d8-9a25-58e2a503ff02" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:59:41 user nova-compute[72766]: DEBUG nova.network.neutron [req-f9372c31-86db-471f-8447-94249e04a53f req-690a449c-f774-44df-b2ca-5355da03a68c service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Refreshing network info cache for port 5d0ea097-96cd-4d3b-8815-346a488703d2 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:59:41 user nova-compute[72766]: DEBUG nova.network.neutron [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Successfully updated port: 0d0642a2-a76e-4de1-956c-fb58280caec3 {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 22:59:41 user nova-compute[72766]: DEBUG nova.network.neutron [req-f9372c31-86db-471f-8447-94249e04a53f req-690a449c-f774-44df-b2ca-5355da03a68c service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 22:59:41 user nova-compute[72766]: DEBUG nova.network.neutron [req-f9372c31-86db-471f-8447-94249e04a53f req-690a449c-f774-44df-b2ca-5355da03a68c service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:59:41 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f9372c31-86db-471f-8447-94249e04a53f req-690a449c-f774-44df-b2ca-5355da03a68c service nova] Releasing lock "refresh_cache-e503ad35-1d9e-47d8-9a25-58e2a503ff02" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:59:42 user nova-compute[72766]: DEBUG nova.network.neutron [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Successfully updated port: a9ba4ad3-e5eb-436a-8514-567d511f1999 {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 22:59:42 user nova-compute[72766]: DEBUG nova.compute.manager [req-8d853cae-4681-44d6-b373-049a27113abe req-08fc3c2f-707c-49cb-aff9-bde27e055902 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-changed-a9ba4ad3-e5eb-436a-8514-567d511f1999 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:59:42 user nova-compute[72766]: DEBUG nova.compute.manager [req-8d853cae-4681-44d6-b373-049a27113abe req-08fc3c2f-707c-49cb-aff9-bde27e055902 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Refreshing instance network info cache due to event network-changed-a9ba4ad3-e5eb-436a-8514-567d511f1999. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:59:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8d853cae-4681-44d6-b373-049a27113abe req-08fc3c2f-707c-49cb-aff9-bde27e055902 service nova] Acquiring lock "refresh_cache-e503ad35-1d9e-47d8-9a25-58e2a503ff02" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:59:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8d853cae-4681-44d6-b373-049a27113abe req-08fc3c2f-707c-49cb-aff9-bde27e055902 service nova] Acquired lock "refresh_cache-e503ad35-1d9e-47d8-9a25-58e2a503ff02" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:59:42 user nova-compute[72766]: DEBUG nova.network.neutron [req-8d853cae-4681-44d6-b373-049a27113abe req-08fc3c2f-707c-49cb-aff9-bde27e055902 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Refreshing network info cache for port a9ba4ad3-e5eb-436a-8514-567d511f1999 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:59:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Acquiring lock "78f02883-99a1-493d-b6be-e43500bfba37" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "78f02883-99a1-493d-b6be-e43500bfba37" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:42 user nova-compute[72766]: DEBUG nova.compute.manager [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 22:59:42 user nova-compute[72766]: DEBUG nova.network.neutron [req-8d853cae-4681-44d6-b373-049a27113abe req-08fc3c2f-707c-49cb-aff9-bde27e055902 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 22:59:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:42 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 22:59:42 user nova-compute[72766]: INFO nova.compute.claims [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Claim successful on node user
Aug 14 22:59:42 user nova-compute[72766]: INFO nova.virt.block_device [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Booting with volume bdc00e2e-604f-428f-bfb4-7451d23a1c9d at /dev/vdb
Aug 14 22:59:42 user nova-compute[72766]: DEBUG os_brick.utils [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:59:42 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:42 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:42 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43f2959-2539-4382-9c46-1a1ee0e68bd7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:42 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:42 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:42 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f650999-be29-413e-8db8-34d6c881f529]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:42 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:42 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:42 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd141f4-bfe2-4f4b-ba8d-71c13cf4a4e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:42 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fac3937-43ac-4472-ad94-89c617b43f9e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:42 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:42 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:59:42 user nova-compute[72766]: DEBUG nova.network.neutron [req-8d853cae-4681-44d6-b373-049a27113abe req-08fc3c2f-707c-49cb-aff9-bde27e055902 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:59:42 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 22:59:42 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8d853cae-4681-44d6-b373-049a27113abe req-08fc3c2f-707c-49cb-aff9-bde27e055902 service nova] Releasing lock "refresh_cache-e503ad35-1d9e-47d8-9a25-58e2a503ff02" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:59:42 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:59:42 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 22:59:42 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c5e114-6e83-4b38-a999-1d7f8a5f0663]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:42 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 22:59:42 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 22:59:42 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 22:59:42 user nova-compute[72766]: DEBUG os_brick.utils [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:59:42 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Updating existing volume attachment record: ebac15f0-73b9-48af-b31a-75794f3d509e {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 22:59:43 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 22:59:43 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 22:59:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.501s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:43 user nova-compute[72766]: DEBUG nova.compute.manager [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 22:59:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:43 user nova-compute[72766]: DEBUG nova.compute.manager [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 22:59:43 user nova-compute[72766]: DEBUG nova.network.neutron [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 22:59:43 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 22:59:43 user nova-compute[72766]: DEBUG nova.compute.manager [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 22:59:43 user nova-compute[72766]: DEBUG nova.compute.manager [req-b3f989fd-6698-49e8-aa59-0761355021f8 req-7007e1ba-76d0-4df2-9edd-aec3677f1c8a service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-changed-0d0642a2-a76e-4de1-956c-fb58280caec3 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:59:43 user nova-compute[72766]: DEBUG nova.compute.manager [req-b3f989fd-6698-49e8-aa59-0761355021f8 req-7007e1ba-76d0-4df2-9edd-aec3677f1c8a service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Refreshing instance network info cache due to event network-changed-0d0642a2-a76e-4de1-956c-fb58280caec3. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:59:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-b3f989fd-6698-49e8-aa59-0761355021f8 req-7007e1ba-76d0-4df2-9edd-aec3677f1c8a service nova] Acquiring lock "refresh_cache-e503ad35-1d9e-47d8-9a25-58e2a503ff02" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:59:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-b3f989fd-6698-49e8-aa59-0761355021f8 req-7007e1ba-76d0-4df2-9edd-aec3677f1c8a service nova] Acquired lock "refresh_cache-e503ad35-1d9e-47d8-9a25-58e2a503ff02" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:59:43 user nova-compute[72766]: DEBUG nova.network.neutron [req-b3f989fd-6698-49e8-aa59-0761355021f8 req-7007e1ba-76d0-4df2-9edd-aec3677f1c8a service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Refreshing network info cache for port 0d0642a2-a76e-4de1-956c-fb58280caec3 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:59:43 user nova-compute[72766]: DEBUG nova.policy [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b7bcae26ae5d406196128c0ce83d3413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ff897ef00ec45258b22d76ca60447fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 22:59:43 user nova-compute[72766]: DEBUG nova.compute.manager [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 22:59:43 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 22:59:43 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Creating image(s)
Aug 14 22:59:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Acquiring lock "/opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "/opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "/opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:43 user nova-compute[72766]: DEBUG nova.network.neutron [req-b3f989fd-6698-49e8-aa59-0761355021f8 req-7007e1ba-76d0-4df2-9edd-aec3677f1c8a service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 22:59:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.194s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Acquiring lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:43 user nova-compute[72766]: DEBUG nova.network.neutron [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Successfully updated port: 2774a932-7806-4c06-a128-e067a3072ebc {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 22:59:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.185s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk 1073741824 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:43 user nova-compute[72766]: DEBUG nova.network.neutron [req-b3f989fd-6698-49e8-aa59-0761355021f8 req-7007e1ba-76d0-4df2-9edd-aec3677f1c8a service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:59:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk 1073741824" returned: 0 in 0.050s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-b3f989fd-6698-49e8-aa59-0761355021f8 req-7007e1ba-76d0-4df2-9edd-aec3677f1c8a service nova] Releasing lock "refresh_cache-e503ad35-1d9e-47d8-9a25-58e2a503ff02" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:59:44 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.233s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:44 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Checking if we can resize image /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk. size=1073741824 {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 22:59:44 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:44 user nova-compute[72766]: DEBUG nova.network.neutron [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Successfully created port: 8e7e311b-453d-4e17-9652-45723c7a2944 {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 22:59:44 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:44 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Cannot resize image /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk to a smaller size. {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 22:59:44 user nova-compute[72766]: DEBUG nova.objects.instance [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lazy-loading 'migration_context' on Instance uuid 78f02883-99a1-493d-b6be-e43500bfba37 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:59:44 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 22:59:44 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Ensure instance console log exists: /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 22:59:44 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:44 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:44 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:44 user nova-compute[72766]: DEBUG nova.compute.manager [req-ccacf015-00d1-4eba-abe8-146f274eb91d req-7cd25593-debc-4832-b623-fd2bd1373125 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-changed-2774a932-7806-4c06-a128-e067a3072ebc {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:59:44 user nova-compute[72766]: DEBUG nova.compute.manager [req-ccacf015-00d1-4eba-abe8-146f274eb91d req-7cd25593-debc-4832-b623-fd2bd1373125 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Refreshing instance network info cache due to event network-changed-2774a932-7806-4c06-a128-e067a3072ebc. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:59:44 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ccacf015-00d1-4eba-abe8-146f274eb91d req-7cd25593-debc-4832-b623-fd2bd1373125 service nova] Acquiring lock "refresh_cache-e503ad35-1d9e-47d8-9a25-58e2a503ff02" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:59:44 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ccacf015-00d1-4eba-abe8-146f274eb91d req-7cd25593-debc-4832-b623-fd2bd1373125 service nova] Acquired lock "refresh_cache-e503ad35-1d9e-47d8-9a25-58e2a503ff02" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:59:44 user nova-compute[72766]: DEBUG nova.network.neutron [req-ccacf015-00d1-4eba-abe8-146f274eb91d req-7cd25593-debc-4832-b623-fd2bd1373125 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Refreshing network info cache for port 2774a932-7806-4c06-a128-e067a3072ebc {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:59:44 user nova-compute[72766]: DEBUG nova.network.neutron [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Successfully updated port: 0c7d05ab-1414-4892-a28e-18b3816a1040 {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 22:59:44 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Acquiring lock "refresh_cache-e503ad35-1d9e-47d8-9a25-58e2a503ff02" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:59:44 user nova-compute[72766]: DEBUG nova.network.neutron [req-ccacf015-00d1-4eba-abe8-146f274eb91d req-7cd25593-debc-4832-b623-fd2bd1373125 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 22:59:44 user nova-compute[72766]: DEBUG nova.network.neutron [req-ccacf015-00d1-4eba-abe8-146f274eb91d req-7cd25593-debc-4832-b623-fd2bd1373125 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:59:44 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ccacf015-00d1-4eba-abe8-146f274eb91d req-7cd25593-debc-4832-b623-fd2bd1373125 service nova] Releasing lock "refresh_cache-e503ad35-1d9e-47d8-9a25-58e2a503ff02" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:59:44 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Acquired lock "refresh_cache-e503ad35-1d9e-47d8-9a25-58e2a503ff02" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:59:44 user nova-compute[72766]: DEBUG nova.network.neutron [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:59:44 user nova-compute[72766]: DEBUG nova.network.neutron [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG nova.network.neutron [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Successfully updated port: 8e7e311b-453d-4e17-9652-45723c7a2944 {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Acquiring lock "refresh_cache-78f02883-99a1-493d-b6be-e43500bfba37" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Acquired lock "refresh_cache-78f02883-99a1-493d-b6be-e43500bfba37" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG nova.network.neutron [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ba74ac9b-4108-479d-824f-e2761971931d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Acquiring lock "c3c0a004-8d70-4253-bf17-b83088e30031" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ba74ac9b-4108-479d-824f-e2761971931d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "c3c0a004-8d70-4253-bf17-b83088e30031" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG nova.network.neutron [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 22:59:45 user nova-compute[72766]: INFO nova.compute.manager [None req-ba74ac9b-4108-479d-824f-e2761971931d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Detaching volume 767365c4-d886-43b3-b85c-ddc641e27391
Aug 14 22:59:45 user nova-compute[72766]: INFO nova.virt.block_device [None req-ba74ac9b-4108-479d-824f-e2761971931d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Attempting to driver detach volume 767365c4-d886-43b3-b85c-ddc641e27391 from mountpoint /dev/vdb
Aug 14 22:59:45 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ba74ac9b-4108-479d-824f-e2761971931d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Attempting to detach device vdb from instance c3c0a004-8d70-4253-bf17-b83088e30031 from the persistent domain config. {{(pid=72766) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-ba74ac9b-4108-479d-824f-e2761971931d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 22:59:45 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:59:45 user nova-compute[72766]:   <source dev="/dev/sdd"/>
Aug 14 22:59:45 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:59:45 user nova-compute[72766]:   <serial>767365c4-d886-43b3-b85c-ddc641e27391</serial>
Aug 14 22:59:45 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 22:59:45 user nova-compute[72766]: </disk>
Aug 14 22:59:45 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 22:59:45 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-ba74ac9b-4108-479d-824f-e2761971931d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Successfully detached device vdb from instance c3c0a004-8d70-4253-bf17-b83088e30031 from the persistent domain config.
Aug 14 22:59:45 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ba74ac9b-4108-479d-824f-e2761971931d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c3c0a004-8d70-4253-bf17-b83088e30031 from the live domain config. {{(pid=72766) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-ba74ac9b-4108-479d-824f-e2761971931d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 22:59:45 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 22:59:45 user nova-compute[72766]:   <source dev="/dev/sdd"/>
Aug 14 22:59:45 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 22:59:45 user nova-compute[72766]:   <serial>767365c4-d886-43b3-b85c-ddc641e27391</serial>
Aug 14 22:59:45 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 22:59:45 user nova-compute[72766]: </disk>
Aug 14 22:59:45 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG nova.compute.manager [req-babd6191-d0a8-4e0b-a25d-a6e555c21790 req-38950798-e926-4fe5-a34f-5ce482fb69dd service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Received event network-changed-8e7e311b-453d-4e17-9652-45723c7a2944 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG nova.compute.manager [req-babd6191-d0a8-4e0b-a25d-a6e555c21790 req-38950798-e926-4fe5-a34f-5ce482fb69dd service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Refreshing instance network info cache due to event network-changed-8e7e311b-453d-4e17-9652-45723c7a2944. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-babd6191-d0a8-4e0b-a25d-a6e555c21790 req-38950798-e926-4fe5-a34f-5ce482fb69dd service nova] Acquiring lock "refresh_cache-78f02883-99a1-493d-b6be-e43500bfba37" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG nova.network.neutron [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Updating instance_info_cache with network_info: [{"id": "8e7e311b-453d-4e17-9652-45723c7a2944", "address": "fa:16:3e:7e:31:c1", "network": {"id": "c07935db-7a05-49df-a504-682549f30d55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-765423768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ff897ef00ec45258b22d76ca60447fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e7e311b-45", "ovs_interfaceid": "8e7e311b-453d-4e17-9652-45723c7a2944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Releasing lock "refresh_cache-78f02883-99a1-493d-b6be-e43500bfba37" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG nova.compute.manager [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Instance network_info: |[{"id": "8e7e311b-453d-4e17-9652-45723c7a2944", "address": "fa:16:3e:7e:31:c1", "network": {"id": "c07935db-7a05-49df-a504-682549f30d55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-765423768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ff897ef00ec45258b22d76ca60447fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e7e311b-45", "ovs_interfaceid": "8e7e311b-453d-4e17-9652-45723c7a2944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-babd6191-d0a8-4e0b-a25d-a6e555c21790 req-38950798-e926-4fe5-a34f-5ce482fb69dd service nova] Acquired lock "refresh_cache-78f02883-99a1-493d-b6be-e43500bfba37" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG nova.network.neutron [req-babd6191-d0a8-4e0b-a25d-a6e555c21790 req-38950798-e926-4fe5-a34f-5ce482fb69dd service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Refreshing network info cache for port 8e7e311b-453d-4e17-9652-45723c7a2944 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Start _get_guest_xml network_info=[{"id": "8e7e311b-453d-4e17-9652-45723c7a2944", "address": "fa:16:3e:7e:31:c1", "network": {"id": "c07935db-7a05-49df-a504-682549f30d55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-765423768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ff897ef00ec45258b22d76ca60447fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e7e311b-45", "ovs_interfaceid": "8e7e311b-453d-4e17-9652-45723c7a2944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd2900d30-2c4c-4d57-9135-d45564c0c596'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 22:59:45 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:59:45 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 22:59:45 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:59:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1272916435',display_name='tempest-ServerActionsTestOtherB-server-1272916435',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1272916435',id=16,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsHL/Ov683ewfS5a6Ilb918RzZcGPjg2jcHmAa4FSbUUXkwfiZz6KofKWkKrLkhgLEqXzZXHVc5OIPNVj5SeE4gBrIjsJUy7rj9111gEojmIZrrW+x2JI01+TKIPNtdRQ==',key_name='tempest-keypair-2053681781',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ff897ef00ec45258b22d76ca60447fe',ramdisk_id='',reservation_id='r-vhmch78j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-930559363',owner_user_name='tempest-ServerActionsTestOtherB-930559363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:59:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7bcae26ae5d406196128c0ce83d3413',uuid=78f02883-99a1-493d-b6be-e43500bfba37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e7e311b-453d-4e17-9652-45723c7a2944", "address": "fa:16:3e:7e:31:c1", "network": {"id": "c07935db-7a05-49df-a504-682549f30d55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-765423768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ff897ef00ec45258b22d76ca60447fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e7e311b-45", "ovs_interfaceid": "8e7e311b-453d-4e17-9652-45723c7a2944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Converting VIF {"id": "8e7e311b-453d-4e17-9652-45723c7a2944", "address": "fa:16:3e:7e:31:c1", "network": {"id": "c07935db-7a05-49df-a504-682549f30d55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-765423768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ff897ef00ec45258b22d76ca60447fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e7e311b-45", "ovs_interfaceid": "8e7e311b-453d-4e17-9652-45723c7a2944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:31:c1,bridge_name='br-int',has_traffic_filtering=True,id=8e7e311b-453d-4e17-9652-45723c7a2944,network=Network(c07935db-7a05-49df-a504-682549f30d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e7e311b-45') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG nova.objects.instance [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lazy-loading 'pci_devices' on Instance uuid 78f02883-99a1-493d-b6be-e43500bfba37 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] End _get_guest_xml xml=<domain type="kvm">
Aug 14 22:59:45 user nova-compute[72766]:   <uuid>78f02883-99a1-493d-b6be-e43500bfba37</uuid>
Aug 14 22:59:45 user nova-compute[72766]:   <name>instance-00000010</name>
Aug 14 22:59:45 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 22:59:45 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 22:59:45 user nova-compute[72766]:   <metadata>
Aug 14 22:59:45 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 22:59:45 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 22:59:45 user nova-compute[72766]:       <nova:name>tempest-ServerActionsTestOtherB-server-1272916435</nova:name>
Aug 14 22:59:45 user nova-compute[72766]:       <nova:creationTime>2023-08-14 22:59:45</nova:creationTime>
Aug 14 22:59:45 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 22:59:45 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 22:59:45 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 22:59:45 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 22:59:45 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 22:59:45 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 22:59:45 user nova-compute[72766]:       </nova:flavor>
Aug 14 22:59:45 user nova-compute[72766]:       <nova:owner>
Aug 14 22:59:45 user nova-compute[72766]:         <nova:user uuid="b7bcae26ae5d406196128c0ce83d3413">tempest-ServerActionsTestOtherB-930559363-project-member</nova:user>
Aug 14 22:59:45 user nova-compute[72766]:         <nova:project uuid="9ff897ef00ec45258b22d76ca60447fe">tempest-ServerActionsTestOtherB-930559363</nova:project>
Aug 14 22:59:45 user nova-compute[72766]:       </nova:owner>
Aug 14 22:59:45 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 22:59:45 user nova-compute[72766]:       <nova:ports>
Aug 14 22:59:45 user nova-compute[72766]:         <nova:port uuid="8e7e311b-453d-4e17-9652-45723c7a2944">
Aug 14 22:59:45 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 22:59:45 user nova-compute[72766]:         </nova:port>
Aug 14 22:59:45 user nova-compute[72766]:       </nova:ports>
Aug 14 22:59:45 user nova-compute[72766]:     </nova:instance>
Aug 14 22:59:45 user nova-compute[72766]:   </metadata>
Aug 14 22:59:45 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 22:59:45 user nova-compute[72766]:     <system>
Aug 14 22:59:45 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 22:59:45 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 22:59:45 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 22:59:45 user nova-compute[72766]:       <entry name="serial">78f02883-99a1-493d-b6be-e43500bfba37</entry>
Aug 14 22:59:45 user nova-compute[72766]:       <entry name="uuid">78f02883-99a1-493d-b6be-e43500bfba37</entry>
Aug 14 22:59:45 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 22:59:45 user nova-compute[72766]:     </system>
Aug 14 22:59:45 user nova-compute[72766]:   </sysinfo>
Aug 14 22:59:45 user nova-compute[72766]:   <os>
Aug 14 22:59:45 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 22:59:45 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 22:59:45 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 22:59:45 user nova-compute[72766]:   </os>
Aug 14 22:59:45 user nova-compute[72766]:   <features>
Aug 14 22:59:45 user nova-compute[72766]:     <acpi/>
Aug 14 22:59:45 user nova-compute[72766]:     <apic/>
Aug 14 22:59:45 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 22:59:45 user nova-compute[72766]:   </features>
Aug 14 22:59:45 user nova-compute[72766]:   <clock offset="utc">
Aug 14 22:59:45 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 22:59:45 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 22:59:45 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 22:59:45 user nova-compute[72766]:   </clock>
Aug 14 22:59:45 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 22:59:45 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 22:59:45 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 22:59:45 user nova-compute[72766]:   </cpu>
Aug 14 22:59:45 user nova-compute[72766]:   <devices>
Aug 14 22:59:45 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 22:59:45 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 22:59:45 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk"/>
Aug 14 22:59:45 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 22:59:45 user nova-compute[72766]:     </disk>
Aug 14 22:59:45 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 22:59:45 user nova-compute[72766]:       <mac address="fa:16:3e:7e:31:c1"/>
Aug 14 22:59:45 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 22:59:45 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 22:59:45 user nova-compute[72766]:       <target dev="tap8e7e311b-45"/>
Aug 14 22:59:45 user nova-compute[72766]:     </interface>
Aug 14 22:59:45 user nova-compute[72766]:     <serial type="pty">
Aug 14 22:59:45 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/console.log" append="off"/>
Aug 14 22:59:45 user nova-compute[72766]:     </serial>
Aug 14 22:59:45 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 22:59:45 user nova-compute[72766]:     <video>
Aug 14 22:59:45 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 22:59:45 user nova-compute[72766]:     </video>
Aug 14 22:59:45 user nova-compute[72766]:     <rng model="virtio">
Aug 14 22:59:45 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 22:59:45 user nova-compute[72766]:     </rng>
Aug 14 22:59:45 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 22:59:45 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 22:59:45 user nova-compute[72766]:       <stats period="10"/>
Aug 14 22:59:45 user nova-compute[72766]:     </memballoon>
Aug 14 22:59:45 user nova-compute[72766]:   </devices>
Aug 14 22:59:45 user nova-compute[72766]: </domain>
Aug 14 22:59:45 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:59:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1272916435',display_name='tempest-ServerActionsTestOtherB-server-1272916435',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1272916435',id=16,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsHL/Ov683ewfS5a6Ilb918RzZcGPjg2jcHmAa4FSbUUXkwfiZz6KofKWkKrLkhgLEqXzZXHVc5OIPNVj5SeE4gBrIjsJUy7rj9111gEojmIZrrW+x2JI01+TKIPNtdRQ==',key_name='tempest-keypair-2053681781',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ff897ef00ec45258b22d76ca60447fe',ramdisk_id='',reservation_id='r-vhmch78j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-930559363',owner_user_name='tempest-ServerActionsTestOtherB-930559363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:59:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7bcae26ae5d406196128c0ce83d3413',uuid=78f02883-99a1-493d-b6be-e43500bfba37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e7e311b-453d-4e17-9652-45723c7a2944", "address": "fa:16:3e:7e:31:c1", "network": {"id": "c07935db-7a05-49df-a504-682549f30d55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-765423768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ff897ef00ec45258b22d76ca60447fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e7e311b-45", "ovs_interfaceid": "8e7e311b-453d-4e17-9652-45723c7a2944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Converting VIF {"id": "8e7e311b-453d-4e17-9652-45723c7a2944", "address": "fa:16:3e:7e:31:c1", "network": {"id": "c07935db-7a05-49df-a504-682549f30d55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-765423768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ff897ef00ec45258b22d76ca60447fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e7e311b-45", "ovs_interfaceid": "8e7e311b-453d-4e17-9652-45723c7a2944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:31:c1,bridge_name='br-int',has_traffic_filtering=True,id=8e7e311b-453d-4e17-9652-45723c7a2944,network=Network(c07935db-7a05-49df-a504-682549f30d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e7e311b-45') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG os_vif [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:31:c1,bridge_name='br-int',has_traffic_filtering=True,id=8e7e311b-453d-4e17-9652-45723c7a2944,network=Network(c07935db-7a05-49df-a504-682549f30d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e7e311b-45') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e7e311b-45, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8e7e311b-45, col_values=(('external_ids', {'iface-id': '8e7e311b-453d-4e17-9652-45723c7a2944', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:31:c1', 'vm-uuid': '78f02883-99a1-493d-b6be-e43500bfba37'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:45 user nova-compute[72766]: INFO os_vif [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:31:c1,bridge_name='br-int',has_traffic_filtering=True,id=8e7e311b-453d-4e17-9652-45723c7a2944,network=Network(c07935db-7a05-49df-a504-682549f30d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e7e311b-45')
Aug 14 22:59:45 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] No VIF found with MAC fa:16:3e:7e:31:c1, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Received event <DeviceRemovedEvent: 1692053985.6587439, c3c0a004-8d70-4253-bf17-b83088e30031 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72766) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ba74ac9b-4108-479d-824f-e2761971931d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c3c0a004-8d70-4253-bf17-b83088e30031 {{(pid=72766) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 22:59:45 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-ba74ac9b-4108-479d-824f-e2761971931d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Successfully detached device vdb from instance c3c0a004-8d70-4253-bf17-b83088e30031 from the live domain config.
Aug 14 22:59:45 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba74ac9b-4108-479d-824f-e2761971931d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba74ac9b-4108-479d-824f-e2761971931d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qIuwcSsg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:59:45 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-ba74ac9b-4108-479d-824f-e2761971931d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 22:59:45 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-ba74ac9b-4108-479d-824f-e2761971931d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-ba74ac9b-4108-479d-824f-e2761971931d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba74ac9b-4108-479d-824f-e2761971931d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ff6ed2-48aa-4fa6-9624-fe90604a7773]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c24b05d-c160-4a00-9ea4-98cb1f0c1c08]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba74ac9b-4108-479d-824f-e2761971931d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 22:59:45 user nova-compute[72766]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 22:59:45 user nova-compute[72766]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391 (non-flash)
Aug 14 22:59:45 user nova-compute[72766]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)
Aug 14 22:59:45 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba74ac9b-4108-479d-824f-e2761971931d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 22:59:45 user nova-compute[72766]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 22:59:45 user nova-compute[72766]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391 (non-flash)
Aug 14 22:59:45 user nova-compute[72766]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)
Aug 14 22:59:45 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba74ac9b-4108-479d-824f-e2761971931d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff1545ecb80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391'): ({'sdd'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-ba74ac9b-4108-479d-824f-e2761971931d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Removing single pathed devices sdd {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ccaad5-29cf-4860-9be5-23a8596ed68c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf86c3d-f6b7-4d47-98c3-ad507b682c1e]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-ba74ac9b-4108-479d-824f-e2761971931d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Flushing IO for device /dev/sdd {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b55bc3-e847-454c-9e0c-88f14509b96b]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-ba74ac9b-4108-479d-824f-e2761971931d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cd30ea-d802-492a-b6a6-6863868a54a4]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-ba74ac9b-4108-479d-824f-e2761971931d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-ba74ac9b-4108-479d-824f-e2761971931d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] SCSI volumes sdd have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba74ac9b-4108-479d-824f-e2761971931d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG nova.network.neutron [req-babd6191-d0a8-4e0b-a25d-a6e555c21790 req-38950798-e926-4fe5-a34f-5ce482fb69dd service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Updated VIF entry in instance network info cache for port 8e7e311b-453d-4e17-9652-45723c7a2944. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG nova.network.neutron [req-babd6191-d0a8-4e0b-a25d-a6e555c21790 req-38950798-e926-4fe5-a34f-5ce482fb69dd service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Updating instance_info_cache with network_info: [{"id": "8e7e311b-453d-4e17-9652-45723c7a2944", "address": "fa:16:3e:7e:31:c1", "network": {"id": "c07935db-7a05-49df-a504-682549f30d55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-765423768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ff897ef00ec45258b22d76ca60447fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e7e311b-45", "ovs_interfaceid": "8e7e311b-453d-4e17-9652-45723c7a2944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5a29a7-4e2b-414a-9de2-44258591371b]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba74ac9b-4108-479d-824f-e2761971931d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-babd6191-d0a8-4e0b-a25d-a6e555c21790 req-38950798-e926-4fe5-a34f-5ce482fb69dd service nova] Releasing lock "refresh_cache-78f02883-99a1-493d-b6be-e43500bfba37" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391 -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2805b11e-b8f2-411b-8939-9474c56b7be3]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba74ac9b-4108-479d-824f-e2761971931d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391, portal: 172.16.0.220,3260]
Aug 14 22:59:45 user nova-compute[72766]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391, portal: 172.16.0.220,3260] successful.
Aug 14 22:59:45 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:59:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391 -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:767365c4-d886-43b3-b85c-ddc641e27391 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:46 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e621e40-343d-4453-9cb3-8ce3632b4c04]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:46 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba74ac9b-4108-479d-824f-e2761971931d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 22:59:46 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-ba74ac9b-4108-479d-824f-e2761971931d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 22:59:46 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba74ac9b-4108-479d-824f-e2761971931d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] <== disconnect_volume: return (357ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:59:46 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba74ac9b-4108-479d-824f-e2761971931d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 22:59:46 user nova-compute[72766]: DEBUG nova.compute.manager [req-be3f0eca-eeb7-47b7-9af2-18d4538fea75 req-d5b81bd9-6008-4711-b9ed-884de2174c74 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-changed-0c7d05ab-1414-4892-a28e-18b3816a1040 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:59:46 user nova-compute[72766]: DEBUG nova.compute.manager [req-be3f0eca-eeb7-47b7-9af2-18d4538fea75 req-d5b81bd9-6008-4711-b9ed-884de2174c74 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Refreshing instance network info cache due to event network-changed-0c7d05ab-1414-4892-a28e-18b3816a1040. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 22:59:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-be3f0eca-eeb7-47b7-9af2-18d4538fea75 req-d5b81bd9-6008-4711-b9ed-884de2174c74 service nova] Acquiring lock "refresh_cache-e503ad35-1d9e-47d8-9a25-58e2a503ff02" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 22:59:46 user nova-compute[72766]: DEBUG nova.objects.instance [None req-ba74ac9b-4108-479d-824f-e2761971931d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lazy-loading 'flavor' on Instance uuid c3c0a004-8d70-4253-bf17-b83088e30031 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 22:59:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ba74ac9b-4108-479d-824f-e2761971931d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "c3c0a004-8d70-4253-bf17-b83088e30031" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.856s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:47 user nova-compute[72766]: DEBUG nova.network.neutron [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Updating instance_info_cache with network_info: [{"id": "098834fb-ad7d-4032-9f2c-28b8a206d4c4", "address": "fa:16:3e:5e:72:4a", "network": {"id": "6991af8d-255f-45a5-8be0-f6d851affa68", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1760061206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap098834fb-ad", "ovs_interfaceid": "098834fb-ad7d-4032-9f2c-28b8a206d4c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ad9f734-e280-4596-a00e-672de5d6ecb6", "address": "fa:16:3e:8c:7f:fe", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ad9f734-e2", "ovs_interfaceid": "4ad9f734-e280-4596-a00e-672de5d6ecb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5d0ea097-96cd-4d3b-8815-346a488703d2", "address": "fa:16:3e:46:88:4e", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0ea097-96", "ovs_interfaceid": "5d0ea097-96cd-4d3b-8815-346a488703d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0d0642a2-a76e-4de1-956c-fb58280caec3", "address": "fa:16:3e:d9:c2:f7", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d0642a2-a7", "ovs_interfaceid": "0d0642a2-a76e-4de1-956c-fb58280caec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a9ba4ad3-e5eb-436a-8514-567d511f1999", "address": "fa:16:3e:30:f6:50", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9ba4ad3-e5", "ovs_interfaceid": "a9ba4ad3-e5eb-436a-8514-567d511f1999", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2774a932-7806-4c06-a128-e067a3072ebc", "address": "fa:16:3e:35:ec:2f", "network": {"id": "1f7634cf-e63f-4d83-8a75-65d21e863a21", "bridge": "br-int", "label": "tempest-device-tagging-net2-388612262", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2774a932-78", "ovs_interfaceid": "2774a932-7806-4c06-a128-e067a3072ebc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0c7d05ab-1414-4892-a28e-18b3816a1040", "address": "fa:16:3e:1f:5e:13", "network": {"id": "1f7634cf-e63f-4d83-8a75-65d21e863a21", "bridge": "br-int", "label": "tempest-device-tagging-net2-388612262", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c7d05ab-14", "ovs_interfaceid": "0c7d05ab-1414-4892-a28e-18b3816a1040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:59:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Releasing lock "refresh_cache-e503ad35-1d9e-47d8-9a25-58e2a503ff02" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:59:47 user nova-compute[72766]: DEBUG nova.compute.manager [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Instance network_info: |[{"id": "098834fb-ad7d-4032-9f2c-28b8a206d4c4", "address": "fa:16:3e:5e:72:4a", "network": {"id": "6991af8d-255f-45a5-8be0-f6d851affa68", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1760061206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap098834fb-ad", "ovs_interfaceid": "098834fb-ad7d-4032-9f2c-28b8a206d4c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ad9f734-e280-4596-a00e-672de5d6ecb6", "address": "fa:16:3e:8c:7f:fe", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ad9f734-e2", "ovs_interfaceid": "4ad9f734-e280-4596-a00e-672de5d6ecb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5d0ea097-96cd-4d3b-8815-346a488703d2", "address": "fa:16:3e:46:88:4e", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0ea097-96", "ovs_interfaceid": "5d0ea097-96cd-4d3b-8815-346a488703d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0d0642a2-a76e-4de1-956c-fb58280caec3", "address": "fa:16:3e:d9:c2:f7", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d0642a2-a7", "ovs_interfaceid": "0d0642a2-a76e-4de1-956c-fb58280caec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a9ba4ad3-e5eb-436a-8514-567d511f1999", "address": "fa:16:3e:30:f6:50", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9ba4ad3-e5", "ovs_interfaceid": "a9ba4ad3-e5eb-436a-8514-567d511f1999", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2774a932-7806-4c06-a128-e067a3072ebc", "address": "fa:16:3e:35:ec:2f", "network": {"id": "1f7634cf-e63f-4d83-8a75-65d21e863a21", "bridge": "br-int", "label": "tempest-device-tagging-net2-388612262", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2774a932-78", "ovs_interfaceid": "2774a932-7806-4c06-a128-e067a3072ebc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0c7d05ab-1414-4892-a28e-18b3816a1040", "address": "fa:16:3e:1f:5e:13", "network": {"id": "1f7634cf-e63f-4d83-8a75-65d21e863a21", "bridge": "br-int", "label": "tempest-device-tagging-net2-388612262", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c7d05ab-14", "ovs_interfaceid": "0c7d05ab-1414-4892-a28e-18b3816a1040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 22:59:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-be3f0eca-eeb7-47b7-9af2-18d4538fea75 req-d5b81bd9-6008-4711-b9ed-884de2174c74 service nova] Acquired lock "refresh_cache-e503ad35-1d9e-47d8-9a25-58e2a503ff02" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 22:59:47 user nova-compute[72766]: DEBUG nova.network.neutron [req-be3f0eca-eeb7-47b7-9af2-18d4538fea75 req-d5b81bd9-6008-4711-b9ed-884de2174c74 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Refreshing network info cache for port 0c7d05ab-1414-4892-a28e-18b3816a1040 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 22:59:47 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:47 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:47 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:47 user nova-compute[72766]: DEBUG nova.compute.manager [req-192a5966-d0e6-4991-96cf-4f4396c553e1 req-3c495d12-77fd-4181-b3c2-cf21de4c9e85 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Received event network-vif-plugged-8e7e311b-453d-4e17-9652-45723c7a2944 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:59:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-192a5966-d0e6-4991-96cf-4f4396c553e1 req-3c495d12-77fd-4181-b3c2-cf21de4c9e85 service nova] Acquiring lock "78f02883-99a1-493d-b6be-e43500bfba37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-192a5966-d0e6-4991-96cf-4f4396c553e1 req-3c495d12-77fd-4181-b3c2-cf21de4c9e85 service nova] Lock "78f02883-99a1-493d-b6be-e43500bfba37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-192a5966-d0e6-4991-96cf-4f4396c553e1 req-3c495d12-77fd-4181-b3c2-cf21de4c9e85 service nova] Lock "78f02883-99a1-493d-b6be-e43500bfba37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:47 user nova-compute[72766]: DEBUG nova.compute.manager [req-192a5966-d0e6-4991-96cf-4f4396c553e1 req-3c495d12-77fd-4181-b3c2-cf21de4c9e85 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] No waiting events found dispatching network-vif-plugged-8e7e311b-453d-4e17-9652-45723c7a2944 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:59:47 user nova-compute[72766]: WARNING nova.compute.manager [req-192a5966-d0e6-4991-96cf-4f4396c553e1 req-3c495d12-77fd-4181-b3c2-cf21de4c9e85 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Received unexpected event network-vif-plugged-8e7e311b-453d-4e17-9652-45723c7a2944 for instance with vm_state building and task_state spawning.
Aug 14 22:59:47 user nova-compute[72766]: DEBUG nova.network.neutron [req-be3f0eca-eeb7-47b7-9af2-18d4538fea75 req-d5b81bd9-6008-4711-b9ed-884de2174c74 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Updated VIF entry in instance network info cache for port 0c7d05ab-1414-4892-a28e-18b3816a1040. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 22:59:47 user nova-compute[72766]: DEBUG nova.network.neutron [req-be3f0eca-eeb7-47b7-9af2-18d4538fea75 req-d5b81bd9-6008-4711-b9ed-884de2174c74 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Updating instance_info_cache with network_info: [{"id": "098834fb-ad7d-4032-9f2c-28b8a206d4c4", "address": "fa:16:3e:5e:72:4a", "network": {"id": "6991af8d-255f-45a5-8be0-f6d851affa68", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1760061206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap098834fb-ad", "ovs_interfaceid": "098834fb-ad7d-4032-9f2c-28b8a206d4c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ad9f734-e280-4596-a00e-672de5d6ecb6", "address": "fa:16:3e:8c:7f:fe", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ad9f734-e2", "ovs_interfaceid": "4ad9f734-e280-4596-a00e-672de5d6ecb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5d0ea097-96cd-4d3b-8815-346a488703d2", "address": "fa:16:3e:46:88:4e", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0ea097-96", "ovs_interfaceid": "5d0ea097-96cd-4d3b-8815-346a488703d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0d0642a2-a76e-4de1-956c-fb58280caec3", "address": "fa:16:3e:d9:c2:f7", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d0642a2-a7", "ovs_interfaceid": "0d0642a2-a76e-4de1-956c-fb58280caec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a9ba4ad3-e5eb-436a-8514-567d511f1999", "address": "fa:16:3e:30:f6:50", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9ba4ad3-e5", "ovs_interfaceid": "a9ba4ad3-e5eb-436a-8514-567d511f1999", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2774a932-7806-4c06-a128-e067a3072ebc", "address": "fa:16:3e:35:ec:2f", "network": {"id": "1f7634cf-e63f-4d83-8a75-65d21e863a21", "bridge": "br-int", "label": "tempest-device-tagging-net2-388612262", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2774a932-78", "ovs_interfaceid": "2774a932-7806-4c06-a128-e067a3072ebc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0c7d05ab-1414-4892-a28e-18b3816a1040", "address": "fa:16:3e:1f:5e:13", "network": {"id": "1f7634cf-e63f-4d83-8a75-65d21e863a21", "bridge": "br-int", "label": "tempest-device-tagging-net2-388612262", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c7d05ab-14", "ovs_interfaceid": "0c7d05ab-1414-4892-a28e-18b3816a1040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 22:59:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-be3f0eca-eeb7-47b7-9af2-18d4538fea75 req-d5b81bd9-6008-4711-b9ed-884de2174c74 service nova] Releasing lock "refresh_cache-e503ad35-1d9e-47d8-9a25-58e2a503ff02" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 22:59:47 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:47 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:47 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:49 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692053989.3075943, 78f02883-99a1-493d-b6be-e43500bfba37 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:59:49 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] VM Resumed (Lifecycle Event)
Aug 14 22:59:49 user nova-compute[72766]: DEBUG nova.compute.manager [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 22:59:49 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 22:59:49 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Instance spawned successfully.
Aug 14 22:59:49 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 22:59:49 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:59:49 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:59:49 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:59:49 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:59:49 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:59:49 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:59:49 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:59:49 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 22:59:49 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:59:49 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692053989.312983, 78f02883-99a1-493d-b6be-e43500bfba37 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:59:49 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] VM Started (Lifecycle Event)
Aug 14 22:59:49 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:59:49 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 22:59:49 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 22:59:49 user nova-compute[72766]: INFO nova.compute.manager [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Took 6.09 seconds to spawn the instance on the hypervisor.
Aug 14 22:59:49 user nova-compute[72766]: DEBUG nova.compute.manager [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:59:49 user nova-compute[72766]: INFO nova.compute.manager [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Took 6.96 seconds to build instance.
Aug 14 22:59:49 user nova-compute[72766]: DEBUG nova.compute.manager [req-da4df570-6931-4c88-a54a-e4312cc6aa4b req-80b263f8-45e4-44d1-a733-e6484cc853be service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Received event network-vif-plugged-8e7e311b-453d-4e17-9652-45723c7a2944 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 22:59:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-da4df570-6931-4c88-a54a-e4312cc6aa4b req-80b263f8-45e4-44d1-a733-e6484cc853be service nova] Acquiring lock "78f02883-99a1-493d-b6be-e43500bfba37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 22:59:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-da4df570-6931-4c88-a54a-e4312cc6aa4b req-80b263f8-45e4-44d1-a733-e6484cc853be service nova] Lock "78f02883-99a1-493d-b6be-e43500bfba37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 22:59:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-da4df570-6931-4c88-a54a-e4312cc6aa4b req-80b263f8-45e4-44d1-a733-e6484cc853be service nova] Lock "78f02883-99a1-493d-b6be-e43500bfba37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:49 user nova-compute[72766]: DEBUG nova.compute.manager [req-da4df570-6931-4c88-a54a-e4312cc6aa4b req-80b263f8-45e4-44d1-a733-e6484cc853be service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] No waiting events found dispatching network-vif-plugged-8e7e311b-453d-4e17-9652-45723c7a2944 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 22:59:49 user nova-compute[72766]: WARNING nova.compute.manager [req-da4df570-6931-4c88-a54a-e4312cc6aa4b req-80b263f8-45e4-44d1-a733-e6484cc853be service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Received unexpected event network-vif-plugged-8e7e311b-453d-4e17-9652-45723c7a2944 for instance with vm_state active and task_state None.
Aug 14 22:59:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eb062cff-88ee-4f3b-8d77-869bd1f7502c tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "78f02883-99a1-493d-b6be-e43500bfba37" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.079s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 22:59:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:52 user nova-compute[72766]: INFO nova.virt.block_device [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Booting with volume 9900a64e-33db-4cad-95c1-2561e727dd79 at /dev/vdc
Aug 14 22:59:52 user nova-compute[72766]: DEBUG os_brick.utils [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 22:59:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:52 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[14cd9239-3316-4fa0-ac89-4394e6072188]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:52 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbf9c27-10fe-45db-b205-04d603738313]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 22:59:52 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[350e55af-ea5b-485c-b9e7-e64b19545776]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:52 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebb95e2-d72a-4d3e-b654-09cfe9b4ba9c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:59:53 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 22:59:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 22:59:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 22:59:53 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 22:59:53 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e2dfb2-4941-4cd3-b8a6-997c1e377a8e]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 22:59:53 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 22:59:53 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 22:59:53 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 22:59:53 user nova-compute[72766]: DEBUG os_brick.utils [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 22:59:53 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Updating existing volume attachment record: a6237501-f125-4cbb-81f6-423a137391fb {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 22:59:53 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692053978.0795665, 33e6f8aa-bb0d-478d-b7b5-3334302476fb => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 22:59:53 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] VM Stopped (Lifecycle Event)
Aug 14 22:59:53 user nova-compute[72766]: DEBUG nova.compute.manager [None req-77fda644-0247-4a78-aa96-182f6ae182eb None None] [instance: 33e6f8aa-bb0d-478d-b7b5-3334302476fb] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 22:59:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:55 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 22:59:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:00 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:00 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:02 user nova-compute[72766]: DEBUG nova.compute.manager [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 23:00:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 23:00:02 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Creating image(s)
Aug 14 23:00:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Did not create local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 23:00:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Ensure instance console log exists: /opt/stack/data/nova/instances/e503ad35-1d9e-47d8-9a25-58e2a503ff02/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 23:00:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:00:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:00:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:00:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Start _get_guest_xml network_info=[{"id": "098834fb-ad7d-4032-9f2c-28b8a206d4c4", "address": "fa:16:3e:5e:72:4a", "network": {"id": "6991af8d-255f-45a5-8be0-f6d851affa68", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1760061206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap098834fb-ad", "ovs_interfaceid": "098834fb-ad7d-4032-9f2c-28b8a206d4c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ad9f734-e280-4596-a00e-672de5d6ecb6", "address": "fa:16:3e:8c:7f:fe", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ad9f734-e2", "ovs_interfaceid": "4ad9f734-e280-4596-a00e-672de5d6ecb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5d0ea097-96cd-4d3b-8815-346a488703d2", "address": "fa:16:3e:46:88:4e", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0ea097-96", "ovs_interfaceid": "5d0ea097-96cd-4d3b-8815-346a488703d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0d0642a2-a76e-4de1-956c-fb58280caec3", "address": "fa:16:3e:d9:c2:f7", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d0642a2-a7", "ovs_interfaceid": "0d0642a2-a76e-4de1-956c-fb58280caec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a9ba4ad3-e5eb-436a-8514-567d511f1999", "address": "fa:16:3e:30:f6:50", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9ba4ad3-e5", "ovs_interfaceid": "a9ba4ad3-e5eb-436a-8514-567d511f1999", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2774a932-7806-4c06-a128-e067a3072ebc", "address": "fa:16:3e:35:ec:2f", "network": {"id": "1f7634cf-e63f-4d83-8a75-65d21e863a21", "bridge": "br-int", "label": "tempest-device-tagging-net2-388612262", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2774a932-78", "ovs_interfaceid": "2774a932-7806-4c06-a128-e067a3072ebc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0c7d05ab-1414-4892-a28e-18b3816a1040", "address": "fa:16:3e:1f:5e:13", "network": {"id": "1f7634cf-e63f-4d83-8a75-65d21e863a21", "bridge": "br-int", "label": "tempest-device-tagging-net2-388612262", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c7d05ab-14", "ovs_interfaceid": "0c7d05ab-1414-4892-a28e-18b3816a1040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'b108d5b9-f03d-4b7d-8d99-6df063551e65', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fCUzoLOg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e503ad35-1d9e-47d8-9a25-58e2a503ff02', 'attached_at': '', 'detached_at': '', 'volume_id': 'cf11e175-5cef-45e6-94a6-0198c4db16ba', 'serial': 'cf11e175-5cef-45e6-94a6-0198c4db16ba'}, 'volume_type': None}, {'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'boot_index': 1, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'ebac15f0-73b9-48af-b31a-75794f3d509e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfSsALwa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e503ad35-1d9e-47d8-9a25-58e2a503ff02', 'attached_at': '', 'detached_at': '', 'volume_id': 'bdc00e2e-604f-428f-bfb4-7451d23a1c9d', 'serial': 'bdc00e2e-604f-428f-bfb4-7451d23a1c9d'}, 'volume_type': None}, {'mount_device': '/dev/vdc', 'guest_format': None, 'device_type': 'disk', 'boot_index': 2, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'a6237501-f125-4cbb-81f6-423a137391fb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eFimLPAu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e503ad35-1d9e-47d8-9a25-58e2a503ff02', 'attached_at': '', 'detached_at': '', 'volume_id': '9900a64e-33db-4cad-95c1-2561e727dd79', 'serial': '9900a64e-33db-4cad-95c1-2561e727dd79'}, 'volume_type': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:00:02 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:00:02 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:00:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:00:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:00:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:00:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:00:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:00:02 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:00:02 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:00:02 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:00:02 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:00:02 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:00:02 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:00:02 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fCUzoLOg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:00:03 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:00:03 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:00:03 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:00:03 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:00:03 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 23:00:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c0ebc1-fbb7-419c-ba05-d55eda72a2e9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 23:00:03 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a618924f-8845-4e0f-971a-c90d993dbffe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba] added
Aug 14 23:00:03 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[487180ee-fabf-45fe-8ab6-b970368d8b2b]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6c711f-e1a1-45bb-a005-bb29766a8726]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fCUzoLOg {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fCUzoLOg" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a7349b-7552-4606-8b35-ee328ec1ab31]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fCUzoLOg'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ea67b9-46f8-4834-8140-29667bac3e70]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[f405b040-2ec8-487f-8be9-91f389dbfb31]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 23:00:03 user nova-compute[72766]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 23:00:03 user nova-compute[72766]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)
Aug 14 23:00:03 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 23:00:03 user nova-compute[72766]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 23:00:03 user nova-compute[72766]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)
Aug 14 23:00:03 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[04180580-8d5c-4131-9df3-56f6d3095494]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba, portal: 172.16.0.220,3260]
Aug 14 23:00:03 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba, portal: 172.16.0.220,3260] successful.
Aug 14 23:00:03 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdfeca0-a306-46d1-957b-2be42e1b92e7]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b584850f-d1c0-4e27-a61a-4765226cdd42]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 23:00:03 user nova-compute[72766]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 23:00:03 user nova-compute[72766]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)
Aug 14 23:00:03 user nova-compute[72766]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba (non-flash)
Aug 14 23:00:03 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 23:00:03 user nova-compute[72766]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 23:00:03 user nova-compute[72766]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)
Aug 14 23:00:03 user nova-compute[72766]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba (non-flash)
Aug 14 23:00:03 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] HCTL ('35', '-', '-', 0) found on session 16 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfac8b9f-6b92-44eb-89f1-73d91865ec19]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fCUzoLOg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 23:00:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23531313361313064', 'path': '/dev/sdd'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531313361313064', 'path': '/dev/sdd'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfSsALwa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:00:04 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:00:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:00:04 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:00:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:00:04 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 23:00:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c36ddc-1280-422d-a96d-f5a039ead45c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 23:00:04 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38c9349-8d5b-453c-a316-ee7997b5d510]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d] added
Aug 14 23:00:04 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b6fcab-e8aa-457f-9420-d1b5d5033b0b]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f2e4cc-8520-4fdb-85b3-07559deaad14]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OfSsALwa {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OfSsALwa" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a925b4-f6d5-4a54-adc2-0e76395792cf]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OfSsALwa'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd609a8d-69a5-42e6-9cf9-e9487bc4e0c4]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[208ec649-ce4e-43f5-93f2-a061ebf68411]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 23:00:04 user nova-compute[72766]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 23:00:04 user nova-compute[72766]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)
Aug 14 23:00:04 user nova-compute[72766]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba (non-flash)
Aug 14 23:00:04 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 23:00:04 user nova-compute[72766]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 23:00:04 user nova-compute[72766]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)
Aug 14 23:00:04 user nova-compute[72766]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba (non-flash)
Aug 14 23:00:04 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d9fd08-a708-4a1d-aec2-3097650b0880]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d, portal: 172.16.0.220,3260]
Aug 14 23:00:04 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d, portal: 172.16.0.220,3260] successful.
Aug 14 23:00:04 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b930c13-f478-48ae-9326-704ec51a3b73]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[378ebc65-6324-46fb-970a-b904f79af59e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 23:00:04 user nova-compute[72766]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 23:00:04 user nova-compute[72766]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)
Aug 14 23:00:04 user nova-compute[72766]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba (non-flash)
Aug 14 23:00:04 user nova-compute[72766]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d (non-flash)
Aug 14 23:00:04 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 23:00:04 user nova-compute[72766]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 23:00:04 user nova-compute[72766]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)
Aug 14 23:00:04 user nova-compute[72766]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba (non-flash)
Aug 14 23:00:04 user nova-compute[72766]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d (non-flash)
Aug 14 23:00:04 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] HCTL ('37', '-', '-', 0) found on session 17 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d0c3a3-38f7-47d7-b59f-5928b3baa474]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Searching for a device in session 17 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:00:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfSsALwa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 23:00:05 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:00:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26364636463393137', 'path': '/dev/sdf'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:00:05 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364636463393137', 'path': '/dev/sdf'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 23:00:05 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 23:00:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eFimLPAu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:00:05 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:00:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:00:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:00:05 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:00:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:00:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:00:05 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 23:00:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:05 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[1425a1ce-f902-4461-ab0b-3204ae7f15d4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 23:00:05 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:00:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:05 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20b05be-c2f0-4d36-9460-bcc3b31433bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79] added
Aug 14 23:00:05 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:00:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:05 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf84c359-61ed-47c5-9927-62357cf825f2]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:00:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:05 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8474fe-df0c-4074-896b-d98211284c66]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:00:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eFimLPAu {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eFimLPAu" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:05 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe51f822-bef1-44cd-adeb-41e3bb7cbeaf]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eFimLPAu'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:00:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:05 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d947adc-2689-412c-b62d-c9cb5d5abc1f]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:00:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:05 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[1304d17a-58f1-4ede-9376-e871b42dec96]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 23:00:05 user nova-compute[72766]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 23:00:05 user nova-compute[72766]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)
Aug 14 23:00:05 user nova-compute[72766]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba (non-flash)
Aug 14 23:00:05 user nova-compute[72766]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d (non-flash)
Aug 14 23:00:05 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:00:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 23:00:05 user nova-compute[72766]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 23:00:05 user nova-compute[72766]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)
Aug 14 23:00:05 user nova-compute[72766]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba (non-flash)
Aug 14 23:00:05 user nova-compute[72766]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d (non-flash)
Aug 14 23:00:05 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:00:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:06 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[568c9c53-f99a-461a-a5b3-aa4fb4458ab7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:06 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79, portal: 172.16.0.220,3260]
Aug 14 23:00:06 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79, portal: 172.16.0.220,3260] successful.
Aug 14 23:00:06 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:00:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:06 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce70cde1-7b75-4255-a876-cbbc2ab74ec8]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:06 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:00:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:06 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[817a86d3-b1f4-4efc-a82a-03b9730b61cf]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:06 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 23:00:06 user nova-compute[72766]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 23:00:06 user nova-compute[72766]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)
Aug 14 23:00:06 user nova-compute[72766]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba (non-flash)
Aug 14 23:00:06 user nova-compute[72766]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d (non-flash)
Aug 14 23:00:06 user nova-compute[72766]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 (non-flash)
Aug 14 23:00:06 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:00:06 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 23:00:06 user nova-compute[72766]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 23:00:06 user nova-compute[72766]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)
Aug 14 23:00:06 user nova-compute[72766]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba (non-flash)
Aug 14 23:00:06 user nova-compute[72766]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d (non-flash)
Aug 14 23:00:06 user nova-compute[72766]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 (non-flash)
Aug 14 23:00:06 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:00:06 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.378s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:00:06 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 23:00:06 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] HCTL ('38', '-', '-', 0) found on session 18 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 23:00:06 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 23:00:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:06 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[088017ab-06a0-4efa-8783-73a44c025c37]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:06 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Searching for a device in session 18 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:00:06 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eFimLPAu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] <== connect_volume: return (1431ms) {'type': 'block', 'scsi_wwn': '26131613935393966', 'path': '/dev/sdg'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131613935393966', 'path': '/dev/sdg'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T22:59:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1980704616',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1980704616',id=15,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTW3JotsHqkkXvtJosiuyB+jgYCyIIaBk4uEzRhxiHlu66v6Cs2FyC8xKi4GfKh+FPWzxjQ/1KSY3IeIfVhlQtrhAM8ckKpiQQi+W90XzsZXKKfsCNaLVEhiUmmOF0MbA==',key_name='tempest-keypair-1244565067',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa34f06852ad4fc9aaa9f542232d711b',ramdisk_id='',reservation_id='r-jdcne46q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-507110939',owner_user_name='tempest-TaggedBootDevicesTest-507110939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:59:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb06afcc445148a9aaba54ee872cd38b',uuid=e503ad35-1d9e-47d8-9a25-58e2a503ff02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "098834fb-ad7d-4032-9f2c-28b8a206d4c4", "address": "fa:16:3e:5e:72:4a", "network": {"id": "6991af8d-255f-45a5-8be0-f6d851affa68", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1760061206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap098834fb-ad", "ovs_interfaceid": "098834fb-ad7d-4032-9f2c-28b8a206d4c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Converting VIF {"id": "098834fb-ad7d-4032-9f2c-28b8a206d4c4", "address": "fa:16:3e:5e:72:4a", "network": {"id": "6991af8d-255f-45a5-8be0-f6d851affa68", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1760061206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap098834fb-ad", "ovs_interfaceid": "098834fb-ad7d-4032-9f2c-28b8a206d4c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:72:4a,bridge_name='br-int',has_traffic_filtering=True,id=098834fb-ad7d-4032-9f2c-28b8a206d4c4,network=Network(6991af8d-255f-45a5-8be0-f6d851affa68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap098834fb-ad') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T22:59:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1980704616',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1980704616',id=15,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTW3JotsHqkkXvtJosiuyB+jgYCyIIaBk4uEzRhxiHlu66v6Cs2FyC8xKi4GfKh+FPWzxjQ/1KSY3IeIfVhlQtrhAM8ckKpiQQi+W90XzsZXKKfsCNaLVEhiUmmOF0MbA==',key_name='tempest-keypair-1244565067',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa34f06852ad4fc9aaa9f542232d711b',ramdisk_id='',reservation_id='r-jdcne46q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-507110939',owner_user_name='tempest-TaggedBootDevicesTest-507110939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:59:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb06afcc445148a9aaba54ee872cd38b',uuid=e503ad35-1d9e-47d8-9a25-58e2a503ff02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ad9f734-e280-4596-a00e-672de5d6ecb6", "address": "fa:16:3e:8c:7f:fe", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ad9f734-e2", "ovs_interfaceid": "4ad9f734-e280-4596-a00e-672de5d6ecb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Converting VIF {"id": "4ad9f734-e280-4596-a00e-672de5d6ecb6", "address": "fa:16:3e:8c:7f:fe", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ad9f734-e2", "ovs_interfaceid": "4ad9f734-e280-4596-a00e-672de5d6ecb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:7f:fe,bridge_name='br-int',has_traffic_filtering=True,id=4ad9f734-e280-4596-a00e-672de5d6ecb6,network=Network(140290ed-5e86-4fc4-a97d-169e77a3d9d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4ad9f734-e2') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T22:59:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1980704616',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1980704616',id=15,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTW3JotsHqkkXvtJosiuyB+jgYCyIIaBk4uEzRhxiHlu66v6Cs2FyC8xKi4GfKh+FPWzxjQ/1KSY3IeIfVhlQtrhAM8ckKpiQQi+W90XzsZXKKfsCNaLVEhiUmmOF0MbA==',key_name='tempest-keypair-1244565067',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa34f06852ad4fc9aaa9f542232d711b',ramdisk_id='',reservation_id='r-jdcne46q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-507110939',owner_user_name='tempest-TaggedBootDevicesTest-507110939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:59:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb06afcc445148a9aaba54ee872cd38b',uuid=e503ad35-1d9e-47d8-9a25-58e2a503ff02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d0ea097-96cd-4d3b-8815-346a488703d2", "address": "fa:16:3e:46:88:4e", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0ea097-96", "ovs_interfaceid": "5d0ea097-96cd-4d3b-8815-346a488703d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Converting VIF {"id": "5d0ea097-96cd-4d3b-8815-346a488703d2", "address": "fa:16:3e:46:88:4e", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0ea097-96", "ovs_interfaceid": "5d0ea097-96cd-4d3b-8815-346a488703d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:88:4e,bridge_name='br-int',has_traffic_filtering=True,id=5d0ea097-96cd-4d3b-8815-346a488703d2,network=Network(140290ed-5e86-4fc4-a97d-169e77a3d9d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5d0ea097-96') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T22:59:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1980704616',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1980704616',id=15,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTW3JotsHqkkXvtJosiuyB+jgYCyIIaBk4uEzRhxiHlu66v6Cs2FyC8xKi4GfKh+FPWzxjQ/1KSY3IeIfVhlQtrhAM8ckKpiQQi+W90XzsZXKKfsCNaLVEhiUmmOF0MbA==',key_name='tempest-keypair-1244565067',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa34f06852ad4fc9aaa9f542232d711b',ramdisk_id='',reservation_id='r-jdcne46q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-507110939',owner_user_name='tempest-TaggedBootDevicesTest-507110939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:59:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb06afcc445148a9aaba54ee872cd38b',uuid=e503ad35-1d9e-47d8-9a25-58e2a503ff02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d0642a2-a76e-4de1-956c-fb58280caec3", "address": "fa:16:3e:d9:c2:f7", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d0642a2-a7", "ovs_interfaceid": "0d0642a2-a76e-4de1-956c-fb58280caec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Converting VIF {"id": "0d0642a2-a76e-4de1-956c-fb58280caec3", "address": "fa:16:3e:d9:c2:f7", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d0642a2-a7", "ovs_interfaceid": "0d0642a2-a76e-4de1-956c-fb58280caec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:c2:f7,bridge_name='br-int',has_traffic_filtering=True,id=0d0642a2-a76e-4de1-956c-fb58280caec3,network=Network(140290ed-5e86-4fc4-a97d-169e77a3d9d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d0642a2-a7') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T22:59:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1980704616',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1980704616',id=15,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTW3JotsHqkkXvtJosiuyB+jgYCyIIaBk4uEzRhxiHlu66v6Cs2FyC8xKi4GfKh+FPWzxjQ/1KSY3IeIfVhlQtrhAM8ckKpiQQi+W90XzsZXKKfsCNaLVEhiUmmOF0MbA==',key_name='tempest-keypair-1244565067',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa34f06852ad4fc9aaa9f542232d711b',ramdisk_id='',reservation_id='r-jdcne46q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-507110939',owner_user_name='tempest-TaggedBootDevicesTest-507110939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:59:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb06afcc445148a9aaba54ee872cd38b',uuid=e503ad35-1d9e-47d8-9a25-58e2a503ff02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9ba4ad3-e5eb-436a-8514-567d511f1999", "address": "fa:16:3e:30:f6:50", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9ba4ad3-e5", "ovs_interfaceid": "a9ba4ad3-e5eb-436a-8514-567d511f1999", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Converting VIF {"id": "a9ba4ad3-e5eb-436a-8514-567d511f1999", "address": "fa:16:3e:30:f6:50", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9ba4ad3-e5", "ovs_interfaceid": "a9ba4ad3-e5eb-436a-8514-567d511f1999", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:f6:50,bridge_name='br-int',has_traffic_filtering=True,id=a9ba4ad3-e5eb-436a-8514-567d511f1999,network=Network(140290ed-5e86-4fc4-a97d-169e77a3d9d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9ba4ad3-e5') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T22:59:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1980704616',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1980704616',id=15,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTW3JotsHqkkXvtJosiuyB+jgYCyIIaBk4uEzRhxiHlu66v6Cs2FyC8xKi4GfKh+FPWzxjQ/1KSY3IeIfVhlQtrhAM8ckKpiQQi+W90XzsZXKKfsCNaLVEhiUmmOF0MbA==',key_name='tempest-keypair-1244565067',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa34f06852ad4fc9aaa9f542232d711b',ramdisk_id='',reservation_id='r-jdcne46q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-507110939',owner_user_name='tempest-TaggedBootDevicesTest-507110939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:59:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb06afcc445148a9aaba54ee872cd38b',uuid=e503ad35-1d9e-47d8-9a25-58e2a503ff02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2774a932-7806-4c06-a128-e067a3072ebc", "address": "fa:16:3e:35:ec:2f", "network": {"id": "1f7634cf-e63f-4d83-8a75-65d21e863a21", "bridge": "br-int", "label": "tempest-device-tagging-net2-388612262", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2774a932-78", "ovs_interfaceid": "2774a932-7806-4c06-a128-e067a3072ebc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Converting VIF {"id": "2774a932-7806-4c06-a128-e067a3072ebc", "address": "fa:16:3e:35:ec:2f", "network": {"id": "1f7634cf-e63f-4d83-8a75-65d21e863a21", "bridge": "br-int", "label": "tempest-device-tagging-net2-388612262", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2774a932-78", "ovs_interfaceid": "2774a932-7806-4c06-a128-e067a3072ebc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:ec:2f,bridge_name='br-int',has_traffic_filtering=True,id=2774a932-7806-4c06-a128-e067a3072ebc,network=Network(1f7634cf-e63f-4d83-8a75-65d21e863a21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2774a932-78') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T22:59:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1980704616',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1980704616',id=15,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTW3JotsHqkkXvtJosiuyB+jgYCyIIaBk4uEzRhxiHlu66v6Cs2FyC8xKi4GfKh+FPWzxjQ/1KSY3IeIfVhlQtrhAM8ckKpiQQi+W90XzsZXKKfsCNaLVEhiUmmOF0MbA==',key_name='tempest-keypair-1244565067',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa34f06852ad4fc9aaa9f542232d711b',ramdisk_id='',reservation_id='r-jdcne46q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-507110939',owner_user_name='tempest-TaggedBootDevicesTest-507110939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:59:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb06afcc445148a9aaba54ee872cd38b',uuid=e503ad35-1d9e-47d8-9a25-58e2a503ff02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c7d05ab-1414-4892-a28e-18b3816a1040", "address": "fa:16:3e:1f:5e:13", "network": {"id": "1f7634cf-e63f-4d83-8a75-65d21e863a21", "bridge": "br-int", "label": "tempest-device-tagging-net2-388612262", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c7d05ab-14", "ovs_interfaceid": "0c7d05ab-1414-4892-a28e-18b3816a1040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Converting VIF {"id": "0c7d05ab-1414-4892-a28e-18b3816a1040", "address": "fa:16:3e:1f:5e:13", "network": {"id": "1f7634cf-e63f-4d83-8a75-65d21e863a21", "bridge": "br-int", "label": "tempest-device-tagging-net2-388612262", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c7d05ab-14", "ovs_interfaceid": "0c7d05ab-1414-4892-a28e-18b3816a1040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:5e:13,bridge_name='br-int',has_traffic_filtering=True,id=0c7d05ab-1414-4892-a28e-18b3816a1040,network=Network(1f7634cf-e63f-4d83-8a75-65d21e863a21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c7d05ab-14') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.objects.instance [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Lazy-loading 'pci_devices' on Instance uuid e503ad35-1d9e-47d8-9a25-58e2a503ff02 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:00:07 user nova-compute[72766]:   <uuid>e503ad35-1d9e-47d8-9a25-58e2a503ff02</uuid>
Aug 14 23:00:07 user nova-compute[72766]:   <name>instance-0000000f</name>
Aug 14 23:00:07 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:00:07 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:00:07 user nova-compute[72766]:   <metadata>
Aug 14 23:00:07 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:00:07 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:00:07 user nova-compute[72766]:       <nova:name>tempest-device-tagging-server-1980704616</nova:name>
Aug 14 23:00:07 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:00:02</nova:creationTime>
Aug 14 23:00:07 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:00:07 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:00:07 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:00:07 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:00:07 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:00:07 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:00:07 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:00:07 user nova-compute[72766]:       <nova:owner>
Aug 14 23:00:07 user nova-compute[72766]:         <nova:user uuid="fb06afcc445148a9aaba54ee872cd38b">tempest-TaggedBootDevicesTest-507110939-project-member</nova:user>
Aug 14 23:00:07 user nova-compute[72766]:         <nova:project uuid="fa34f06852ad4fc9aaa9f542232d711b">tempest-TaggedBootDevicesTest-507110939</nova:project>
Aug 14 23:00:07 user nova-compute[72766]:       </nova:owner>
Aug 14 23:00:07 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 23:00:07 user nova-compute[72766]:       <nova:ports>
Aug 14 23:00:07 user nova-compute[72766]:         <nova:port uuid="098834fb-ad7d-4032-9f2c-28b8a206d4c4">
Aug 14 23:00:07 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 23:00:07 user nova-compute[72766]:         </nova:port>
Aug 14 23:00:07 user nova-compute[72766]:         <nova:port uuid="4ad9f734-e280-4596-a00e-672de5d6ecb6">
Aug 14 23:00:07 user nova-compute[72766]:           <nova:ip type="fixed" address="10.1.1.119" ipVersion="4"/>
Aug 14 23:00:07 user nova-compute[72766]:         </nova:port>
Aug 14 23:00:07 user nova-compute[72766]:         <nova:port uuid="5d0ea097-96cd-4d3b-8815-346a488703d2">
Aug 14 23:00:07 user nova-compute[72766]:           <nova:ip type="fixed" address="10.1.1.91" ipVersion="4"/>
Aug 14 23:00:07 user nova-compute[72766]:         </nova:port>
Aug 14 23:00:07 user nova-compute[72766]:         <nova:port uuid="0d0642a2-a76e-4de1-956c-fb58280caec3">
Aug 14 23:00:07 user nova-compute[72766]:           <nova:ip type="fixed" address="10.1.1.242" ipVersion="4"/>
Aug 14 23:00:07 user nova-compute[72766]:         </nova:port>
Aug 14 23:00:07 user nova-compute[72766]:         <nova:port uuid="a9ba4ad3-e5eb-436a-8514-567d511f1999">
Aug 14 23:00:07 user nova-compute[72766]:           <nova:ip type="fixed" address="10.1.1.154" ipVersion="4"/>
Aug 14 23:00:07 user nova-compute[72766]:         </nova:port>
Aug 14 23:00:07 user nova-compute[72766]:         <nova:port uuid="2774a932-7806-4c06-a128-e067a3072ebc">
Aug 14 23:00:07 user nova-compute[72766]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 14 23:00:07 user nova-compute[72766]:         </nova:port>
Aug 14 23:00:07 user nova-compute[72766]:         <nova:port uuid="0c7d05ab-1414-4892-a28e-18b3816a1040">
Aug 14 23:00:07 user nova-compute[72766]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 14 23:00:07 user nova-compute[72766]:         </nova:port>
Aug 14 23:00:07 user nova-compute[72766]:       </nova:ports>
Aug 14 23:00:07 user nova-compute[72766]:     </nova:instance>
Aug 14 23:00:07 user nova-compute[72766]:   </metadata>
Aug 14 23:00:07 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:00:07 user nova-compute[72766]:     <system>
Aug 14 23:00:07 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:00:07 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:00:07 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:00:07 user nova-compute[72766]:       <entry name="serial">e503ad35-1d9e-47d8-9a25-58e2a503ff02</entry>
Aug 14 23:00:07 user nova-compute[72766]:       <entry name="uuid">e503ad35-1d9e-47d8-9a25-58e2a503ff02</entry>
Aug 14 23:00:07 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:00:07 user nova-compute[72766]:     </system>
Aug 14 23:00:07 user nova-compute[72766]:   </sysinfo>
Aug 14 23:00:07 user nova-compute[72766]:   <os>
Aug 14 23:00:07 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:00:07 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:00:07 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:00:07 user nova-compute[72766]:   </os>
Aug 14 23:00:07 user nova-compute[72766]:   <features>
Aug 14 23:00:07 user nova-compute[72766]:     <acpi/>
Aug 14 23:00:07 user nova-compute[72766]:     <apic/>
Aug 14 23:00:07 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:00:07 user nova-compute[72766]:   </features>
Aug 14 23:00:07 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:00:07 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:00:07 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:00:07 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:00:07 user nova-compute[72766]:   </clock>
Aug 14 23:00:07 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:00:07 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:00:07 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:00:07 user nova-compute[72766]:   </cpu>
Aug 14 23:00:07 user nova-compute[72766]:   <devices>
Aug 14 23:00:07 user nova-compute[72766]:     <disk type="file" device="cdrom">
Aug 14 23:00:07 user nova-compute[72766]:       <driver name="qemu" type="raw" cache="none"/>
Aug 14 23:00:07 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/e503ad35-1d9e-47d8-9a25-58e2a503ff02/disk.config"/>
Aug 14 23:00:07 user nova-compute[72766]:       <target dev="hda" bus="ide"/>
Aug 14 23:00:07 user nova-compute[72766]:     </disk>
Aug 14 23:00:07 user nova-compute[72766]:     <disk type="block" device="disk">
Aug 14 23:00:07 user nova-compute[72766]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:00:07 user nova-compute[72766]:       <source dev="/dev/sdd"/>
Aug 14 23:00:07 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:00:07 user nova-compute[72766]:       <serial>cf11e175-5cef-45e6-94a6-0198c4db16ba</serial>
Aug 14 23:00:07 user nova-compute[72766]:     </disk>
Aug 14 23:00:07 user nova-compute[72766]:     <disk type="block" device="disk">
Aug 14 23:00:07 user nova-compute[72766]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:00:07 user nova-compute[72766]:       <source dev="/dev/sdf"/>
Aug 14 23:00:07 user nova-compute[72766]:       <target dev="vdb" bus="virtio"/>
Aug 14 23:00:07 user nova-compute[72766]:       <serial>bdc00e2e-604f-428f-bfb4-7451d23a1c9d</serial>
Aug 14 23:00:07 user nova-compute[72766]:     </disk>
Aug 14 23:00:07 user nova-compute[72766]:     <disk type="block" device="disk">
Aug 14 23:00:07 user nova-compute[72766]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:00:07 user nova-compute[72766]:       <source dev="/dev/sdg"/>
Aug 14 23:00:07 user nova-compute[72766]:       <target dev="vdc" bus="virtio"/>
Aug 14 23:00:07 user nova-compute[72766]:       <serial>9900a64e-33db-4cad-95c1-2561e727dd79</serial>
Aug 14 23:00:07 user nova-compute[72766]:     </disk>
Aug 14 23:00:07 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:00:07 user nova-compute[72766]:       <mac address="fa:16:3e:5e:72:4a"/>
Aug 14 23:00:07 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:00:07 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:00:07 user nova-compute[72766]:       <target dev="tap098834fb-ad"/>
Aug 14 23:00:07 user nova-compute[72766]:     </interface>
Aug 14 23:00:07 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:00:07 user nova-compute[72766]:       <mac address="fa:16:3e:8c:7f:fe"/>
Aug 14 23:00:07 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:00:07 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:00:07 user nova-compute[72766]:       <target dev="tap4ad9f734-e2"/>
Aug 14 23:00:07 user nova-compute[72766]:     </interface>
Aug 14 23:00:07 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:00:07 user nova-compute[72766]:       <mac address="fa:16:3e:46:88:4e"/>
Aug 14 23:00:07 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:00:07 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:00:07 user nova-compute[72766]:       <target dev="tap5d0ea097-96"/>
Aug 14 23:00:07 user nova-compute[72766]:     </interface>
Aug 14 23:00:07 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:00:07 user nova-compute[72766]:       <mac address="fa:16:3e:d9:c2:f7"/>
Aug 14 23:00:07 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:00:07 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:00:07 user nova-compute[72766]:       <target dev="tap0d0642a2-a7"/>
Aug 14 23:00:07 user nova-compute[72766]:     </interface>
Aug 14 23:00:07 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:00:07 user nova-compute[72766]:       <mac address="fa:16:3e:30:f6:50"/>
Aug 14 23:00:07 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:00:07 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:00:07 user nova-compute[72766]:       <target dev="tapa9ba4ad3-e5"/>
Aug 14 23:00:07 user nova-compute[72766]:     </interface>
Aug 14 23:00:07 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:00:07 user nova-compute[72766]:       <mac address="fa:16:3e:35:ec:2f"/>
Aug 14 23:00:07 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:00:07 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:00:07 user nova-compute[72766]:       <target dev="tap2774a932-78"/>
Aug 14 23:00:07 user nova-compute[72766]:     </interface>
Aug 14 23:00:07 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:00:07 user nova-compute[72766]:       <mac address="fa:16:3e:1f:5e:13"/>
Aug 14 23:00:07 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:00:07 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:00:07 user nova-compute[72766]:       <target dev="tap0c7d05ab-14"/>
Aug 14 23:00:07 user nova-compute[72766]:     </interface>
Aug 14 23:00:07 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:00:07 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/e503ad35-1d9e-47d8-9a25-58e2a503ff02/console.log" append="off"/>
Aug 14 23:00:07 user nova-compute[72766]:     </serial>
Aug 14 23:00:07 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:00:07 user nova-compute[72766]:     <video>
Aug 14 23:00:07 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:00:07 user nova-compute[72766]:     </video>
Aug 14 23:00:07 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:00:07 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:00:07 user nova-compute[72766]:     </rng>
Aug 14 23:00:07 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:00:07 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:00:07 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:00:07 user nova-compute[72766]:     </memballoon>
Aug 14 23:00:07 user nova-compute[72766]:   </devices>
Aug 14 23:00:07 user nova-compute[72766]: </domain>
Aug 14 23:00:07 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T22:59:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1980704616',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1980704616',id=15,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTW3JotsHqkkXvtJosiuyB+jgYCyIIaBk4uEzRhxiHlu66v6Cs2FyC8xKi4GfKh+FPWzxjQ/1KSY3IeIfVhlQtrhAM8ckKpiQQi+W90XzsZXKKfsCNaLVEhiUmmOF0MbA==',key_name='tempest-keypair-1244565067',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa34f06852ad4fc9aaa9f542232d711b',ramdisk_id='',reservation_id='r-jdcne46q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-507110939',owner_user_name='tempest-TaggedBootDevicesTest-507110939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:59:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb06afcc445148a9aaba54ee872cd38b',uuid=e503ad35-1d9e-47d8-9a25-58e2a503ff02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "098834fb-ad7d-4032-9f2c-28b8a206d4c4", "address": "fa:16:3e:5e:72:4a", "network": {"id": "6991af8d-255f-45a5-8be0-f6d851affa68", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1760061206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap098834fb-ad", "ovs_interfaceid": "098834fb-ad7d-4032-9f2c-28b8a206d4c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Converting VIF {"id": "098834fb-ad7d-4032-9f2c-28b8a206d4c4", "address": "fa:16:3e:5e:72:4a", "network": {"id": "6991af8d-255f-45a5-8be0-f6d851affa68", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1760061206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap098834fb-ad", "ovs_interfaceid": "098834fb-ad7d-4032-9f2c-28b8a206d4c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:72:4a,bridge_name='br-int',has_traffic_filtering=True,id=098834fb-ad7d-4032-9f2c-28b8a206d4c4,network=Network(6991af8d-255f-45a5-8be0-f6d851affa68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap098834fb-ad') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG os_vif [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:72:4a,bridge_name='br-int',has_traffic_filtering=True,id=098834fb-ad7d-4032-9f2c-28b8a206d4c4,network=Network(6991af8d-255f-45a5-8be0-f6d851affa68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap098834fb-ad') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap098834fb-ad, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap098834fb-ad, col_values=(('external_ids', {'iface-id': '098834fb-ad7d-4032-9f2c-28b8a206d4c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:72:4a', 'vm-uuid': 'e503ad35-1d9e-47d8-9a25-58e2a503ff02'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:07 user nova-compute[72766]: INFO os_vif [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:72:4a,bridge_name='br-int',has_traffic_filtering=True,id=098834fb-ad7d-4032-9f2c-28b8a206d4c4,network=Network(6991af8d-255f-45a5-8be0-f6d851affa68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap098834fb-ad')
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T22:59:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1980704616',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1980704616',id=15,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTW3JotsHqkkXvtJosiuyB+jgYCyIIaBk4uEzRhxiHlu66v6Cs2FyC8xKi4GfKh+FPWzxjQ/1KSY3IeIfVhlQtrhAM8ckKpiQQi+W90XzsZXKKfsCNaLVEhiUmmOF0MbA==',key_name='tempest-keypair-1244565067',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa34f06852ad4fc9aaa9f542232d711b',ramdisk_id='',reservation_id='r-jdcne46q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-507110939',owner_user_name='tempest-TaggedBootDevicesTest-507110939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:59:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb06afcc445148a9aaba54ee872cd38b',uuid=e503ad35-1d9e-47d8-9a25-58e2a503ff02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ad9f734-e280-4596-a00e-672de5d6ecb6", "address": "fa:16:3e:8c:7f:fe", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ad9f734-e2", "ovs_interfaceid": "4ad9f734-e280-4596-a00e-672de5d6ecb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Converting VIF {"id": "4ad9f734-e280-4596-a00e-672de5d6ecb6", "address": "fa:16:3e:8c:7f:fe", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ad9f734-e2", "ovs_interfaceid": "4ad9f734-e280-4596-a00e-672de5d6ecb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:7f:fe,bridge_name='br-int',has_traffic_filtering=True,id=4ad9f734-e280-4596-a00e-672de5d6ecb6,network=Network(140290ed-5e86-4fc4-a97d-169e77a3d9d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4ad9f734-e2') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG os_vif [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:7f:fe,bridge_name='br-int',has_traffic_filtering=True,id=4ad9f734-e280-4596-a00e-672de5d6ecb6,network=Network(140290ed-5e86-4fc4-a97d-169e77a3d9d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4ad9f734-e2') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ad9f734-e2, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4ad9f734-e2, col_values=(('external_ids', {'iface-id': '4ad9f734-e280-4596-a00e-672de5d6ecb6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:7f:fe', 'vm-uuid': 'e503ad35-1d9e-47d8-9a25-58e2a503ff02'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:07 user nova-compute[72766]: INFO os_vif [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:7f:fe,bridge_name='br-int',has_traffic_filtering=True,id=4ad9f734-e280-4596-a00e-672de5d6ecb6,network=Network(140290ed-5e86-4fc4-a97d-169e77a3d9d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4ad9f734-e2')
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T22:59:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1980704616',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1980704616',id=15,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTW3JotsHqkkXvtJosiuyB+jgYCyIIaBk4uEzRhxiHlu66v6Cs2FyC8xKi4GfKh+FPWzxjQ/1KSY3IeIfVhlQtrhAM8ckKpiQQi+W90XzsZXKKfsCNaLVEhiUmmOF0MbA==',key_name='tempest-keypair-1244565067',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa34f06852ad4fc9aaa9f542232d711b',ramdisk_id='',reservation_id='r-jdcne46q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-507110939',owner_user_name='tempest-TaggedBootDevicesTest-507110939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:59:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb06afcc445148a9aaba54ee872cd38b',uuid=e503ad35-1d9e-47d8-9a25-58e2a503ff02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d0ea097-96cd-4d3b-8815-346a488703d2", "address": "fa:16:3e:46:88:4e", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0ea097-96", "ovs_interfaceid": "5d0ea097-96cd-4d3b-8815-346a488703d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Converting VIF {"id": "5d0ea097-96cd-4d3b-8815-346a488703d2", "address": "fa:16:3e:46:88:4e", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0ea097-96", "ovs_interfaceid": "5d0ea097-96cd-4d3b-8815-346a488703d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:88:4e,bridge_name='br-int',has_traffic_filtering=True,id=5d0ea097-96cd-4d3b-8815-346a488703d2,network=Network(140290ed-5e86-4fc4-a97d-169e77a3d9d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5d0ea097-96') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG os_vif [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:88:4e,bridge_name='br-int',has_traffic_filtering=True,id=5d0ea097-96cd-4d3b-8815-346a488703d2,network=Network(140290ed-5e86-4fc4-a97d-169e77a3d9d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5d0ea097-96') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d0ea097-96, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5d0ea097-96, col_values=(('external_ids', {'iface-id': '5d0ea097-96cd-4d3b-8815-346a488703d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:88:4e', 'vm-uuid': 'e503ad35-1d9e-47d8-9a25-58e2a503ff02'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:07 user nova-compute[72766]: INFO os_vif [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:88:4e,bridge_name='br-int',has_traffic_filtering=True,id=5d0ea097-96cd-4d3b-8815-346a488703d2,network=Network(140290ed-5e86-4fc4-a97d-169e77a3d9d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5d0ea097-96')
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T22:59:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1980704616',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1980704616',id=15,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTW3JotsHqkkXvtJosiuyB+jgYCyIIaBk4uEzRhxiHlu66v6Cs2FyC8xKi4GfKh+FPWzxjQ/1KSY3IeIfVhlQtrhAM8ckKpiQQi+W90XzsZXKKfsCNaLVEhiUmmOF0MbA==',key_name='tempest-keypair-1244565067',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa34f06852ad4fc9aaa9f542232d711b',ramdisk_id='',reservation_id='r-jdcne46q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-507110939',owner_user_name='tempest-TaggedBootDevicesTest-507110939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:59:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb06afcc445148a9aaba54ee872cd38b',uuid=e503ad35-1d9e-47d8-9a25-58e2a503ff02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d0642a2-a76e-4de1-956c-fb58280caec3", "address": "fa:16:3e:d9:c2:f7", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d0642a2-a7", "ovs_interfaceid": "0d0642a2-a76e-4de1-956c-fb58280caec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Converting VIF {"id": "0d0642a2-a76e-4de1-956c-fb58280caec3", "address": "fa:16:3e:d9:c2:f7", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d0642a2-a7", "ovs_interfaceid": "0d0642a2-a76e-4de1-956c-fb58280caec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:c2:f7,bridge_name='br-int',has_traffic_filtering=True,id=0d0642a2-a76e-4de1-956c-fb58280caec3,network=Network(140290ed-5e86-4fc4-a97d-169e77a3d9d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d0642a2-a7') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG os_vif [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:c2:f7,bridge_name='br-int',has_traffic_filtering=True,id=0d0642a2-a76e-4de1-956c-fb58280caec3,network=Network(140290ed-5e86-4fc4-a97d-169e77a3d9d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d0642a2-a7') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d0642a2-a7, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0d0642a2-a7, col_values=(('external_ids', {'iface-id': '0d0642a2-a76e-4de1-956c-fb58280caec3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:c2:f7', 'vm-uuid': 'e503ad35-1d9e-47d8-9a25-58e2a503ff02'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:07 user nova-compute[72766]: INFO os_vif [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:c2:f7,bridge_name='br-int',has_traffic_filtering=True,id=0d0642a2-a76e-4de1-956c-fb58280caec3,network=Network(140290ed-5e86-4fc4-a97d-169e77a3d9d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d0642a2-a7')
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T22:59:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1980704616',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1980704616',id=15,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTW3JotsHqkkXvtJosiuyB+jgYCyIIaBk4uEzRhxiHlu66v6Cs2FyC8xKi4GfKh+FPWzxjQ/1KSY3IeIfVhlQtrhAM8ckKpiQQi+W90XzsZXKKfsCNaLVEhiUmmOF0MbA==',key_name='tempest-keypair-1244565067',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa34f06852ad4fc9aaa9f542232d711b',ramdisk_id='',reservation_id='r-jdcne46q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-507110939',owner_user_name='tempest-TaggedBootDevicesTest-507110939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:59:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb06afcc445148a9aaba54ee872cd38b',uuid=e503ad35-1d9e-47d8-9a25-58e2a503ff02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9ba4ad3-e5eb-436a-8514-567d511f1999", "address": "fa:16:3e:30:f6:50", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9ba4ad3-e5", "ovs_interfaceid": "a9ba4ad3-e5eb-436a-8514-567d511f1999", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Converting VIF {"id": "a9ba4ad3-e5eb-436a-8514-567d511f1999", "address": "fa:16:3e:30:f6:50", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9ba4ad3-e5", "ovs_interfaceid": "a9ba4ad3-e5eb-436a-8514-567d511f1999", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:f6:50,bridge_name='br-int',has_traffic_filtering=True,id=a9ba4ad3-e5eb-436a-8514-567d511f1999,network=Network(140290ed-5e86-4fc4-a97d-169e77a3d9d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9ba4ad3-e5') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG os_vif [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:f6:50,bridge_name='br-int',has_traffic_filtering=True,id=a9ba4ad3-e5eb-436a-8514-567d511f1999,network=Network(140290ed-5e86-4fc4-a97d-169e77a3d9d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9ba4ad3-e5') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9ba4ad3-e5, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa9ba4ad3-e5, col_values=(('external_ids', {'iface-id': 'a9ba4ad3-e5eb-436a-8514-567d511f1999', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:f6:50', 'vm-uuid': 'e503ad35-1d9e-47d8-9a25-58e2a503ff02'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:07 user nova-compute[72766]: INFO os_vif [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:f6:50,bridge_name='br-int',has_traffic_filtering=True,id=a9ba4ad3-e5eb-436a-8514-567d511f1999,network=Network(140290ed-5e86-4fc4-a97d-169e77a3d9d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9ba4ad3-e5')
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T22:59:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1980704616',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1980704616',id=15,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTW3JotsHqkkXvtJosiuyB+jgYCyIIaBk4uEzRhxiHlu66v6Cs2FyC8xKi4GfKh+FPWzxjQ/1KSY3IeIfVhlQtrhAM8ckKpiQQi+W90XzsZXKKfsCNaLVEhiUmmOF0MbA==',key_name='tempest-keypair-1244565067',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa34f06852ad4fc9aaa9f542232d711b',ramdisk_id='',reservation_id='r-jdcne46q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-507110939',owner_user_name='tempest-TaggedBootDevicesTest-507110939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:59:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb06afcc445148a9aaba54ee872cd38b',uuid=e503ad35-1d9e-47d8-9a25-58e2a503ff02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2774a932-7806-4c06-a128-e067a3072ebc", "address": "fa:16:3e:35:ec:2f", "network": {"id": "1f7634cf-e63f-4d83-8a75-65d21e863a21", "bridge": "br-int", "label": "tempest-device-tagging-net2-388612262", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2774a932-78", "ovs_interfaceid": "2774a932-7806-4c06-a128-e067a3072ebc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Converting VIF {"id": "2774a932-7806-4c06-a128-e067a3072ebc", "address": "fa:16:3e:35:ec:2f", "network": {"id": "1f7634cf-e63f-4d83-8a75-65d21e863a21", "bridge": "br-int", "label": "tempest-device-tagging-net2-388612262", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2774a932-78", "ovs_interfaceid": "2774a932-7806-4c06-a128-e067a3072ebc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:ec:2f,bridge_name='br-int',has_traffic_filtering=True,id=2774a932-7806-4c06-a128-e067a3072ebc,network=Network(1f7634cf-e63f-4d83-8a75-65d21e863a21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2774a932-78') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG os_vif [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:ec:2f,bridge_name='br-int',has_traffic_filtering=True,id=2774a932-7806-4c06-a128-e067a3072ebc,network=Network(1f7634cf-e63f-4d83-8a75-65d21e863a21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2774a932-78') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2774a932-78, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2774a932-78, col_values=(('external_ids', {'iface-id': '2774a932-7806-4c06-a128-e067a3072ebc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:ec:2f', 'vm-uuid': 'e503ad35-1d9e-47d8-9a25-58e2a503ff02'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:07 user nova-compute[72766]: INFO os_vif [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:ec:2f,bridge_name='br-int',has_traffic_filtering=True,id=2774a932-7806-4c06-a128-e067a3072ebc,network=Network(1f7634cf-e63f-4d83-8a75-65d21e863a21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2774a932-78')
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T22:59:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1980704616',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1980704616',id=15,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTW3JotsHqkkXvtJosiuyB+jgYCyIIaBk4uEzRhxiHlu66v6Cs2FyC8xKi4GfKh+FPWzxjQ/1KSY3IeIfVhlQtrhAM8ckKpiQQi+W90XzsZXKKfsCNaLVEhiUmmOF0MbA==',key_name='tempest-keypair-1244565067',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa34f06852ad4fc9aaa9f542232d711b',ramdisk_id='',reservation_id='r-jdcne46q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-507110939',owner_user_name='tempest-TaggedBootDevicesTest-507110939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T22:59:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb06afcc445148a9aaba54ee872cd38b',uuid=e503ad35-1d9e-47d8-9a25-58e2a503ff02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c7d05ab-1414-4892-a28e-18b3816a1040", "address": "fa:16:3e:1f:5e:13", "network": {"id": "1f7634cf-e63f-4d83-8a75-65d21e863a21", "bridge": "br-int", "label": "tempest-device-tagging-net2-388612262", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c7d05ab-14", "ovs_interfaceid": "0c7d05ab-1414-4892-a28e-18b3816a1040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Converting VIF {"id": "0c7d05ab-1414-4892-a28e-18b3816a1040", "address": "fa:16:3e:1f:5e:13", "network": {"id": "1f7634cf-e63f-4d83-8a75-65d21e863a21", "bridge": "br-int", "label": "tempest-device-tagging-net2-388612262", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c7d05ab-14", "ovs_interfaceid": "0c7d05ab-1414-4892-a28e-18b3816a1040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:5e:13,bridge_name='br-int',has_traffic_filtering=True,id=0c7d05ab-1414-4892-a28e-18b3816a1040,network=Network(1f7634cf-e63f-4d83-8a75-65d21e863a21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c7d05ab-14') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG os_vif [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:5e:13,bridge_name='br-int',has_traffic_filtering=True,id=0c7d05ab-1414-4892-a28e-18b3816a1040,network=Network(1f7634cf-e63f-4d83-8a75-65d21e863a21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c7d05ab-14') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c7d05ab-14, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0c7d05ab-14, col_values=(('external_ids', {'iface-id': '0c7d05ab-1414-4892-a28e-18b3816a1040', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:5e:13', 'vm-uuid': 'e503ad35-1d9e-47d8-9a25-58e2a503ff02'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:07 user nova-compute[72766]: INFO os_vif [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:5e:13,bridge_name='br-int',has_traffic_filtering=True,id=0c7d05ab-1414-4892-a28e-18b3816a1040,network=Network(1f7634cf-e63f-4d83-8a75-65d21e863a21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c7d05ab-14')
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] No BDM found with device name hda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] No VIF found with MAC fa:16:3e:5e:72:4a, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:00:07 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] No VIF found with MAC fa:16:3e:30:f6:50, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:00:07 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Using config drive
Aug 14 23:00:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:08 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Creating config drive at /opt/stack/data/nova/instances/e503ad35-1d9e-47d8-9a25-58e2a503ff02/disk.config
Aug 14 23:00:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e503ad35-1d9e-47d8-9a25-58e2a503ff02/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpe2zfe_6i {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e503ad35-1d9e-47d8-9a25-58e2a503ff02/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpe2zfe_6i" returned: 0 in 0.062s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:10 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:10 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:10 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:10 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:10 user nova-compute[72766]: DEBUG nova.compute.manager [req-7a4f9606-d5bc-4ace-9666-487f2bf62b07 req-39753d5f-07b1-4d64-a9d1-b1b0d595b14d service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-vif-plugged-098834fb-ad7d-4032-9f2c-28b8a206d4c4 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:00:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7a4f9606-d5bc-4ace-9666-487f2bf62b07 req-39753d5f-07b1-4d64-a9d1-b1b0d595b14d service nova] Acquiring lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:00:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7a4f9606-d5bc-4ace-9666-487f2bf62b07 req-39753d5f-07b1-4d64-a9d1-b1b0d595b14d service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:00:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7a4f9606-d5bc-4ace-9666-487f2bf62b07 req-39753d5f-07b1-4d64-a9d1-b1b0d595b14d service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:00:10 user nova-compute[72766]: DEBUG nova.compute.manager [req-7a4f9606-d5bc-4ace-9666-487f2bf62b07 req-39753d5f-07b1-4d64-a9d1-b1b0d595b14d service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] No waiting events found dispatching network-vif-plugged-098834fb-ad7d-4032-9f2c-28b8a206d4c4 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:00:10 user nova-compute[72766]: WARNING nova.compute.manager [req-7a4f9606-d5bc-4ace-9666-487f2bf62b07 req-39753d5f-07b1-4d64-a9d1-b1b0d595b14d service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received unexpected event network-vif-plugged-098834fb-ad7d-4032-9f2c-28b8a206d4c4 for instance with vm_state building and task_state spawning.
Aug 14 23:00:10 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:10 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:10 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:10 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:10 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:10 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:10 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:10 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:11 user nova-compute[72766]: DEBUG nova.compute.manager [req-a067a6e3-441f-4e54-96ba-c7e42a2a14bc req-3cc15905-f0e9-499b-b326-4d28e8d91476 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-vif-plugged-0d0642a2-a76e-4de1-956c-fb58280caec3 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:00:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a067a6e3-441f-4e54-96ba-c7e42a2a14bc req-3cc15905-f0e9-499b-b326-4d28e8d91476 service nova] Acquiring lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:00:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a067a6e3-441f-4e54-96ba-c7e42a2a14bc req-3cc15905-f0e9-499b-b326-4d28e8d91476 service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:00:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a067a6e3-441f-4e54-96ba-c7e42a2a14bc req-3cc15905-f0e9-499b-b326-4d28e8d91476 service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:00:11 user nova-compute[72766]: DEBUG nova.compute.manager [req-a067a6e3-441f-4e54-96ba-c7e42a2a14bc req-3cc15905-f0e9-499b-b326-4d28e8d91476 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] No waiting events found dispatching network-vif-plugged-0d0642a2-a76e-4de1-956c-fb58280caec3 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:00:11 user nova-compute[72766]: WARNING nova.compute.manager [req-a067a6e3-441f-4e54-96ba-c7e42a2a14bc req-3cc15905-f0e9-499b-b326-4d28e8d91476 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received unexpected event network-vif-plugged-0d0642a2-a76e-4de1-956c-fb58280caec3 for instance with vm_state building and task_state spawning.
Aug 14 23:00:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:11 user nova-compute[72766]: DEBUG nova.compute.manager [req-cf9e73f6-2e74-4b63-9ca4-02577e0c868c req-9d31afc2-8cc8-40c1-97a9-73899b48e012 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-vif-plugged-5d0ea097-96cd-4d3b-8815-346a488703d2 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:00:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-cf9e73f6-2e74-4b63-9ca4-02577e0c868c req-9d31afc2-8cc8-40c1-97a9-73899b48e012 service nova] Acquiring lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:00:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-cf9e73f6-2e74-4b63-9ca4-02577e0c868c req-9d31afc2-8cc8-40c1-97a9-73899b48e012 service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:00:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-cf9e73f6-2e74-4b63-9ca4-02577e0c868c req-9d31afc2-8cc8-40c1-97a9-73899b48e012 service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:00:11 user nova-compute[72766]: DEBUG nova.compute.manager [req-cf9e73f6-2e74-4b63-9ca4-02577e0c868c req-9d31afc2-8cc8-40c1-97a9-73899b48e012 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] No waiting events found dispatching network-vif-plugged-5d0ea097-96cd-4d3b-8815-346a488703d2 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:00:11 user nova-compute[72766]: WARNING nova.compute.manager [req-cf9e73f6-2e74-4b63-9ca4-02577e0c868c req-9d31afc2-8cc8-40c1-97a9-73899b48e012 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received unexpected event network-vif-plugged-5d0ea097-96cd-4d3b-8815-346a488703d2 for instance with vm_state building and task_state spawning.
Aug 14 23:00:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:12 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:12 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:12 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:12 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:12 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:12 user nova-compute[72766]: DEBUG nova.compute.manager [req-0354d8f5-5dce-48bf-a66e-fbb57071f948 req-4d306737-1d32-4ed5-a2cd-537a9eba5476 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-vif-plugged-098834fb-ad7d-4032-9f2c-28b8a206d4c4 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:00:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0354d8f5-5dce-48bf-a66e-fbb57071f948 req-4d306737-1d32-4ed5-a2cd-537a9eba5476 service nova] Acquiring lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:00:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0354d8f5-5dce-48bf-a66e-fbb57071f948 req-4d306737-1d32-4ed5-a2cd-537a9eba5476 service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:00:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0354d8f5-5dce-48bf-a66e-fbb57071f948 req-4d306737-1d32-4ed5-a2cd-537a9eba5476 service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:00:12 user nova-compute[72766]: DEBUG nova.compute.manager [req-0354d8f5-5dce-48bf-a66e-fbb57071f948 req-4d306737-1d32-4ed5-a2cd-537a9eba5476 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] No waiting events found dispatching network-vif-plugged-098834fb-ad7d-4032-9f2c-28b8a206d4c4 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:00:12 user nova-compute[72766]: WARNING nova.compute.manager [req-0354d8f5-5dce-48bf-a66e-fbb57071f948 req-4d306737-1d32-4ed5-a2cd-537a9eba5476 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received unexpected event network-vif-plugged-098834fb-ad7d-4032-9f2c-28b8a206d4c4 for instance with vm_state building and task_state spawning.
Aug 14 23:00:12 user nova-compute[72766]: DEBUG nova.compute.manager [req-0354d8f5-5dce-48bf-a66e-fbb57071f948 req-4d306737-1d32-4ed5-a2cd-537a9eba5476 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-vif-plugged-4ad9f734-e280-4596-a00e-672de5d6ecb6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:00:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0354d8f5-5dce-48bf-a66e-fbb57071f948 req-4d306737-1d32-4ed5-a2cd-537a9eba5476 service nova] Acquiring lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:00:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0354d8f5-5dce-48bf-a66e-fbb57071f948 req-4d306737-1d32-4ed5-a2cd-537a9eba5476 service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:00:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0354d8f5-5dce-48bf-a66e-fbb57071f948 req-4d306737-1d32-4ed5-a2cd-537a9eba5476 service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:00:12 user nova-compute[72766]: DEBUG nova.compute.manager [req-0354d8f5-5dce-48bf-a66e-fbb57071f948 req-4d306737-1d32-4ed5-a2cd-537a9eba5476 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] No waiting events found dispatching network-vif-plugged-4ad9f734-e280-4596-a00e-672de5d6ecb6 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:00:12 user nova-compute[72766]: WARNING nova.compute.manager [req-0354d8f5-5dce-48bf-a66e-fbb57071f948 req-4d306737-1d32-4ed5-a2cd-537a9eba5476 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received unexpected event network-vif-plugged-4ad9f734-e280-4596-a00e-672de5d6ecb6 for instance with vm_state building and task_state spawning.
Aug 14 23:00:12 user nova-compute[72766]: DEBUG nova.compute.manager [req-0354d8f5-5dce-48bf-a66e-fbb57071f948 req-4d306737-1d32-4ed5-a2cd-537a9eba5476 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-vif-plugged-4ad9f734-e280-4596-a00e-672de5d6ecb6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:00:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0354d8f5-5dce-48bf-a66e-fbb57071f948 req-4d306737-1d32-4ed5-a2cd-537a9eba5476 service nova] Acquiring lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:00:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0354d8f5-5dce-48bf-a66e-fbb57071f948 req-4d306737-1d32-4ed5-a2cd-537a9eba5476 service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:00:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0354d8f5-5dce-48bf-a66e-fbb57071f948 req-4d306737-1d32-4ed5-a2cd-537a9eba5476 service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:00:12 user nova-compute[72766]: DEBUG nova.compute.manager [req-0354d8f5-5dce-48bf-a66e-fbb57071f948 req-4d306737-1d32-4ed5-a2cd-537a9eba5476 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] No waiting events found dispatching network-vif-plugged-4ad9f734-e280-4596-a00e-672de5d6ecb6 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:00:12 user nova-compute[72766]: WARNING nova.compute.manager [req-0354d8f5-5dce-48bf-a66e-fbb57071f948 req-4d306737-1d32-4ed5-a2cd-537a9eba5476 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received unexpected event network-vif-plugged-4ad9f734-e280-4596-a00e-672de5d6ecb6 for instance with vm_state building and task_state spawning.
Aug 14 23:00:12 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:12 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:12 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:13 user nova-compute[72766]: DEBUG nova.compute.manager [req-ba3cecf1-c22a-4c43-a516-51ba236868ac req-1b82abb9-d58b-4a82-821e-c15a0edc59cd service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-vif-plugged-0d0642a2-a76e-4de1-956c-fb58280caec3 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:00:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ba3cecf1-c22a-4c43-a516-51ba236868ac req-1b82abb9-d58b-4a82-821e-c15a0edc59cd service nova] Acquiring lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:00:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ba3cecf1-c22a-4c43-a516-51ba236868ac req-1b82abb9-d58b-4a82-821e-c15a0edc59cd service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:00:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ba3cecf1-c22a-4c43-a516-51ba236868ac req-1b82abb9-d58b-4a82-821e-c15a0edc59cd service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:00:13 user nova-compute[72766]: DEBUG nova.compute.manager [req-ba3cecf1-c22a-4c43-a516-51ba236868ac req-1b82abb9-d58b-4a82-821e-c15a0edc59cd service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] No waiting events found dispatching network-vif-plugged-0d0642a2-a76e-4de1-956c-fb58280caec3 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:00:13 user nova-compute[72766]: WARNING nova.compute.manager [req-ba3cecf1-c22a-4c43-a516-51ba236868ac req-1b82abb9-d58b-4a82-821e-c15a0edc59cd service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received unexpected event network-vif-plugged-0d0642a2-a76e-4de1-956c-fb58280caec3 for instance with vm_state building and task_state spawning.
Aug 14 23:00:13 user nova-compute[72766]: DEBUG nova.compute.manager [req-ba3cecf1-c22a-4c43-a516-51ba236868ac req-1b82abb9-d58b-4a82-821e-c15a0edc59cd service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-vif-plugged-2774a932-7806-4c06-a128-e067a3072ebc {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:00:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ba3cecf1-c22a-4c43-a516-51ba236868ac req-1b82abb9-d58b-4a82-821e-c15a0edc59cd service nova] Acquiring lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:00:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ba3cecf1-c22a-4c43-a516-51ba236868ac req-1b82abb9-d58b-4a82-821e-c15a0edc59cd service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:00:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ba3cecf1-c22a-4c43-a516-51ba236868ac req-1b82abb9-d58b-4a82-821e-c15a0edc59cd service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:00:13 user nova-compute[72766]: DEBUG nova.compute.manager [req-ba3cecf1-c22a-4c43-a516-51ba236868ac req-1b82abb9-d58b-4a82-821e-c15a0edc59cd service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] No waiting events found dispatching network-vif-plugged-2774a932-7806-4c06-a128-e067a3072ebc {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:00:13 user nova-compute[72766]: WARNING nova.compute.manager [req-ba3cecf1-c22a-4c43-a516-51ba236868ac req-1b82abb9-d58b-4a82-821e-c15a0edc59cd service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received unexpected event network-vif-plugged-2774a932-7806-4c06-a128-e067a3072ebc for instance with vm_state building and task_state spawning.
Aug 14 23:00:13 user nova-compute[72766]: DEBUG nova.compute.manager [req-ba3cecf1-c22a-4c43-a516-51ba236868ac req-1b82abb9-d58b-4a82-821e-c15a0edc59cd service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-vif-plugged-2774a932-7806-4c06-a128-e067a3072ebc {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:00:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ba3cecf1-c22a-4c43-a516-51ba236868ac req-1b82abb9-d58b-4a82-821e-c15a0edc59cd service nova] Acquiring lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:00:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ba3cecf1-c22a-4c43-a516-51ba236868ac req-1b82abb9-d58b-4a82-821e-c15a0edc59cd service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:00:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ba3cecf1-c22a-4c43-a516-51ba236868ac req-1b82abb9-d58b-4a82-821e-c15a0edc59cd service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:00:13 user nova-compute[72766]: DEBUG nova.compute.manager [req-ba3cecf1-c22a-4c43-a516-51ba236868ac req-1b82abb9-d58b-4a82-821e-c15a0edc59cd service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] No waiting events found dispatching network-vif-plugged-2774a932-7806-4c06-a128-e067a3072ebc {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:00:13 user nova-compute[72766]: WARNING nova.compute.manager [req-ba3cecf1-c22a-4c43-a516-51ba236868ac req-1b82abb9-d58b-4a82-821e-c15a0edc59cd service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received unexpected event network-vif-plugged-2774a932-7806-4c06-a128-e067a3072ebc for instance with vm_state building and task_state spawning.
Aug 14 23:00:13 user nova-compute[72766]: DEBUG nova.compute.manager [req-ba3cecf1-c22a-4c43-a516-51ba236868ac req-1b82abb9-d58b-4a82-821e-c15a0edc59cd service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Received event network-changed-bb47713e-54a8-4834-a78d-749c5f72f334 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:00:13 user nova-compute[72766]: DEBUG nova.compute.manager [req-ba3cecf1-c22a-4c43-a516-51ba236868ac req-1b82abb9-d58b-4a82-821e-c15a0edc59cd service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Refreshing instance network info cache due to event network-changed-bb47713e-54a8-4834-a78d-749c5f72f334. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:00:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ba3cecf1-c22a-4c43-a516-51ba236868ac req-1b82abb9-d58b-4a82-821e-c15a0edc59cd service nova] Acquiring lock "refresh_cache-4d919875-5f24-4bed-bf26-cf437e0de3e2" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:00:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ba3cecf1-c22a-4c43-a516-51ba236868ac req-1b82abb9-d58b-4a82-821e-c15a0edc59cd service nova] Acquired lock "refresh_cache-4d919875-5f24-4bed-bf26-cf437e0de3e2" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:00:13 user nova-compute[72766]: DEBUG nova.network.neutron [req-ba3cecf1-c22a-4c43-a516-51ba236868ac req-1b82abb9-d58b-4a82-821e-c15a0edc59cd service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Refreshing network info cache for port bb47713e-54a8-4834-a78d-749c5f72f334 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:00:13 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:00:13 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:00:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:13 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Didn't find any instances for network info cache update. {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 23:00:13 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:00:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Acquiring lock "4d919875-5f24-4bed-bf26-cf437e0de3e2" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:00:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Lock "4d919875-5f24-4bed-bf26-cf437e0de3e2" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:00:13 user nova-compute[72766]: INFO nova.compute.manager [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Shelve offloading
Aug 14 23:00:14 user nova-compute[72766]: DEBUG nova.compute.manager [req-d735c085-68f7-4615-99ee-81cf1c7829f8 req-0271576a-c8df-4882-8c84-39249dab19c7 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-vif-plugged-5d0ea097-96cd-4d3b-8815-346a488703d2 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:00:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d735c085-68f7-4615-99ee-81cf1c7829f8 req-0271576a-c8df-4882-8c84-39249dab19c7 service nova] Acquiring lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:00:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d735c085-68f7-4615-99ee-81cf1c7829f8 req-0271576a-c8df-4882-8c84-39249dab19c7 service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:00:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d735c085-68f7-4615-99ee-81cf1c7829f8 req-0271576a-c8df-4882-8c84-39249dab19c7 service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:00:14 user nova-compute[72766]: DEBUG nova.compute.manager [req-d735c085-68f7-4615-99ee-81cf1c7829f8 req-0271576a-c8df-4882-8c84-39249dab19c7 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] No waiting events found dispatching network-vif-plugged-5d0ea097-96cd-4d3b-8815-346a488703d2 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:00:14 user nova-compute[72766]: WARNING nova.compute.manager [req-d735c085-68f7-4615-99ee-81cf1c7829f8 req-0271576a-c8df-4882-8c84-39249dab19c7 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received unexpected event network-vif-plugged-5d0ea097-96cd-4d3b-8815-346a488703d2 for instance with vm_state building and task_state spawning.
Aug 14 23:00:14 user nova-compute[72766]: DEBUG nova.compute.manager [req-d735c085-68f7-4615-99ee-81cf1c7829f8 req-0271576a-c8df-4882-8c84-39249dab19c7 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-vif-plugged-a9ba4ad3-e5eb-436a-8514-567d511f1999 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:00:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d735c085-68f7-4615-99ee-81cf1c7829f8 req-0271576a-c8df-4882-8c84-39249dab19c7 service nova] Acquiring lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:00:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d735c085-68f7-4615-99ee-81cf1c7829f8 req-0271576a-c8df-4882-8c84-39249dab19c7 service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:00:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d735c085-68f7-4615-99ee-81cf1c7829f8 req-0271576a-c8df-4882-8c84-39249dab19c7 service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:00:14 user nova-compute[72766]: DEBUG nova.compute.manager [req-d735c085-68f7-4615-99ee-81cf1c7829f8 req-0271576a-c8df-4882-8c84-39249dab19c7 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] No waiting events found dispatching network-vif-plugged-a9ba4ad3-e5eb-436a-8514-567d511f1999 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:00:14 user nova-compute[72766]: WARNING nova.compute.manager [req-d735c085-68f7-4615-99ee-81cf1c7829f8 req-0271576a-c8df-4882-8c84-39249dab19c7 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received unexpected event network-vif-plugged-a9ba4ad3-e5eb-436a-8514-567d511f1999 for instance with vm_state building and task_state spawning.
Aug 14 23:00:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:14 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054014.4053707, e503ad35-1d9e-47d8-9a25-58e2a503ff02 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:00:14 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] VM Resumed (Lifecycle Event)
Aug 14 23:00:14 user nova-compute[72766]: DEBUG nova.compute.manager [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:00:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 23:00:14 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:00:14 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Instance spawned successfully.
Aug 14 23:00:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 23:00:14 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:00:14 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:00:14 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054014.4084678, e503ad35-1d9e-47d8-9a25-58e2a503ff02 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:00:14 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] VM Started (Lifecycle Event)
Aug 14 23:00:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:00:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:00:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:00:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:00:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:00:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:00:14 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:00:14 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:00:14 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:00:14 user nova-compute[72766]: INFO nova.compute.manager [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Took 11.64 seconds to spawn the instance on the hypervisor.
Aug 14 23:00:14 user nova-compute[72766]: DEBUG nova.compute.manager [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:00:14 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:00:14 user nova-compute[72766]: INFO nova.compute.manager [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Took 45.86 seconds to build instance.
Aug 14 23:00:14 user nova-compute[72766]: DEBUG nova.network.neutron [req-ba3cecf1-c22a-4c43-a516-51ba236868ac req-1b82abb9-d58b-4a82-821e-c15a0edc59cd service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Updated VIF entry in instance network info cache for port bb47713e-54a8-4834-a78d-749c5f72f334. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:00:14 user nova-compute[72766]: DEBUG nova.network.neutron [req-ba3cecf1-c22a-4c43-a516-51ba236868ac req-1b82abb9-d58b-4a82-821e-c15a0edc59cd service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Updating instance_info_cache with network_info: [{"id": "bb47713e-54a8-4834-a78d-749c5f72f334", "address": "fa:16:3e:34:a4:4f", "network": {"id": "b151d906-14b7-466f-909c-18c6b9f1855d", "bridge": "br-int", "label": "tempest-TestShelveInstance-664463668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71798c25948f4c8cb02664413314a4e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb47713e-54", "ovs_interfaceid": "bb47713e-54a8-4834-a78d-749c5f72f334", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:00:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ba3cecf1-c22a-4c43-a516-51ba236868ac req-1b82abb9-d58b-4a82-821e-c15a0edc59cd service nova] Releasing lock "refresh_cache-4d919875-5f24-4bed-bf26-cf437e0de3e2" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:00:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-fe05ed8d-f309-4773-a2dc-4ee5fbf26098 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 46.058s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:00:14 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Instance destroyed successfully.
Aug 14 23:00:14 user nova-compute[72766]: DEBUG nova.compute.manager [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:00:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Acquiring lock "refresh_cache-4d919875-5f24-4bed-bf26-cf437e0de3e2" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:00:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Acquired lock "refresh_cache-4d919875-5f24-4bed-bf26-cf437e0de3e2" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:00:14 user nova-compute[72766]: DEBUG nova.network.neutron [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:00:15 user nova-compute[72766]: DEBUG nova.network.neutron [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Updating instance_info_cache with network_info: [{"id": "bb47713e-54a8-4834-a78d-749c5f72f334", "address": "fa:16:3e:34:a4:4f", "network": {"id": "b151d906-14b7-466f-909c-18c6b9f1855d", "bridge": "br-int", "label": "tempest-TestShelveInstance-664463668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71798c25948f4c8cb02664413314a4e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb47713e-54", "ovs_interfaceid": "bb47713e-54a8-4834-a78d-749c5f72f334", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:00:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Releasing lock "refresh_cache-4d919875-5f24-4bed-bf26-cf437e0de3e2" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:00:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "3ff300ff-34fd-4e94-9d2d-681fb133ba32" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:00:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "3ff300ff-34fd-4e94-9d2d-681fb133ba32" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:00:15 user nova-compute[72766]: DEBUG nova.compute.manager [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG nova.compute.manager [req-d515be86-8789-4d6d-9af6-bfbe2c1a00e3 req-65949d1a-a8c5-4688-ab40-bd38321b1cbc service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-vif-plugged-a9ba4ad3-e5eb-436a-8514-567d511f1999 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d515be86-8789-4d6d-9af6-bfbe2c1a00e3 req-65949d1a-a8c5-4688-ab40-bd38321b1cbc service nova] Acquiring lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d515be86-8789-4d6d-9af6-bfbe2c1a00e3 req-65949d1a-a8c5-4688-ab40-bd38321b1cbc service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d515be86-8789-4d6d-9af6-bfbe2c1a00e3 req-65949d1a-a8c5-4688-ab40-bd38321b1cbc service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG nova.compute.manager [req-d515be86-8789-4d6d-9af6-bfbe2c1a00e3 req-65949d1a-a8c5-4688-ab40-bd38321b1cbc service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] No waiting events found dispatching network-vif-plugged-a9ba4ad3-e5eb-436a-8514-567d511f1999 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:00:16 user nova-compute[72766]: WARNING nova.compute.manager [req-d515be86-8789-4d6d-9af6-bfbe2c1a00e3 req-65949d1a-a8c5-4688-ab40-bd38321b1cbc service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received unexpected event network-vif-plugged-a9ba4ad3-e5eb-436a-8514-567d511f1999 for instance with vm_state active and task_state None.
Aug 14 23:00:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 23:00:16 user nova-compute[72766]: INFO nova.compute.claims [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Claim successful on node user
Aug 14 23:00:16 user nova-compute[72766]: DEBUG nova.compute.manager [req-e8b1cc8e-b6b3-4a36-adc6-023953a91da8 req-b39291f7-38c3-460a-9142-3ae08ebc604c service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Received event network-vif-unplugged-bb47713e-54a8-4834-a78d-749c5f72f334 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e8b1cc8e-b6b3-4a36-adc6-023953a91da8 req-b39291f7-38c3-460a-9142-3ae08ebc604c service nova] Acquiring lock "4d919875-5f24-4bed-bf26-cf437e0de3e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e8b1cc8e-b6b3-4a36-adc6-023953a91da8 req-b39291f7-38c3-460a-9142-3ae08ebc604c service nova] Lock "4d919875-5f24-4bed-bf26-cf437e0de3e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e8b1cc8e-b6b3-4a36-adc6-023953a91da8 req-b39291f7-38c3-460a-9142-3ae08ebc604c service nova] Lock "4d919875-5f24-4bed-bf26-cf437e0de3e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG nova.compute.manager [req-e8b1cc8e-b6b3-4a36-adc6-023953a91da8 req-b39291f7-38c3-460a-9142-3ae08ebc604c service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] No waiting events found dispatching network-vif-unplugged-bb47713e-54a8-4834-a78d-749c5f72f334 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:00:16 user nova-compute[72766]: WARNING nova.compute.manager [req-e8b1cc8e-b6b3-4a36-adc6-023953a91da8 req-b39291f7-38c3-460a-9142-3ae08ebc604c service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Received unexpected event network-vif-unplugged-bb47713e-54a8-4834-a78d-749c5f72f334 for instance with vm_state active and task_state shelving.
Aug 14 23:00:16 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Instance destroyed successfully.
Aug 14 23:00:16 user nova-compute[72766]: DEBUG nova.objects.instance [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Lazy-loading 'resources' on Instance uuid 4d919875-5f24-4bed-bf26-cf437e0de3e2 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:58:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1732259896',display_name='tempest-TestShelveInstance-server-1732259896',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1732259896',id=12,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJttuZNcmSPPc5p7oQDHUy8DHRRj8VmSdgjSZwlMP/Wog2Lw20nrGzoNtOerf71zO0Z5VMVyCvpGcPQV7yHBlJjzeBcaszN5MzjHSpERf4DytlGuAt9s2fAouYBU+yBHwA==',key_name='tempest-TestShelveInstance-1877498323',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:58:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71798c25948f4c8cb02664413314a4e1',ramdisk_id='',reservation_id='r-yvm2m86y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1305179191',owner_user_name='tempest-TestShelveInstance-1305179191-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:58:35Z,user_data=None,user_id='d46f138a683742b09a91e1f10f085c18',uuid=4d919875-5f24-4bed-bf26-cf437e0de3e2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb47713e-54a8-4834-a78d-749c5f72f334", "address": "fa:16:3e:34:a4:4f", "network": {"id": "b151d906-14b7-466f-909c-18c6b9f1855d", "bridge": "br-int", "label": "tempest-TestShelveInstance-664463668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71798c25948f4c8cb02664413314a4e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb47713e-54", "ovs_interfaceid": "bb47713e-54a8-4834-a78d-749c5f72f334", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Converting VIF {"id": "bb47713e-54a8-4834-a78d-749c5f72f334", "address": "fa:16:3e:34:a4:4f", "network": {"id": "b151d906-14b7-466f-909c-18c6b9f1855d", "bridge": "br-int", "label": "tempest-TestShelveInstance-664463668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71798c25948f4c8cb02664413314a4e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb47713e-54", "ovs_interfaceid": "bb47713e-54a8-4834-a78d-749c5f72f334", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:a4:4f,bridge_name='br-int',has_traffic_filtering=True,id=bb47713e-54a8-4834-a78d-749c5f72f334,network=Network(b151d906-14b7-466f-909c-18c6b9f1855d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb47713e-54') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG os_vif [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:a4:4f,bridge_name='br-int',has_traffic_filtering=True,id=bb47713e-54a8-4834-a78d-749c5f72f334,network=Network(b151d906-14b7-466f-909c-18c6b9f1855d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb47713e-54') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbb47713e-54, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:16 user nova-compute[72766]: INFO os_vif [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:a4:4f,bridge_name='br-int',has_traffic_filtering=True,id=bb47713e-54a8-4834-a78d-749c5f72f334,network=Network(b151d906-14b7-466f-909c-18c6b9f1855d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb47713e-54')
Aug 14 23:00:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvezkmys', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:00:16 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:00:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b58553-fca0-4276-9e3c-c862b6404792]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[361d4ce4-64d5-4b56-9e3a-a79388123645]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 23:00:16 user nova-compute[72766]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 23:00:16 user nova-compute[72766]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)
Aug 14 23:00:16 user nova-compute[72766]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba (non-flash)
Aug 14 23:00:16 user nova-compute[72766]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d (non-flash)
Aug 14 23:00:16 user nova-compute[72766]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 (non-flash)
Aug 14 23:00:16 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 23:00:16 user nova-compute[72766]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 23:00:16 user nova-compute[72766]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)
Aug 14 23:00:16 user nova-compute[72766]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba (non-flash)
Aug 14 23:00:16 user nova-compute[72766]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d (non-flash)
Aug 14 23:00:16 user nova-compute[72766]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 (non-flash)
Aug 14 23:00:16 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff16c0ed510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886'): ({'sdc'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Removing single pathed devices sdc {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[da72be36-e1c7-4a28-b0f0-a94b53f3cb1d]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66e6141-0ec4-40ed-a4e7-875915ae53d8]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Flushing IO for device /dev/sdc {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[368d0bef-fbbf-4fe4-b7ec-e9300b783f34]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ed6aea-1cf7-426e-ab95-55982dfbd037]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] SCSI volumes sdc have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6c0e50-5bd8-4d4a-ad52-bf37c1d3df5a]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[36401fa7-f9ff-4542-a75d-9898fa52cc3d]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886, portal: 172.16.0.220,3260]
Aug 14 23:00:16 user nova-compute[72766]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886, portal: 172.16.0.220,3260] successful.
Aug 14 23:00:16 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.600s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG nova.compute.manager [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[7601d38c-c089-4ad9-b185-7a4fe6f35882]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] <== disconnect_volume: return (365ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:00:16 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Deleting instance files /opt/stack/data/nova/instances/4d919875-5f24-4bed-bf26-cf437e0de3e2_del
Aug 14 23:00:16 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Deletion of /opt/stack/data/nova/instances/4d919875-5f24-4bed-bf26-cf437e0de3e2_del complete
Aug 14 23:00:16 user nova-compute[72766]: DEBUG nova.compute.manager [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG nova.network.neutron [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 23:00:16 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 23:00:16 user nova-compute[72766]: DEBUG nova.compute.manager [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG nova.policy [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '32e61321c50d4af28adeab72811a3f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3725c4b1cd78403f9628c8af9f8e5cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG nova.compute.manager [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 23:00:16 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Creating image(s)
Aug 14 23:00:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "/opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "/opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "/opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:00:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.199s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:00:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:00:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.283s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk 1073741824 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk 1073741824" returned: 0 in 0.080s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.374s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:00:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:17 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:00:17 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:00:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.207s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:17 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk. size=1073741824 {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 23:00:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:17 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Deleted allocations for instance 4d919875-5f24-4bed-bf26-cf437e0de3e2
Aug 14 23:00:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:00:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:00:17 user nova-compute[72766]: DEBUG nova.objects.instance [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Lazy-loading 'numa_topology' on Instance uuid 4d919875-5f24-4bed-bf26-cf437e0de3e2 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:00:18 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:18 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Cannot resize image /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk to a smaller size. {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 23:00:18 user nova-compute[72766]: DEBUG nova.objects.instance [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lazy-loading 'migration_context' on Instance uuid 3ff300ff-34fd-4e94-9d2d-681fb133ba32 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:00:18 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 23:00:18 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Ensure instance console log exists: /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 23:00:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:00:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:00:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:00:18 user nova-compute[72766]: DEBUG nova.network.neutron [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Successfully created port: c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 23:00:18 user nova-compute[72766]: DEBUG nova.compute.manager [req-36f91c2a-1198-47a7-a146-4615f7f39b45 req-aad44f07-60b1-4c17-939a-44e9420bc214 service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Received event network-changed-bb47713e-54a8-4834-a78d-749c5f72f334 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:00:18 user nova-compute[72766]: DEBUG nova.compute.manager [req-36f91c2a-1198-47a7-a146-4615f7f39b45 req-aad44f07-60b1-4c17-939a-44e9420bc214 service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Refreshing instance network info cache due to event network-changed-bb47713e-54a8-4834-a78d-749c5f72f334. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:00:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-36f91c2a-1198-47a7-a146-4615f7f39b45 req-aad44f07-60b1-4c17-939a-44e9420bc214 service nova] Acquiring lock "refresh_cache-4d919875-5f24-4bed-bf26-cf437e0de3e2" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:00:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-36f91c2a-1198-47a7-a146-4615f7f39b45 req-aad44f07-60b1-4c17-939a-44e9420bc214 service nova] Acquired lock "refresh_cache-4d919875-5f24-4bed-bf26-cf437e0de3e2" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:00:18 user nova-compute[72766]: DEBUG nova.network.neutron [req-36f91c2a-1198-47a7-a146-4615f7f39b45 req-aad44f07-60b1-4c17-939a-44e9420bc214 service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Refreshing network info cache for port bb47713e-54a8-4834-a78d-749c5f72f334 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:00:18 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:00:18 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:00:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.452s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:00:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7493516c-fc30-4b37-b5ab-d5b39ae6210e tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Lock "4d919875-5f24-4bed-bf26-cf437e0de3e2" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.534s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:00:18 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:00:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:00:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:00:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:00:18 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG nova.network.neutron [req-36f91c2a-1198-47a7-a146-4615f7f39b45 req-aad44f07-60b1-4c17-939a-44e9420bc214 service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Updated VIF entry in instance network info cache for port bb47713e-54a8-4834-a78d-749c5f72f334. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG nova.network.neutron [req-36f91c2a-1198-47a7-a146-4615f7f39b45 req-aad44f07-60b1-4c17-939a-44e9420bc214 service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Updating instance_info_cache with network_info: [{"id": "bb47713e-54a8-4834-a78d-749c5f72f334", "address": "fa:16:3e:34:a4:4f", "network": {"id": "b151d906-14b7-466f-909c-18c6b9f1855d", "bridge": null, "label": "tempest-TestShelveInstance-664463668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71798c25948f4c8cb02664413314a4e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapbb47713e-54", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-36f91c2a-1198-47a7-a146-4615f7f39b45 req-aad44f07-60b1-4c17-939a-44e9420bc214 service nova] Releasing lock "refresh_cache-4d919875-5f24-4bed-bf26-cf437e0de3e2" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG nova.network.neutron [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Successfully updated port: c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "refresh_cache-3ff300ff-34fd-4e94-9d2d-681fb133ba32" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquired lock "refresh_cache-3ff300ff-34fd-4e94-9d2d-681fb133ba32" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG nova.network.neutron [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG nova.network.neutron [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG nova.network.neutron [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Updating instance_info_cache with network_info: [{"id": "c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d", "address": "fa:16:3e:67:f9:a0", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46ab9cb-e6", "ovs_interfaceid": "c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Releasing lock "refresh_cache-3ff300ff-34fd-4e94-9d2d-681fb133ba32" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG nova.compute.manager [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Instance network_info: |[{"id": "c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d", "address": "fa:16:3e:67:f9:a0", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46ab9cb-e6", "ovs_interfaceid": "c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Start _get_guest_xml network_info=[{"id": "c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d", "address": "fa:16:3e:67:f9:a0", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46ab9cb-e6", "ovs_interfaceid": "c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd2900d30-2c4c-4d57-9135-d45564c0c596'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:00:19 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:00:19 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:00:19 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:00:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1502527097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1502527097',id=17,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3725c4b1cd78403f9628c8af9f8e5cc5',ramdisk_id='',reservation_id='r-mxh22qu1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-86235447',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:00:17Z,user_data=None,user_id='32e61321c50d4af28adeab72811a3f86',uuid=3ff300ff-34fd-4e94-9d2d-681fb133ba32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d", "address": "fa:16:3e:67:f9:a0", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46ab9cb-e6", "ovs_interfaceid": "c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Converting VIF {"id": "c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d", "address": "fa:16:3e:67:f9:a0", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46ab9cb-e6", "ovs_interfaceid": "c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:f9:a0,bridge_name='br-int',has_traffic_filtering=True,id=c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d,network=Network(f4efdeee-d89b-45e5-b0d9-b45573564e9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc46ab9cb-e6') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG nova.objects.instance [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lazy-loading 'pci_devices' on Instance uuid 3ff300ff-34fd-4e94-9d2d-681fb133ba32 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:00:19 user nova-compute[72766]:   <uuid>3ff300ff-34fd-4e94-9d2d-681fb133ba32</uuid>
Aug 14 23:00:19 user nova-compute[72766]:   <name>instance-00000011</name>
Aug 14 23:00:19 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:00:19 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:00:19 user nova-compute[72766]:   <metadata>
Aug 14 23:00:19 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:00:19 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:00:19 user nova-compute[72766]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1502527097</nova:name>
Aug 14 23:00:19 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:00:19</nova:creationTime>
Aug 14 23:00:19 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:00:19 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:00:19 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:00:19 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:00:19 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:00:19 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:00:19 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:00:19 user nova-compute[72766]:       <nova:owner>
Aug 14 23:00:19 user nova-compute[72766]:         <nova:user uuid="32e61321c50d4af28adeab72811a3f86">tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member</nova:user>
Aug 14 23:00:19 user nova-compute[72766]:         <nova:project uuid="3725c4b1cd78403f9628c8af9f8e5cc5">tempest-ServerBootFromVolumeStableRescueTest-86235447</nova:project>
Aug 14 23:00:19 user nova-compute[72766]:       </nova:owner>
Aug 14 23:00:19 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 23:00:19 user nova-compute[72766]:       <nova:ports>
Aug 14 23:00:19 user nova-compute[72766]:         <nova:port uuid="c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d">
Aug 14 23:00:19 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 23:00:19 user nova-compute[72766]:         </nova:port>
Aug 14 23:00:19 user nova-compute[72766]:       </nova:ports>
Aug 14 23:00:19 user nova-compute[72766]:     </nova:instance>
Aug 14 23:00:19 user nova-compute[72766]:   </metadata>
Aug 14 23:00:19 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:00:19 user nova-compute[72766]:     <system>
Aug 14 23:00:19 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:00:19 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:00:19 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:00:19 user nova-compute[72766]:       <entry name="serial">3ff300ff-34fd-4e94-9d2d-681fb133ba32</entry>
Aug 14 23:00:19 user nova-compute[72766]:       <entry name="uuid">3ff300ff-34fd-4e94-9d2d-681fb133ba32</entry>
Aug 14 23:00:19 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:00:19 user nova-compute[72766]:     </system>
Aug 14 23:00:19 user nova-compute[72766]:   </sysinfo>
Aug 14 23:00:19 user nova-compute[72766]:   <os>
Aug 14 23:00:19 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:00:19 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:00:19 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:00:19 user nova-compute[72766]:   </os>
Aug 14 23:00:19 user nova-compute[72766]:   <features>
Aug 14 23:00:19 user nova-compute[72766]:     <acpi/>
Aug 14 23:00:19 user nova-compute[72766]:     <apic/>
Aug 14 23:00:19 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:00:19 user nova-compute[72766]:   </features>
Aug 14 23:00:19 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:00:19 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:00:19 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:00:19 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:00:19 user nova-compute[72766]:   </clock>
Aug 14 23:00:19 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:00:19 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:00:19 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:00:19 user nova-compute[72766]:   </cpu>
Aug 14 23:00:19 user nova-compute[72766]:   <devices>
Aug 14 23:00:19 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 23:00:19 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 23:00:19 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk"/>
Aug 14 23:00:19 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:00:19 user nova-compute[72766]:     </disk>
Aug 14 23:00:19 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:00:19 user nova-compute[72766]:       <mac address="fa:16:3e:67:f9:a0"/>
Aug 14 23:00:19 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:00:19 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:00:19 user nova-compute[72766]:       <target dev="tapc46ab9cb-e6"/>
Aug 14 23:00:19 user nova-compute[72766]:     </interface>
Aug 14 23:00:19 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:00:19 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/console.log" append="off"/>
Aug 14 23:00:19 user nova-compute[72766]:     </serial>
Aug 14 23:00:19 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:00:19 user nova-compute[72766]:     <video>
Aug 14 23:00:19 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:00:19 user nova-compute[72766]:     </video>
Aug 14 23:00:19 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:00:19 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:00:19 user nova-compute[72766]:     </rng>
Aug 14 23:00:19 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:00:19 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:00:19 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:00:19 user nova-compute[72766]:     </memballoon>
Aug 14 23:00:19 user nova-compute[72766]:   </devices>
Aug 14 23:00:19 user nova-compute[72766]: </domain>
Aug 14 23:00:19 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:00:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1502527097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1502527097',id=17,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3725c4b1cd78403f9628c8af9f8e5cc5',ramdisk_id='',reservation_id='r-mxh22qu1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-86235447',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:00:17Z,user_data=None,user_id='32e61321c50d4af28adeab72811a3f86',uuid=3ff300ff-34fd-4e94-9d2d-681fb133ba32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d", "address": "fa:16:3e:67:f9:a0", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46ab9cb-e6", "ovs_interfaceid": "c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Converting VIF {"id": "c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d", "address": "fa:16:3e:67:f9:a0", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46ab9cb-e6", "ovs_interfaceid": "c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:f9:a0,bridge_name='br-int',has_traffic_filtering=True,id=c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d,network=Network(f4efdeee-d89b-45e5-b0d9-b45573564e9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc46ab9cb-e6') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG os_vif [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:f9:a0,bridge_name='br-int',has_traffic_filtering=True,id=c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d,network=Network(f4efdeee-d89b-45e5-b0d9-b45573564e9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc46ab9cb-e6') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc46ab9cb-e6, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc46ab9cb-e6, col_values=(('external_ids', {'iface-id': 'c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:f9:a0', 'vm-uuid': '3ff300ff-34fd-4e94-9d2d-681fb133ba32'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:19 user nova-compute[72766]: INFO os_vif [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:f9:a0,bridge_name='br-int',has_traffic_filtering=True,id=c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d,network=Network(f4efdeee-d89b-45e5-b0d9-b45573564e9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc46ab9cb-e6')
Aug 14 23:00:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0850bb6c-6e3e-4007-8478-8eba53089158/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:00:19 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] No VIF found with MAC fa:16:3e:67:f9:a0, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:00:20 user nova-compute[72766]: DEBUG nova.compute.manager [req-8b1a7e88-d14d-4847-a86f-60f8ddea33a7 req-882c34a9-3e64-4107-8b0e-7043e72fdcfd service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-vif-plugged-0c7d05ab-1414-4892-a28e-18b3816a1040 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:00:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8b1a7e88-d14d-4847-a86f-60f8ddea33a7 req-882c34a9-3e64-4107-8b0e-7043e72fdcfd service nova] Acquiring lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:00:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8b1a7e88-d14d-4847-a86f-60f8ddea33a7 req-882c34a9-3e64-4107-8b0e-7043e72fdcfd service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:00:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8b1a7e88-d14d-4847-a86f-60f8ddea33a7 req-882c34a9-3e64-4107-8b0e-7043e72fdcfd service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:00:20 user nova-compute[72766]: DEBUG nova.compute.manager [req-8b1a7e88-d14d-4847-a86f-60f8ddea33a7 req-882c34a9-3e64-4107-8b0e-7043e72fdcfd service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] No waiting events found dispatching network-vif-plugged-0c7d05ab-1414-4892-a28e-18b3816a1040 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:00:20 user nova-compute[72766]: WARNING nova.compute.manager [req-8b1a7e88-d14d-4847-a86f-60f8ddea33a7 req-882c34a9-3e64-4107-8b0e-7043e72fdcfd service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received unexpected event network-vif-plugged-0c7d05ab-1414-4892-a28e-18b3816a1040 for instance with vm_state active and task_state None.
Aug 14 23:00:20 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0850bb6c-6e3e-4007-8478-8eba53089158/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:20 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0850bb6c-6e3e-4007-8478-8eba53089158/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:20 user nova-compute[72766]: DEBUG nova.compute.manager [req-2b49c65c-173a-4679-8446-849ce40fa19d req-194ee691-c772-488a-9e20-0594e298c3b5 service nova] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Received event network-changed-c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:00:20 user nova-compute[72766]: DEBUG nova.compute.manager [req-2b49c65c-173a-4679-8446-849ce40fa19d req-194ee691-c772-488a-9e20-0594e298c3b5 service nova] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Refreshing instance network info cache due to event network-changed-c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:00:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2b49c65c-173a-4679-8446-849ce40fa19d req-194ee691-c772-488a-9e20-0594e298c3b5 service nova] Acquiring lock "refresh_cache-3ff300ff-34fd-4e94-9d2d-681fb133ba32" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:00:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2b49c65c-173a-4679-8446-849ce40fa19d req-194ee691-c772-488a-9e20-0594e298c3b5 service nova] Acquired lock "refresh_cache-3ff300ff-34fd-4e94-9d2d-681fb133ba32" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:00:20 user nova-compute[72766]: DEBUG nova.network.neutron [req-2b49c65c-173a-4679-8446-849ce40fa19d req-194ee691-c772-488a-9e20-0594e298c3b5 service nova] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Refreshing network info cache for port c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:00:20 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0850bb6c-6e3e-4007-8478-8eba53089158/disk --force-share --output=json" returned: 0 in 0.315s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:20 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:00:20 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:20 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:20 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:20 user nova-compute[72766]: DEBUG nova.network.neutron [req-2b49c65c-173a-4679-8446-849ce40fa19d req-194ee691-c772-488a-9e20-0594e298c3b5 service nova] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Updated VIF entry in instance network info cache for port c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:00:20 user nova-compute[72766]: DEBUG nova.network.neutron [req-2b49c65c-173a-4679-8446-849ce40fa19d req-194ee691-c772-488a-9e20-0594e298c3b5 service nova] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Updating instance_info_cache with network_info: [{"id": "c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d", "address": "fa:16:3e:67:f9:a0", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46ab9cb-e6", "ovs_interfaceid": "c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:00:20 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:20 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:00:20 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2b49c65c-173a-4679-8446-849ce40fa19d req-194ee691-c772-488a-9e20-0594e298c3b5 service nova] Releasing lock "refresh_cache-3ff300ff-34fd-4e94-9d2d-681fb133ba32" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:00:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk.rescue --force-share --output=json" returned: 0 in 0.242s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c02e6fd7-e712-45da-b35b-2fe21675e2f1/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c02e6fd7-e712-45da-b35b-2fe21675e2f1/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c02e6fd7-e712-45da-b35b-2fe21675e2f1/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c02e6fd7-e712-45da-b35b-2fe21675e2f1/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:21 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:00:21 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:00:21 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:00:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:22 user nova-compute[72766]: DEBUG nova.compute.manager [req-c16d2207-2f9d-4629-808a-f3eae2b73eb2 req-20181e46-6218-4d79-8ec4-fc794a6e30e5 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-vif-plugged-0c7d05ab-1414-4892-a28e-18b3816a1040 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:00:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-c16d2207-2f9d-4629-808a-f3eae2b73eb2 req-20181e46-6218-4d79-8ec4-fc794a6e30e5 service nova] Acquiring lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:00:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-c16d2207-2f9d-4629-808a-f3eae2b73eb2 req-20181e46-6218-4d79-8ec4-fc794a6e30e5 service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:00:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-c16d2207-2f9d-4629-808a-f3eae2b73eb2 req-20181e46-6218-4d79-8ec4-fc794a6e30e5 service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:00:22 user nova-compute[72766]: DEBUG nova.compute.manager [req-c16d2207-2f9d-4629-808a-f3eae2b73eb2 req-20181e46-6218-4d79-8ec4-fc794a6e30e5 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] No waiting events found dispatching network-vif-plugged-0c7d05ab-1414-4892-a28e-18b3816a1040 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:00:22 user nova-compute[72766]: WARNING nova.compute.manager [req-c16d2207-2f9d-4629-808a-f3eae2b73eb2 req-20181e46-6218-4d79-8ec4-fc794a6e30e5 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received unexpected event network-vif-plugged-0c7d05ab-1414-4892-a28e-18b3816a1040 for instance with vm_state active and task_state None.
Aug 14 23:00:22 user nova-compute[72766]: DEBUG nova.compute.manager [req-c16d2207-2f9d-4629-808a-f3eae2b73eb2 req-20181e46-6218-4d79-8ec4-fc794a6e30e5 service nova] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Received event network-vif-plugged-c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:00:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-c16d2207-2f9d-4629-808a-f3eae2b73eb2 req-20181e46-6218-4d79-8ec4-fc794a6e30e5 service nova] Acquiring lock "3ff300ff-34fd-4e94-9d2d-681fb133ba32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:00:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-c16d2207-2f9d-4629-808a-f3eae2b73eb2 req-20181e46-6218-4d79-8ec4-fc794a6e30e5 service nova] Lock "3ff300ff-34fd-4e94-9d2d-681fb133ba32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:00:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-c16d2207-2f9d-4629-808a-f3eae2b73eb2 req-20181e46-6218-4d79-8ec4-fc794a6e30e5 service nova] Lock "3ff300ff-34fd-4e94-9d2d-681fb133ba32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:00:22 user nova-compute[72766]: DEBUG nova.compute.manager [req-c16d2207-2f9d-4629-808a-f3eae2b73eb2 req-20181e46-6218-4d79-8ec4-fc794a6e30e5 service nova] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] No waiting events found dispatching network-vif-plugged-c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:00:22 user nova-compute[72766]: WARNING nova.compute.manager [req-c16d2207-2f9d-4629-808a-f3eae2b73eb2 req-20181e46-6218-4d79-8ec4-fc794a6e30e5 service nova] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Received unexpected event network-vif-plugged-c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d for instance with vm_state building and task_state spawning.
Aug 14 23:00:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:24 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054023.8096929, 3ff300ff-34fd-4e94-9d2d-681fb133ba32 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:00:24 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] VM Resumed (Lifecycle Event)
Aug 14 23:00:24 user nova-compute[72766]: DEBUG nova.compute.manager [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:00:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 23:00:24 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:00:24 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:00:24 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=7259MB free_disk=25.62015151977539GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:00:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:00:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:00:24 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Instance spawned successfully.
Aug 14 23:00:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 23:00:24 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:00:24 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:00:24 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:00:24 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054023.8110104, 3ff300ff-34fd-4e94-9d2d-681fb133ba32 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:00:24 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] VM Started (Lifecycle Event)
Aug 14 23:00:24 user nova-compute[72766]: DEBUG nova.compute.manager [req-d671e195-9db9-4b7e-8755-6097a75f7ba3 req-a0e042bb-bf84-4f3d-b8a9-99c98ec746ff service nova] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Received event network-vif-plugged-c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:00:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d671e195-9db9-4b7e-8755-6097a75f7ba3 req-a0e042bb-bf84-4f3d-b8a9-99c98ec746ff service nova] Acquiring lock "3ff300ff-34fd-4e94-9d2d-681fb133ba32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:00:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d671e195-9db9-4b7e-8755-6097a75f7ba3 req-a0e042bb-bf84-4f3d-b8a9-99c98ec746ff service nova] Lock "3ff300ff-34fd-4e94-9d2d-681fb133ba32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:00:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d671e195-9db9-4b7e-8755-6097a75f7ba3 req-a0e042bb-bf84-4f3d-b8a9-99c98ec746ff service nova] Lock "3ff300ff-34fd-4e94-9d2d-681fb133ba32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:00:24 user nova-compute[72766]: DEBUG nova.compute.manager [req-d671e195-9db9-4b7e-8755-6097a75f7ba3 req-a0e042bb-bf84-4f3d-b8a9-99c98ec746ff service nova] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] No waiting events found dispatching network-vif-plugged-c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:00:24 user nova-compute[72766]: WARNING nova.compute.manager [req-d671e195-9db9-4b7e-8755-6097a75f7ba3 req-a0e042bb-bf84-4f3d-b8a9-99c98ec746ff service nova] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Received unexpected event network-vif-plugged-c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d for instance with vm_state building and task_state spawning.
Aug 14 23:00:24 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:00:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:00:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:00:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:00:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:00:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:00:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:00:24 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:00:24 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:00:24 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance b563c62d-d117-4bb5-9157-7387c51ed641 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:00:24 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:00:24 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 0850bb6c-6e3e-4007-8478-8eba53089158 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:00:24 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance a9d6011c-da14-4fcc-8e31-3063db57b2a6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:00:24 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance c3c0a004-8d70-4253-bf17-b83088e30031 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:00:24 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:00:24 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance c02e6fd7-e712-45da-b35b-2fe21675e2f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:00:24 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance e503ad35-1d9e-47d8-9a25-58e2a503ff02 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:00:24 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 78f02883-99a1-493d-b6be-e43500bfba37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:00:24 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 3ff300ff-34fd-4e94-9d2d-681fb133ba32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:00:24 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:00:24 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:00:24 user nova-compute[72766]: INFO nova.compute.manager [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Took 7.36 seconds to spawn the instance on the hypervisor.
Aug 14 23:00:24 user nova-compute[72766]: DEBUG nova.compute.manager [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:00:24 user nova-compute[72766]: INFO nova.compute.manager [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Took 8.38 seconds to build instance.
Aug 14 23:00:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-12798ba3-e8f0-41fb-96f4-d862ad7b7def tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "3ff300ff-34fd-4e94-9d2d-681fb133ba32" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.495s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:00:24 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:00:24 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:00:24 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:00:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.574s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:00:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:25 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:00:25 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:00:25 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:00:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:29 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692054014.814407, 4d919875-5f24-4bed-bf26-cf437e0de3e2 => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:00:29 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] VM Stopped (Lifecycle Event)
Aug 14 23:00:29 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f24d0c7f-442b-4129-84d9-159cf8e84953 None None] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:00:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Acquiring lock "c3c0a004-8d70-4253-bf17-b83088e30031" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:00:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "c3c0a004-8d70-4253-bf17-b83088e30031" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:00:39 user nova-compute[72766]: DEBUG nova.objects.instance [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lazy-loading 'flavor' on Instance uuid c3c0a004-8d70-4253-bf17-b83088e30031 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:00:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "c3c0a004-8d70-4253-bf17-b83088e30031" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:00:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Acquiring lock "c3c0a004-8d70-4253-bf17-b83088e30031" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:00:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "c3c0a004-8d70-4253-bf17-b83088e30031" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:00:39 user nova-compute[72766]: INFO nova.compute.manager [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Attaching volume 90db1894-a790-4f27-84c6-e6224875a291 to /dev/vdb
Aug 14 23:00:39 user nova-compute[72766]: DEBUG os_brick.utils [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:00:39 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:39 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:39 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d169784a-f4ec-4416-a609-525f8d3e8fa9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:39 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:39 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:39 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c1c67c-cb95-4cb0-8ff3-8db30519d49c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:39 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:39 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:39 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea08d3ea-479c-46a1-8f3f-16e086958717]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:39 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bac971d-8102-48e7-a79d-bcc1804e7ef2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:39 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:39 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:00:39 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 23:00:39 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:39 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:00:39 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 23:00:39 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94239ff-1ca6-449c-9c98-cd1ba142ff04]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:39 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 23:00:39 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 23:00:39 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 23:00:39 user nova-compute[72766]: DEBUG os_brick.utils [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:00:39 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Updating existing volume attachment record: c9c5daa7-d240-4702-80aa-36d0dee34ae1 {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 23:00:39 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:44 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Acquiring lock "a9d6011c-da14-4fcc-8e31-3063db57b2a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:00:44 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Lock "a9d6011c-da14-4fcc-8e31-3063db57b2a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:00:44 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Acquiring lock "a9d6011c-da14-4fcc-8e31-3063db57b2a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:00:44 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Lock "a9d6011c-da14-4fcc-8e31-3063db57b2a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:00:44 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Lock "a9d6011c-da14-4fcc-8e31-3063db57b2a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:00:44 user nova-compute[72766]: INFO nova.compute.manager [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Terminating instance
Aug 14 23:00:44 user nova-compute[72766]: DEBUG nova.compute.manager [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:00:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:45 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Instance destroyed successfully.
Aug 14 23:00:45 user nova-compute[72766]: DEBUG nova.objects.instance [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Lazy-loading 'resources' on Instance uuid a9d6011c-da14-4fcc-8e31-3063db57b2a6 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T22:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1337014418',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-273402320',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPaXy9hxXbMdshWzbQLXVvz7nDESavIOLXia9W/DDo7wSvfhX1RXq42V2N0aLa9Nl7IVLmCAYxoggrECsnBwocK7ffwayiXoTZ4mdKpIHRx8EnNL76GFfNmkvMKW2r7fg==',key_name='tempest-keypair-855485889',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:59:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2299692e42b74c9c85a255f80990e870',ramdisk_id='',reservation_id='r-f401gegj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1913842238',owner_user_name='tempest-ServerActionsV293TestJSON-1913842238-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:59:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e0c74f355e34ec6b175e136f6401b20',uuid=a9d6011c-da14-4fcc-8e31-3063db57b2a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "abead9ae-b0f3-474a-b77a-91733d6d3543", "address": "fa:16:3e:c8:a4:ce", "network": {"id": "58367c0d-d2f6-441c-8a2f-310e045b9cf0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-296205787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2299692e42b74c9c85a255f80990e870", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabead9ae-b0", "ovs_interfaceid": "abead9ae-b0f3-474a-b77a-91733d6d3543", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Converting VIF {"id": "abead9ae-b0f3-474a-b77a-91733d6d3543", "address": "fa:16:3e:c8:a4:ce", "network": {"id": "58367c0d-d2f6-441c-8a2f-310e045b9cf0", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-296205787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2299692e42b74c9c85a255f80990e870", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabead9ae-b0", "ovs_interfaceid": "abead9ae-b0f3-474a-b77a-91733d6d3543", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:a4:ce,bridge_name='br-int',has_traffic_filtering=True,id=abead9ae-b0f3-474a-b77a-91733d6d3543,network=Network(58367c0d-d2f6-441c-8a2f-310e045b9cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabead9ae-b0') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG os_vif [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:a4:ce,bridge_name='br-int',has_traffic_filtering=True,id=abead9ae-b0f3-474a-b77a-91733d6d3543,network=Network(58367c0d-d2f6-441c-8a2f-310e045b9cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabead9ae-b0') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapabead9ae-b0, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:00:45 user nova-compute[72766]: INFO os_vif [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:a4:ce,bridge_name='br-int',has_traffic_filtering=True,id=abead9ae-b0f3-474a-b77a-91733d6d3543,network=Network(58367c0d-d2f6-441c-8a2f-310e045b9cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabead9ae-b0')
Aug 14 23:00:45 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wjbIlVOW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:00:45 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:00:45 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[84db5639-ffc2-40cc-9635-34015d962649]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8284e032-6412-4d61-98c2-f1c40534fc96]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 23:00:45 user nova-compute[72766]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)
Aug 14 23:00:45 user nova-compute[72766]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba (non-flash)
Aug 14 23:00:45 user nova-compute[72766]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d (non-flash)
Aug 14 23:00:45 user nova-compute[72766]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 (non-flash)
Aug 14 23:00:45 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 (non-flash)
Aug 14 23:00:45 user nova-compute[72766]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)
Aug 14 23:00:45 user nova-compute[72766]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba (non-flash)
Aug 14 23:00:45 user nova-compute[72766]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d (non-flash)
Aug 14 23:00:45 user nova-compute[72766]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 (non-flash)
Aug 14 23:00:45 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff154422050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9'): ({'sdb'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Removing single pathed devices sdb {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[860a6eff-9aaa-452b-a997-28fb0e05ce62]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c65630c-382d-401a-ab22-d5ace95347e9]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Flushing IO for device /dev/sdb {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d43456-5859-492b-9866-9cf20f399dee]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[599a1434-a5d5-4d43-9bb1-6a1433e81114]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] SCSI volumes sdb have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOdf0bdb2e-2eba9dec74caa8bc', '/dev/disk/by-id/scsi-23265626139646563', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_df0bdb2e') {{(pid=83651) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d994eb-8ac8-474f-8002-13676e649933]: (4, None) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da50a86-b187-4708-a41b-b40e2104ec33]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45e8516-1f15-4999-b2fd-e5c09cf7ff79]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9, portal: 172.16.0.220,3260]
Aug 14 23:00:45 user nova-compute[72766]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9, portal: 172.16.0.220,3260] successful.
Aug 14 23:00:45 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdfde062-9b2c-45a4-be3a-eccc18e9cef9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d7d4bd-8670-479a-a6d1-0849656dedb5]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] <== disconnect_volume: return (351ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:00:45 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Deleting instance files /opt/stack/data/nova/instances/a9d6011c-da14-4fcc-8e31-3063db57b2a6_del
Aug 14 23:00:45 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Deletion of /opt/stack/data/nova/instances/a9d6011c-da14-4fcc-8e31-3063db57b2a6_del complete
Aug 14 23:00:45 user nova-compute[72766]: INFO nova.compute.manager [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Took 1.25 seconds to destroy the instance on the hypervisor.
Aug 14 23:00:45 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG nova.compute.manager [req-4f3574a4-fe31-4b62-9080-3be7fa21d2b7 req-c79f38ed-26f3-4a6e-9f6f-8f96051e1acc service nova] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Received event network-vif-unplugged-abead9ae-b0f3-474a-b77a-91733d6d3543 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-4f3574a4-fe31-4b62-9080-3be7fa21d2b7 req-c79f38ed-26f3-4a6e-9f6f-8f96051e1acc service nova] Acquiring lock "a9d6011c-da14-4fcc-8e31-3063db57b2a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-4f3574a4-fe31-4b62-9080-3be7fa21d2b7 req-c79f38ed-26f3-4a6e-9f6f-8f96051e1acc service nova] Lock "a9d6011c-da14-4fcc-8e31-3063db57b2a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-4f3574a4-fe31-4b62-9080-3be7fa21d2b7 req-c79f38ed-26f3-4a6e-9f6f-8f96051e1acc service nova] Lock "a9d6011c-da14-4fcc-8e31-3063db57b2a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG nova.compute.manager [req-4f3574a4-fe31-4b62-9080-3be7fa21d2b7 req-c79f38ed-26f3-4a6e-9f6f-8f96051e1acc service nova] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] No waiting events found dispatching network-vif-unplugged-abead9ae-b0f3-474a-b77a-91733d6d3543 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:00:45 user nova-compute[72766]: DEBUG nova.compute.manager [req-4f3574a4-fe31-4b62-9080-3be7fa21d2b7 req-c79f38ed-26f3-4a6e-9f6f-8f96051e1acc service nova] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Received event network-vif-unplugged-abead9ae-b0f3-474a-b77a-91733d6d3543 for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:00:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:47 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:00:47 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Took 1.23 seconds to deallocate network for instance.
Aug 14 23:00:47 user nova-compute[72766]: DEBUG nova.compute.manager [req-605f22a9-d968-4f86-b297-c3755a2aeff0 req-6b00ace5-4c37-41b6-b842-e7fc2ea38c5d service nova] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Received event network-vif-deleted-abead9ae-b0f3-474a-b77a-91733d6d3543 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:00:47 user nova-compute[72766]: INFO nova.compute.manager [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Took 0.83 seconds to detach 1 volumes for instance.
Aug 14 23:00:48 user nova-compute[72766]: DEBUG nova.compute.manager [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Deleting volume: bdfde062-9b2c-45a4-be3a-eccc18e9cef9 {{(pid=72766) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 23:00:48 user nova-compute[72766]: DEBUG nova.compute.manager [req-0ef8339c-8c6a-4e74-95aa-2068df5ffe78 req-7a83c787-6ced-4398-b466-648050e02199 service nova] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Received event network-vif-plugged-abead9ae-b0f3-474a-b77a-91733d6d3543 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:00:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0ef8339c-8c6a-4e74-95aa-2068df5ffe78 req-7a83c787-6ced-4398-b466-648050e02199 service nova] Acquiring lock "a9d6011c-da14-4fcc-8e31-3063db57b2a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:00:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0ef8339c-8c6a-4e74-95aa-2068df5ffe78 req-7a83c787-6ced-4398-b466-648050e02199 service nova] Lock "a9d6011c-da14-4fcc-8e31-3063db57b2a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:00:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0ef8339c-8c6a-4e74-95aa-2068df5ffe78 req-7a83c787-6ced-4398-b466-648050e02199 service nova] Lock "a9d6011c-da14-4fcc-8e31-3063db57b2a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:00:48 user nova-compute[72766]: DEBUG nova.compute.manager [req-0ef8339c-8c6a-4e74-95aa-2068df5ffe78 req-7a83c787-6ced-4398-b466-648050e02199 service nova] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] No waiting events found dispatching network-vif-plugged-abead9ae-b0f3-474a-b77a-91733d6d3543 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:00:48 user nova-compute[72766]: WARNING nova.compute.manager [req-0ef8339c-8c6a-4e74-95aa-2068df5ffe78 req-7a83c787-6ced-4398-b466-648050e02199 service nova] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Received unexpected event network-vif-plugged-abead9ae-b0f3-474a-b77a-91733d6d3543 for instance with vm_state active and task_state deleting.
Aug 14 23:00:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:00:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:00:48 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:00:48 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:00:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.348s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:00:48 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Deleted allocations for instance a9d6011c-da14-4fcc-8e31-3063db57b2a6
Aug 14 23:00:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-3fe6ef51-cdf0-4b68-a023-4a3fe6c708d8 tempest-ServerActionsV293TestJSON-1913842238 tempest-ServerActionsV293TestJSON-1913842238-project-member] Lock "a9d6011c-da14-4fcc-8e31-3063db57b2a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.962s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dRgpnONx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:00:49 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:00:49 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:00:49 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:00:49 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:00:49 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 23:00:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291 -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[598cda57-218c-47cd-962d-2db7d7fbb732]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 23:00:49 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291 -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[7552db8d-2378-4104-b6af-41dbf37b9570]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291] added
Aug 14 23:00:49 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f4d080-bc82-4b06-8b8d-8b72776bfd76]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[861b1998-73ab-47c0-be29-38a27dc69ee0]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dRgpnONx {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dRgpnONx" returned: 0 in 0.025s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e476466-d86f-4419-8f7f-d1018ee86166]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dRgpnONx'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19a6d07-acf7-4066-ba88-b68fbf43433b]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fb2c28-8d81-4d52-91d8-0727704c90b2]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)
Aug 14 23:00:49 user nova-compute[72766]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba (non-flash)
Aug 14 23:00:49 user nova-compute[72766]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d (non-flash)
Aug 14 23:00:49 user nova-compute[72766]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 (non-flash)
Aug 14 23:00:49 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)
Aug 14 23:00:49 user nova-compute[72766]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba (non-flash)
Aug 14 23:00:49 user nova-compute[72766]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d (non-flash)
Aug 14 23:00:49 user nova-compute[72766]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 (non-flash)
Aug 14 23:00:49 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291 -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d87724-cc20-48bb-9ec6-25dd52242fa7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291, portal: 172.16.0.220,3260]
Aug 14 23:00:49 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291, portal: 172.16.0.220,3260] successful.
Aug 14 23:00:49 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf84aa73-b0fd-4f63-9a7a-aeb5e4139370]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[966ebb4f-8779-4af8-95f3-2f628b4407cd]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)
Aug 14 23:00:49 user nova-compute[72766]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba (non-flash)
Aug 14 23:00:49 user nova-compute[72766]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d (non-flash)
Aug 14 23:00:49 user nova-compute[72766]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 (non-flash)
Aug 14 23:00:49 user nova-compute[72766]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291 (non-flash)
Aug 14 23:00:49 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)
Aug 14 23:00:49 user nova-compute[72766]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba (non-flash)
Aug 14 23:00:49 user nova-compute[72766]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d (non-flash)
Aug 14 23:00:49 user nova-compute[72766]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 (non-flash)
Aug 14 23:00:49 user nova-compute[72766]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291 (non-flash)
Aug 14 23:00:49 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7293e3-9736-474a-a75f-1e1a9330f720]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:00:49 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dRgpnONx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 23:00:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:50 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:00:50 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '26134666439303063', 'path': '/dev/sdb'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:00:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134666439303063', 'path': '/dev/sdb'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 23:00:50 user nova-compute[72766]: DEBUG nova.objects.instance [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lazy-loading 'flavor' on Instance uuid c3c0a004-8d70-4253-bf17-b83088e30031 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:00:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 23:00:50 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:00:50 user nova-compute[72766]:   <source dev="/dev/sdb"/>
Aug 14 23:00:50 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:00:50 user nova-compute[72766]:   <serial>90db1894-a790-4f27-84c6-e6224875a291</serial>
Aug 14 23:00:50 user nova-compute[72766]: </disk>
Aug 14 23:00:50 user nova-compute[72766]:  {{(pid=72766) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 23:00:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:00:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:00:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] No VIF found with MAC fa:16:3e:96:85:b3, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:00:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-92f4e0b8-c563-4725-9a10-1162f24c1614 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "c3c0a004-8d70-4253-bf17-b83088e30031" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.111s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:00:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-0e19225e-db03-437e-87ec-ad1ffbacc602 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Acquiring lock "bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:00:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-0e19225e-db03-437e-87ec-ad1ffbacc602 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lock "bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:00:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-0e19225e-db03-437e-87ec-ad1ffbacc602 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Acquiring lock "bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:00:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-0e19225e-db03-437e-87ec-ad1ffbacc602 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lock "bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:00:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-0e19225e-db03-437e-87ec-ad1ffbacc602 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lock "bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:00:53 user nova-compute[72766]: INFO nova.compute.manager [None req-0e19225e-db03-437e-87ec-ad1ffbacc602 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Terminating instance
Aug 14 23:00:53 user nova-compute[72766]: DEBUG nova.compute.manager [None req-0e19225e-db03-437e-87ec-ad1ffbacc602 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:00:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:53 user nova-compute[72766]: DEBUG nova.compute.manager [req-816d6c4c-ba81-4007-908b-dd0c85f1e385 req-bd65dacb-3807-480d-8879-4df0d7f6a20c service nova] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Received event network-vif-unplugged-ad1ca253-760e-4db4-864a-bef71de4c1b7 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:00:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-816d6c4c-ba81-4007-908b-dd0c85f1e385 req-bd65dacb-3807-480d-8879-4df0d7f6a20c service nova] Acquiring lock "bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:00:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-816d6c4c-ba81-4007-908b-dd0c85f1e385 req-bd65dacb-3807-480d-8879-4df0d7f6a20c service nova] Lock "bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:00:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-816d6c4c-ba81-4007-908b-dd0c85f1e385 req-bd65dacb-3807-480d-8879-4df0d7f6a20c service nova] Lock "bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:00:53 user nova-compute[72766]: DEBUG nova.compute.manager [req-816d6c4c-ba81-4007-908b-dd0c85f1e385 req-bd65dacb-3807-480d-8879-4df0d7f6a20c service nova] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] No waiting events found dispatching network-vif-unplugged-ad1ca253-760e-4db4-864a-bef71de4c1b7 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:00:53 user nova-compute[72766]: DEBUG nova.compute.manager [req-816d6c4c-ba81-4007-908b-dd0c85f1e385 req-bd65dacb-3807-480d-8879-4df0d7f6a20c service nova] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Received event network-vif-unplugged-ad1ca253-760e-4db4-864a-bef71de4c1b7 for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:00:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:53 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Instance destroyed successfully.
Aug 14 23:00:53 user nova-compute[72766]: DEBUG nova.objects.instance [None req-0e19225e-db03-437e-87ec-ad1ffbacc602 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lazy-loading 'resources' on Instance uuid bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:00:53 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-0e19225e-db03-437e-87ec-ad1ffbacc602 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:58:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1740119132',display_name='tempest-VolumesAdminNegativeTest-server-1740119132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1740119132',id=13,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:59:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61a77920bef94526816c1a9c95531cb2',ramdisk_id='',reservation_id='r-1lwxb7i5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1115082797',owner_user_name='tempest-VolumesAdminNegativeTest-1115082797-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:59:02Z,user_data=None,user_id='d7df5fafd6ca47179dec9cd295c46233',uuid=bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad1ca253-760e-4db4-864a-bef71de4c1b7", "address": "fa:16:3e:a1:12:c3", "network": {"id": "9bdd38f5-9734-4c5a-8a1c-5296215e6944", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1610393487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61a77920bef94526816c1a9c95531cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1ca253-76", "ovs_interfaceid": "ad1ca253-760e-4db4-864a-bef71de4c1b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:00:53 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-0e19225e-db03-437e-87ec-ad1ffbacc602 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Converting VIF {"id": "ad1ca253-760e-4db4-864a-bef71de4c1b7", "address": "fa:16:3e:a1:12:c3", "network": {"id": "9bdd38f5-9734-4c5a-8a1c-5296215e6944", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1610393487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61a77920bef94526816c1a9c95531cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad1ca253-76", "ovs_interfaceid": "ad1ca253-760e-4db4-864a-bef71de4c1b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:00:53 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-0e19225e-db03-437e-87ec-ad1ffbacc602 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:12:c3,bridge_name='br-int',has_traffic_filtering=True,id=ad1ca253-760e-4db4-864a-bef71de4c1b7,network=Network(9bdd38f5-9734-4c5a-8a1c-5296215e6944),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad1ca253-76') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:00:53 user nova-compute[72766]: DEBUG os_vif [None req-0e19225e-db03-437e-87ec-ad1ffbacc602 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:12:c3,bridge_name='br-int',has_traffic_filtering=True,id=ad1ca253-760e-4db4-864a-bef71de4c1b7,network=Network(9bdd38f5-9734-4c5a-8a1c-5296215e6944),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad1ca253-76') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:00:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad1ca253-76, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:00:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:00:53 user nova-compute[72766]: INFO os_vif [None req-0e19225e-db03-437e-87ec-ad1ffbacc602 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:12:c3,bridge_name='br-int',has_traffic_filtering=True,id=ad1ca253-760e-4db4-864a-bef71de4c1b7,network=Network(9bdd38f5-9734-4c5a-8a1c-5296215e6944),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad1ca253-76')
Aug 14 23:00:53 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-0e19225e-db03-437e-87ec-ad1ffbacc602 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Deleting instance files /opt/stack/data/nova/instances/bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a_del
Aug 14 23:00:53 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-0e19225e-db03-437e-87ec-ad1ffbacc602 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Deletion of /opt/stack/data/nova/instances/bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a_del complete
Aug 14 23:00:53 user nova-compute[72766]: INFO nova.compute.manager [None req-0e19225e-db03-437e-87ec-ad1ffbacc602 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Took 0.71 seconds to destroy the instance on the hypervisor.
Aug 14 23:00:53 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-0e19225e-db03-437e-87ec-ad1ffbacc602 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:00:53 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:00:53 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ebc4a000-4a14-4415-b755-553bc2e4bb68 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Acquiring lock "c3c0a004-8d70-4253-bf17-b83088e30031" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ebc4a000-4a14-4415-b755-553bc2e4bb68 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "c3c0a004-8d70-4253-bf17-b83088e30031" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:00:54 user nova-compute[72766]: INFO nova.compute.manager [None req-ebc4a000-4a14-4415-b755-553bc2e4bb68 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Detaching volume 90db1894-a790-4f27-84c6-e6224875a291
Aug 14 23:00:54 user nova-compute[72766]: INFO nova.virt.block_device [None req-ebc4a000-4a14-4415-b755-553bc2e4bb68 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Attempting to driver detach volume 90db1894-a790-4f27-84c6-e6224875a291 from mountpoint /dev/vdb
Aug 14 23:00:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ebc4a000-4a14-4415-b755-553bc2e4bb68 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Attempting to detach device vdb from instance c3c0a004-8d70-4253-bf17-b83088e30031 from the persistent domain config. {{(pid=72766) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-ebc4a000-4a14-4415-b755-553bc2e4bb68 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 23:00:54 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:00:54 user nova-compute[72766]:   <source dev="/dev/sdb"/>
Aug 14 23:00:54 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:00:54 user nova-compute[72766]:   <serial>90db1894-a790-4f27-84c6-e6224875a291</serial>
Aug 14 23:00:54 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 23:00:54 user nova-compute[72766]: </disk>
Aug 14 23:00:54 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 23:00:54 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-ebc4a000-4a14-4415-b755-553bc2e4bb68 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Successfully detached device vdb from instance c3c0a004-8d70-4253-bf17-b83088e30031 from the persistent domain config.
Aug 14 23:00:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ebc4a000-4a14-4415-b755-553bc2e4bb68 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c3c0a004-8d70-4253-bf17-b83088e30031 from the live domain config. {{(pid=72766) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-ebc4a000-4a14-4415-b755-553bc2e4bb68 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 23:00:54 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:00:54 user nova-compute[72766]:   <source dev="/dev/sdb"/>
Aug 14 23:00:54 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:00:54 user nova-compute[72766]:   <serial>90db1894-a790-4f27-84c6-e6224875a291</serial>
Aug 14 23:00:54 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 23:00:54 user nova-compute[72766]: </disk>
Aug 14 23:00:54 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:00:54 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Took 0.56 seconds to deallocate network for instance.
Aug 14 23:00:54 user nova-compute[72766]: DEBUG nova.compute.manager [req-77389b84-3b10-4caa-a228-40ccc3f93db8 req-9ad1dabb-0f50-4144-a61a-7e008e4f6ca6 service nova] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Received event network-vif-deleted-ad1ca253-760e-4db4-864a-bef71de4c1b7 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:00:54 user nova-compute[72766]: INFO nova.compute.manager [req-77389b84-3b10-4caa-a228-40ccc3f93db8 req-9ad1dabb-0f50-4144-a61a-7e008e4f6ca6 service nova] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Neutron deleted interface ad1ca253-760e-4db4-864a-bef71de4c1b7; detaching it from the instance and deleting it from the info cache
Aug 14 23:00:54 user nova-compute[72766]: DEBUG nova.network.neutron [req-77389b84-3b10-4caa-a228-40ccc3f93db8 req-9ad1dabb-0f50-4144-a61a-7e008e4f6ca6 service nova] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG nova.compute.manager [req-77389b84-3b10-4caa-a228-40ccc3f93db8 req-9ad1dabb-0f50-4144-a61a-7e008e4f6ca6 service nova] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Detach interface failed, port_id=ad1ca253-760e-4db4-864a-bef71de4c1b7, reason: Instance bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a could not be found. {{(pid=72766) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-0e19225e-db03-437e-87ec-ad1ffbacc602 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-0e19225e-db03-437e-87ec-ad1ffbacc602 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Received event <DeviceRemovedEvent: 1692054054.6889825, c3c0a004-8d70-4253-bf17-b83088e30031 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72766) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ebc4a000-4a14-4415-b755-553bc2e4bb68 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c3c0a004-8d70-4253-bf17-b83088e30031 {{(pid=72766) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 23:00:54 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-ebc4a000-4a14-4415-b755-553bc2e4bb68 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Successfully detached device vdb from instance c3c0a004-8d70-4253-bf17-b83088e30031 from the live domain config.
Aug 14 23:00:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebc4a000-4a14-4415-b755-553bc2e4bb68 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc4a000-4a14-4415-b755-553bc2e4bb68 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dRgpnONx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:00:54 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-ebc4a000-4a14-4415-b755-553bc2e4bb68 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:00:54 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-ebc4a000-4a14-4415-b755-553bc2e4bb68 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-ebc4a000-4a14-4415-b755-553bc2e4bb68 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc4a000-4a14-4415-b755-553bc2e4bb68 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-0e19225e-db03-437e-87ec-ad1ffbacc602 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[7875d8b7-e545-465c-9cda-196b06ef72a6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-0e19225e-db03-437e-87ec-ad1ffbacc602 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[0971025d-2ddc-4d91-b5c2-2437c2f3ad38]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc4a000-4a14-4415-b755-553bc2e4bb68 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)
Aug 14 23:00:54 user nova-compute[72766]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba (non-flash)
Aug 14 23:00:54 user nova-compute[72766]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d (non-flash)
Aug 14 23:00:54 user nova-compute[72766]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 (non-flash)
Aug 14 23:00:54 user nova-compute[72766]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291 (non-flash)
Aug 14 23:00:54 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc4a000-4a14-4415-b755-553bc2e4bb68 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)
Aug 14 23:00:54 user nova-compute[72766]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba (non-flash)
Aug 14 23:00:54 user nova-compute[72766]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d (non-flash)
Aug 14 23:00:54 user nova-compute[72766]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 (non-flash)
Aug 14 23:00:54 user nova-compute[72766]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291 (non-flash)
Aug 14 23:00:54 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc4a000-4a14-4415-b755-553bc2e4bb68 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff154439fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291'): ({'sdb'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-ebc4a000-4a14-4415-b755-553bc2e4bb68 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Removing single pathed devices sdb {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-0e19225e-db03-437e-87ec-ad1ffbacc602 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46a388e-09a3-4d04-9d88-c9386d5a31c8]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[34575bbd-d166-45d5-a0a4-3c6463197c54]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-ebc4a000-4a14-4415-b755-553bc2e4bb68 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Flushing IO for device /dev/sdb {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0523bed-f50d-4889-9408-f0cf0ff9e964]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-ebc4a000-4a14-4415-b755-553bc2e4bb68 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.065s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f146a8-4b1d-44a9-8f02-d865859067d1]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-ebc4a000-4a14-4415-b755-553bc2e4bb68 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-ebc4a000-4a14-4415-b755-553bc2e4bb68 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] SCSI volumes sdb have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc4a000-4a14-4415-b755-553bc2e4bb68 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:00:54 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-0e19225e-db03-437e-87ec-ad1ffbacc602 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Deleted allocations for instance bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a
Aug 14 23:00:54 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e768af74-0390-4d96-b0fa-1250ea988616]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc4a000-4a14-4415-b755-553bc2e4bb68 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291 -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-0e19225e-db03-437e-87ec-ad1ffbacc602 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lock "bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.876s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:54 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[685bea8c-cdcb-4eb1-8d28-a814a6530f67]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:55 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc4a000-4a14-4415-b755-553bc2e4bb68 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291, portal: 172.16.0.220,3260]
Aug 14 23:00:55 user nova-compute[72766]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291, portal: 172.16.0.220,3260] successful.
Aug 14 23:00:55 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:00:55 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291 -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:00:55 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90db1894-a790-4f27-84c6-e6224875a291 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:00:55 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43fc098-4642-4123-a54a-42e35567e465]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:00:55 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc4a000-4a14-4415-b755-553bc2e4bb68 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:00:55 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-ebc4a000-4a14-4415-b755-553bc2e4bb68 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:00:55 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc4a000-4a14-4415-b755-553bc2e4bb68 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] <== disconnect_volume: return (326ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:00:55 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebc4a000-4a14-4415-b755-553bc2e4bb68 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:00:55 user nova-compute[72766]: DEBUG nova.compute.manager [req-11bd15e6-b959-47b1-953d-c2faf2b4c735 req-acce2dfc-8888-4cd3-9999-0642c6daec55 service nova] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Received event network-vif-plugged-ad1ca253-760e-4db4-864a-bef71de4c1b7 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:00:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-11bd15e6-b959-47b1-953d-c2faf2b4c735 req-acce2dfc-8888-4cd3-9999-0642c6daec55 service nova] Acquiring lock "bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:00:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-11bd15e6-b959-47b1-953d-c2faf2b4c735 req-acce2dfc-8888-4cd3-9999-0642c6daec55 service nova] Lock "bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:00:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-11bd15e6-b959-47b1-953d-c2faf2b4c735 req-acce2dfc-8888-4cd3-9999-0642c6daec55 service nova] Lock "bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:00:55 user nova-compute[72766]: DEBUG nova.compute.manager [req-11bd15e6-b959-47b1-953d-c2faf2b4c735 req-acce2dfc-8888-4cd3-9999-0642c6daec55 service nova] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] No waiting events found dispatching network-vif-plugged-ad1ca253-760e-4db4-864a-bef71de4c1b7 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:00:55 user nova-compute[72766]: WARNING nova.compute.manager [req-11bd15e6-b959-47b1-953d-c2faf2b4c735 req-acce2dfc-8888-4cd3-9999-0642c6daec55 service nova] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Received unexpected event network-vif-plugged-ad1ca253-760e-4db4-864a-bef71de4c1b7 for instance with vm_state deleted and task_state None.
Aug 14 23:00:55 user nova-compute[72766]: DEBUG nova.objects.instance [None req-ebc4a000-4a14-4415-b755-553bc2e4bb68 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lazy-loading 'flavor' on Instance uuid c3c0a004-8d70-4253-bf17-b83088e30031 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:00:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ebc4a000-4a14-4415-b755-553bc2e4bb68 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "c3c0a004-8d70-4253-bf17-b83088e30031" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.760s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:00:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:00:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:00 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692054045.4416687, a9d6011c-da14-4fcc-8e31-3063db57b2a6 => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:01:00 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] VM Stopped (Lifecycle Event)
Aug 14 23:01:00 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2e56e9b-6e39-4306-9efa-b4b7c1bbe425 None None] [instance: a9d6011c-da14-4fcc-8e31-3063db57b2a6] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:01:00 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:05 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:08 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692054053.707618, bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:01:08 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] VM Stopped (Lifecycle Event)
Aug 14 23:01:08 user nova-compute[72766]: DEBUG nova.compute.manager [None req-e81331f7-8607-40e0-82f4-0ef85cda5e7d None None] [instance: bdf76a3e-61c4-4e2a-9405-77bf4f03ef5a] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:01:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:08 user nova-compute[72766]: DEBUG nova.compute.manager [req-b95908a0-92a8-436f-8bdb-1d637edef7d1 req-4c02cfbf-c122-4073-a283-5425ccaf4d59 service nova] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Received event network-changed-3b9abe2a-2056-403c-bc2e-97bff0d04648 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:01:08 user nova-compute[72766]: DEBUG nova.compute.manager [req-b95908a0-92a8-436f-8bdb-1d637edef7d1 req-4c02cfbf-c122-4073-a283-5425ccaf4d59 service nova] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Refreshing instance network info cache due to event network-changed-3b9abe2a-2056-403c-bc2e-97bff0d04648. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:01:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-b95908a0-92a8-436f-8bdb-1d637edef7d1 req-4c02cfbf-c122-4073-a283-5425ccaf4d59 service nova] Acquiring lock "refresh_cache-c02e6fd7-e712-45da-b35b-2fe21675e2f1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:01:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-b95908a0-92a8-436f-8bdb-1d637edef7d1 req-4c02cfbf-c122-4073-a283-5425ccaf4d59 service nova] Acquired lock "refresh_cache-c02e6fd7-e712-45da-b35b-2fe21675e2f1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:01:08 user nova-compute[72766]: DEBUG nova.network.neutron [req-b95908a0-92a8-436f-8bdb-1d637edef7d1 req-4c02cfbf-c122-4073-a283-5425ccaf4d59 service nova] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Refreshing network info cache for port 3b9abe2a-2056-403c-bc2e-97bff0d04648 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:01:09 user nova-compute[72766]: DEBUG nova.network.neutron [req-b95908a0-92a8-436f-8bdb-1d637edef7d1 req-4c02cfbf-c122-4073-a283-5425ccaf4d59 service nova] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Updated VIF entry in instance network info cache for port 3b9abe2a-2056-403c-bc2e-97bff0d04648. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:01:09 user nova-compute[72766]: DEBUG nova.network.neutron [req-b95908a0-92a8-436f-8bdb-1d637edef7d1 req-4c02cfbf-c122-4073-a283-5425ccaf4d59 service nova] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Updating instance_info_cache with network_info: [{"id": "3b9abe2a-2056-403c-bc2e-97bff0d04648", "address": "fa:16:3e:3e:c1:d6", "network": {"id": "4b9625cb-278d-447f-8309-577dc3b6532f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2056420710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2a15ce46cf545a8bd6e8e93f12a70a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9abe2a-20", "ovs_interfaceid": "3b9abe2a-2056-403c-bc2e-97bff0d04648", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:01:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-b95908a0-92a8-436f-8bdb-1d637edef7d1 req-4c02cfbf-c122-4073-a283-5425ccaf4d59 service nova] Releasing lock "refresh_cache-c02e6fd7-e712-45da-b35b-2fe21675e2f1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:01:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Acquiring lock "c02e6fd7-e712-45da-b35b-2fe21675e2f1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:01:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Lock "c02e6fd7-e712-45da-b35b-2fe21675e2f1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:01:13 user nova-compute[72766]: DEBUG nova.objects.instance [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Lazy-loading 'flavor' on Instance uuid c02e6fd7-e712-45da-b35b-2fe21675e2f1 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:01:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Lock "c02e6fd7-e712-45da-b35b-2fe21675e2f1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:01:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Acquiring lock "c02e6fd7-e712-45da-b35b-2fe21675e2f1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:01:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Lock "c02e6fd7-e712-45da-b35b-2fe21675e2f1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:01:13 user nova-compute[72766]: INFO nova.compute.manager [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Attaching volume 423f7a5d-4684-430d-a086-5fa5ce06c358 to /dev/vdb
Aug 14 23:01:13 user nova-compute[72766]: DEBUG os_brick.utils [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:01:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[892020f7-9c74-4919-9b35-84399aaa6190]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[521ff7a0-c3ba-483f-9c53-1652c58b4108]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a2a2f0-3c1c-4316-b01e-63a6a0dec319]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[6941ff2e-0554-4f41-9206-4ea1495d60f2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:01:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 23:01:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:01:13 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 23:01:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e6458f-0e80-4d0a-a692-b321ae0740b5]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 23:01:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 23:01:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 23:01:13 user nova-compute[72766]: DEBUG os_brick.utils [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:01:13 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Updating existing volume attachment record: 975a6e57-406f-46b0-a5d6-2773936550f1 {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 23:01:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:15 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:01:15 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:01:15 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Rebuilding the list of instances to heal {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 23:01:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-b563c62d-d117-4bb5-9157-7387c51ed641" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:01:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-b563c62d-d117-4bb5-9157-7387c51ed641" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:01:15 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:01:15 user nova-compute[72766]: DEBUG nova.objects.instance [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lazy-loading 'info_cache' on Instance uuid b563c62d-d117-4bb5-9157-7387c51ed641 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:01:16 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Updating instance_info_cache with network_info: [{"id": "1663df0b-566c-4588-a5e1-5082de0e3bcf", "address": "fa:16:3e:b7:97:01", "network": {"id": "5464d98e-0483-4d6d-895b-b51c50c0cfd9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-581355694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142137ab929f4e5289b06319af10751b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1663df0b-56", "ovs_interfaceid": "1663df0b-566c-4588-a5e1-5082de0e3bcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:01:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-b563c62d-d117-4bb5-9157-7387c51ed641" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:01:16 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:01:16 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:01:16 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:01:16 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72766) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 23:01:16 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:01:16 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:01:16 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:01:17 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:01:17 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Cleaning up deleted instances {{(pid=72766) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 23:01:17 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] There are 0 instances to clean {{(pid=72766) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 23:01:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:18 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:01:18 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:01:18 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:01:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:19 user nova-compute[72766]: INFO nova.compute.manager [None req-6f5fca43-9d81-48a9-b389-be36904567d6 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Unrescuing
Aug 14 23:01:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6f5fca43-9d81-48a9-b389-be36904567d6 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Acquiring lock "refresh_cache-87712dfd-d67b-4e5e-a75d-ca2dd7c764b1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:01:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6f5fca43-9d81-48a9-b389-be36904567d6 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Acquired lock "refresh_cache-87712dfd-d67b-4e5e-a75d-ca2dd7c764b1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:01:19 user nova-compute[72766]: DEBUG nova.network.neutron [None req-6f5fca43-9d81-48a9-b389-be36904567d6 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:01:19 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:01:19 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:01:19 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:01:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:01:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:01:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:01:19 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:01:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:20 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:20 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:20 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:20 user nova-compute[72766]: DEBUG nova.network.neutron [None req-6f5fca43-9d81-48a9-b389-be36904567d6 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Updating instance_info_cache with network_info: [{"id": "baa7e0c2-91d4-4077-8405-abb537475df2", "address": "fa:16:3e:88:35:14", "network": {"id": "aff4f146-97db-4102-abf1-6528e74cad55", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1894452367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6942d31258304de68c9f7f8bb9304acb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa7e0c2-91", "ovs_interfaceid": "baa7e0c2-91d4-4077-8405-abb537475df2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:01:20 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6f5fca43-9d81-48a9-b389-be36904567d6 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Releasing lock "refresh_cache-87712dfd-d67b-4e5e-a75d-ca2dd7c764b1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:01:20 user nova-compute[72766]: DEBUG nova.objects.instance [None req-6f5fca43-9d81-48a9-b389-be36904567d6 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lazy-loading 'flavor' on Instance uuid 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:01:20 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:20 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:20 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:20 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:20 user nova-compute[72766]: DEBUG nova.compute.manager [req-6512517a-0f56-4b5a-822e-aa9f40bd93a0 req-ac2bd7cf-1d8c-4771-a42a-c71f2d27e2b4 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-changed-098834fb-ad7d-4032-9f2c-28b8a206d4c4 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:01:20 user nova-compute[72766]: DEBUG nova.compute.manager [req-6512517a-0f56-4b5a-822e-aa9f40bd93a0 req-ac2bd7cf-1d8c-4771-a42a-c71f2d27e2b4 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Refreshing instance network info cache due to event network-changed-098834fb-ad7d-4032-9f2c-28b8a206d4c4. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:01:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-6512517a-0f56-4b5a-822e-aa9f40bd93a0 req-ac2bd7cf-1d8c-4771-a42a-c71f2d27e2b4 service nova] Acquiring lock "refresh_cache-e503ad35-1d9e-47d8-9a25-58e2a503ff02" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:01:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-6512517a-0f56-4b5a-822e-aa9f40bd93a0 req-ac2bd7cf-1d8c-4771-a42a-c71f2d27e2b4 service nova] Acquired lock "refresh_cache-e503ad35-1d9e-47d8-9a25-58e2a503ff02" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:01:20 user nova-compute[72766]: DEBUG nova.network.neutron [req-6512517a-0f56-4b5a-822e-aa9f40bd93a0 req-ac2bd7cf-1d8c-4771-a42a-c71f2d27e2b4 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Refreshing network info cache for port 098834fb-ad7d-4032-9f2c-28b8a206d4c4 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:01:20 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:20 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:20 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:20 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0850bb6c-6e3e-4007-8478-8eba53089158/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:20 user nova-compute[72766]: DEBUG nova.compute.manager [req-6b2db2ee-d4cf-4ce2-8c9a-e826c4c0f201 req-e8042825-8e54-48b7-8cb2-41d9c9d3e5b0 service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Received event network-vif-unplugged-baa7e0c2-91d4-4077-8405-abb537475df2 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:01:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-6b2db2ee-d4cf-4ce2-8c9a-e826c4c0f201 req-e8042825-8e54-48b7-8cb2-41d9c9d3e5b0 service nova] Acquiring lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:01:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-6b2db2ee-d4cf-4ce2-8c9a-e826c4c0f201 req-e8042825-8e54-48b7-8cb2-41d9c9d3e5b0 service nova] Lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:01:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-6b2db2ee-d4cf-4ce2-8c9a-e826c4c0f201 req-e8042825-8e54-48b7-8cb2-41d9c9d3e5b0 service nova] Lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:01:20 user nova-compute[72766]: DEBUG nova.compute.manager [req-6b2db2ee-d4cf-4ce2-8c9a-e826c4c0f201 req-e8042825-8e54-48b7-8cb2-41d9c9d3e5b0 service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] No waiting events found dispatching network-vif-unplugged-baa7e0c2-91d4-4077-8405-abb537475df2 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:01:20 user nova-compute[72766]: WARNING nova.compute.manager [req-6b2db2ee-d4cf-4ce2-8c9a-e826c4c0f201 req-e8042825-8e54-48b7-8cb2-41d9c9d3e5b0 service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Received unexpected event network-vif-unplugged-baa7e0c2-91d4-4077-8405-abb537475df2 for instance with vm_state rescued and task_state unrescuing.
Aug 14 23:01:20 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0850bb6c-6e3e-4007-8478-8eba53089158/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:20 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0850bb6c-6e3e-4007-8478-8eba53089158/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0850bb6c-6e3e-4007-8478-8eba53089158/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:21 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Instance destroyed successfully.
Aug 14 23:01:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:21 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:01:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:21 user nova-compute[72766]: DEBUG nova.network.neutron [req-6512517a-0f56-4b5a-822e-aa9f40bd93a0 req-ac2bd7cf-1d8c-4771-a42a-c71f2d27e2b4 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Updated VIF entry in instance network info cache for port 098834fb-ad7d-4032-9f2c-28b8a206d4c4. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:01:21 user nova-compute[72766]: DEBUG nova.network.neutron [req-6512517a-0f56-4b5a-822e-aa9f40bd93a0 req-ac2bd7cf-1d8c-4771-a42a-c71f2d27e2b4 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Updating instance_info_cache with network_info: [{"id": "098834fb-ad7d-4032-9f2c-28b8a206d4c4", "address": "fa:16:3e:5e:72:4a", "network": {"id": "6991af8d-255f-45a5-8be0-f6d851affa68", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1760061206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap098834fb-ad", "ovs_interfaceid": "098834fb-ad7d-4032-9f2c-28b8a206d4c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ad9f734-e280-4596-a00e-672de5d6ecb6", "address": "fa:16:3e:8c:7f:fe", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ad9f734-e2", "ovs_interfaceid": "4ad9f734-e280-4596-a00e-672de5d6ecb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5d0ea097-96cd-4d3b-8815-346a488703d2", "address": "fa:16:3e:46:88:4e", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0ea097-96", "ovs_interfaceid": "5d0ea097-96cd-4d3b-8815-346a488703d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0d0642a2-a76e-4de1-956c-fb58280caec3", "address": "fa:16:3e:d9:c2:f7", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d0642a2-a7", "ovs_interfaceid": "0d0642a2-a76e-4de1-956c-fb58280caec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a9ba4ad3-e5eb-436a-8514-567d511f1999", "address": "fa:16:3e:30:f6:50", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9ba4ad3-e5", "ovs_interfaceid": "a9ba4ad3-e5eb-436a-8514-567d511f1999", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2774a932-7806-4c06-a128-e067a3072ebc", "address": "fa:16:3e:35:ec:2f", "network": {"id": "1f7634cf-e63f-4d83-8a75-65d21e863a21", "bridge": "br-int", "label": "tempest-device-tagging-net2-388612262", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2774a932-78", "ovs_interfaceid": "2774a932-7806-4c06-a128-e067a3072ebc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0c7d05ab-1414-4892-a28e-18b3816a1040", "address": "fa:16:3e:1f:5e:13", "network": {"id": "1f7634cf-e63f-4d83-8a75-65d21e863a21", "bridge": "br-int", "label": "tempest-device-tagging-net2-388612262", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c7d05ab-14", "ovs_interfaceid": "0c7d05ab-1414-4892-a28e-18b3816a1040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:01:21 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-6512517a-0f56-4b5a-822e-aa9f40bd93a0 req-ac2bd7cf-1d8c-4771-a42a-c71f2d27e2b4 service nova] Releasing lock "refresh_cache-e503ad35-1d9e-47d8-9a25-58e2a503ff02" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:01:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c02e6fd7-e712-45da-b35b-2fe21675e2f1/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c02e6fd7-e712-45da-b35b-2fe21675e2f1/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c02e6fd7-e712-45da-b35b-2fe21675e2f1/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c02e6fd7-e712-45da-b35b-2fe21675e2f1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:22 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:01:22 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:01:22 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:01:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:22 user nova-compute[72766]: DEBUG nova.compute.manager [req-9c571eb1-53cb-4a3c-98e0-6f0b955d6ab0 req-13ee1de1-85b4-4819-a85d-66d1fe7ebd51 service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Received event network-changed-baa7e0c2-91d4-4077-8405-abb537475df2 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:01:22 user nova-compute[72766]: DEBUG nova.compute.manager [req-9c571eb1-53cb-4a3c-98e0-6f0b955d6ab0 req-13ee1de1-85b4-4819-a85d-66d1fe7ebd51 service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Refreshing instance network info cache due to event network-changed-baa7e0c2-91d4-4077-8405-abb537475df2. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:01:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9c571eb1-53cb-4a3c-98e0-6f0b955d6ab0 req-13ee1de1-85b4-4819-a85d-66d1fe7ebd51 service nova] Acquiring lock "refresh_cache-87712dfd-d67b-4e5e-a75d-ca2dd7c764b1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:01:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9c571eb1-53cb-4a3c-98e0-6f0b955d6ab0 req-13ee1de1-85b4-4819-a85d-66d1fe7ebd51 service nova] Acquired lock "refresh_cache-87712dfd-d67b-4e5e-a75d-ca2dd7c764b1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:01:22 user nova-compute[72766]: DEBUG nova.network.neutron [req-9c571eb1-53cb-4a3c-98e0-6f0b955d6ab0 req-13ee1de1-85b4-4819-a85d-66d1fe7ebd51 service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Refreshing network info cache for port baa7e0c2-91d4-4077-8405-abb537475df2 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:01:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG nova.compute.manager [None req-6f5fca43-9d81-48a9-b389-be36904567d6 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG nova.compute.manager [req-9f902b9e-8963-4037-a14a-17c96d3716ae req-137916df-ccb6-40bf-8163-a3c42195f7ed service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Received event network-vif-plugged-baa7e0c2-91d4-4077-8405-abb537475df2 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9f902b9e-8963-4037-a14a-17c96d3716ae req-137916df-ccb6-40bf-8163-a3c42195f7ed service nova] Acquiring lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9f902b9e-8963-4037-a14a-17c96d3716ae req-137916df-ccb6-40bf-8163-a3c42195f7ed service nova] Lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9f902b9e-8963-4037-a14a-17c96d3716ae req-137916df-ccb6-40bf-8163-a3c42195f7ed service nova] Lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG nova.compute.manager [req-9f902b9e-8963-4037-a14a-17c96d3716ae req-137916df-ccb6-40bf-8163-a3c42195f7ed service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] No waiting events found dispatching network-vif-plugged-baa7e0c2-91d4-4077-8405-abb537475df2 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:01:25 user nova-compute[72766]: WARNING nova.compute.manager [req-9f902b9e-8963-4037-a14a-17c96d3716ae req-137916df-ccb6-40bf-8163-a3c42195f7ed service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Received unexpected event network-vif-plugged-baa7e0c2-91d4-4077-8405-abb537475df2 for instance with vm_state rescued and task_state unrescuing.
Aug 14 23:01:25 user nova-compute[72766]: DEBUG nova.compute.manager [req-9f902b9e-8963-4037-a14a-17c96d3716ae req-137916df-ccb6-40bf-8163-a3c42195f7ed service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Received event network-vif-plugged-baa7e0c2-91d4-4077-8405-abb537475df2 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9f902b9e-8963-4037-a14a-17c96d3716ae req-137916df-ccb6-40bf-8163-a3c42195f7ed service nova] Acquiring lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9f902b9e-8963-4037-a14a-17c96d3716ae req-137916df-ccb6-40bf-8163-a3c42195f7ed service nova] Lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9f902b9e-8963-4037-a14a-17c96d3716ae req-137916df-ccb6-40bf-8163-a3c42195f7ed service nova] Lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG nova.compute.manager [req-9f902b9e-8963-4037-a14a-17c96d3716ae req-137916df-ccb6-40bf-8163-a3c42195f7ed service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] No waiting events found dispatching network-vif-plugged-baa7e0c2-91d4-4077-8405-abb537475df2 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:01:25 user nova-compute[72766]: WARNING nova.compute.manager [req-9f902b9e-8963-4037-a14a-17c96d3716ae req-137916df-ccb6-40bf-8163-a3c42195f7ed service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Received unexpected event network-vif-plugged-baa7e0c2-91d4-4077-8405-abb537475df2 for instance with vm_state rescued and task_state unrescuing.
Aug 14 23:01:25 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Removed pending event for 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1 due to event {{(pid=72766) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054084.9270897, 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:01:25 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] VM Resumed (Lifecycle Event)
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Acquiring lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Acquiring lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:01:25 user nova-compute[72766]: INFO nova.compute.manager [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Terminating instance
Aug 14 23:01:25 user nova-compute[72766]: DEBUG nova.compute.manager [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'holwfUcP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:01:25 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:01:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:01:25 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:01:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:01:25 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 23:01:25 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358 -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:25 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:01:25 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:01:25 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=7365MB free_disk=25.60588836669922GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ecff32-7840-488e-925a-9b928c709795]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 23:01:25 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358 -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:01:25 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 14 23:01:25 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054084.9285657, 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:01:25 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] VM Started (Lifecycle Event)
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b359ff8-57ea-491d-a494-a197e483c4b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358] added
Aug 14 23:01:25 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG nova.network.neutron [req-9c571eb1-53cb-4a3c-98e0-6f0b955d6ab0 req-13ee1de1-85b4-4819-a85d-66d1fe7ebd51 service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Updated VIF entry in instance network info cache for port baa7e0c2-91d4-4077-8405-abb537475df2. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG nova.network.neutron [req-9c571eb1-53cb-4a3c-98e0-6f0b955d6ab0 req-13ee1de1-85b4-4819-a85d-66d1fe7ebd51 service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Updating instance_info_cache with network_info: [{"id": "baa7e0c2-91d4-4077-8405-abb537475df2", "address": "fa:16:3e:88:35:14", "network": {"id": "aff4f146-97db-4102-abf1-6528e74cad55", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1894452367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6942d31258304de68c9f7f8bb9304acb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa7e0c2-91", "ovs_interfaceid": "baa7e0c2-91d4-4077-8405-abb537475df2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d32cce-c00e-4430-babd-ba965e75e256]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d57e70b-32f1-4614-9521-5dba211a9117]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9c571eb1-53cb-4a3c-98e0-6f0b955d6ab0 req-13ee1de1-85b4-4819-a85d-66d1fe7ebd51 service nova] Releasing lock "refresh_cache-87712dfd-d67b-4e5e-a75d-ca2dd7c764b1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG nova.compute.manager [req-9c571eb1-53cb-4a3c-98e0-6f0b955d6ab0 req-13ee1de1-85b4-4819-a85d-66d1fe7ebd51 service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Received event network-changed-baa7e0c2-91d4-4077-8405-abb537475df2 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG nova.compute.manager [req-9c571eb1-53cb-4a3c-98e0-6f0b955d6ab0 req-13ee1de1-85b4-4819-a85d-66d1fe7ebd51 service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Refreshing instance network info cache due to event network-changed-baa7e0c2-91d4-4077-8405-abb537475df2. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9c571eb1-53cb-4a3c-98e0-6f0b955d6ab0 req-13ee1de1-85b4-4819-a85d-66d1fe7ebd51 service nova] Acquiring lock "refresh_cache-87712dfd-d67b-4e5e-a75d-ca2dd7c764b1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9c571eb1-53cb-4a3c-98e0-6f0b955d6ab0 req-13ee1de1-85b4-4819-a85d-66d1fe7ebd51 service nova] Acquired lock "refresh_cache-87712dfd-d67b-4e5e-a75d-ca2dd7c764b1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG nova.network.neutron [req-9c571eb1-53cb-4a3c-98e0-6f0b955d6ab0 req-13ee1de1-85b4-4819-a85d-66d1fe7ebd51 service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Refreshing network info cache for port baa7e0c2-91d4-4077-8405-abb537475df2 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v holwfUcP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v holwfUcP" returned: 0 in 0.031s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf5e90f-4829-49bf-85f6-a5b8b3e1436d]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'holwfUcP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a97c28a-0207-4715-be5a-ec2ad1419e3a]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d4face-4d91-47ee-9e97-0434f1c5e0d6]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)
Aug 14 23:01:25 user nova-compute[72766]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba (non-flash)
Aug 14 23:01:25 user nova-compute[72766]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d (non-flash)
Aug 14 23:01:25 user nova-compute[72766]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 (non-flash)
Aug 14 23:01:25 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)
Aug 14 23:01:25 user nova-compute[72766]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba (non-flash)
Aug 14 23:01:25 user nova-compute[72766]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d (non-flash)
Aug 14 23:01:25 user nova-compute[72766]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 (non-flash)
Aug 14 23:01:25 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358 -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358 -p 172.16.0.220:3260 --login" returned: 0 in 0.108s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e059a638-86b4-462c-9d04-3915591feb22]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358, portal: 172.16.0.220,3260]
Aug 14 23:01:25 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358, portal: 172.16.0.220,3260] successful.
Aug 14 23:01:25 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efdee88-a461-4948-b4fa-ca2c9f601083]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance b563c62d-d117-4bb5-9157-7387c51ed641 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 0850bb6c-6e3e-4007-8478-8eba53089158 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance c3c0a004-8d70-4253-bf17-b83088e30031 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance c02e6fd7-e712-45da-b35b-2fe21675e2f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance e503ad35-1d9e-47d8-9a25-58e2a503ff02 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 78f02883-99a1-493d-b6be-e43500bfba37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 3ff300ff-34fd-4e94-9d2d-681fb133ba32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.075s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[f039c4c0-121b-4bc5-82bc-587b19063eba]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)
Aug 14 23:01:25 user nova-compute[72766]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba (non-flash)
Aug 14 23:01:25 user nova-compute[72766]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d (non-flash)
Aug 14 23:01:25 user nova-compute[72766]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 (non-flash)
Aug 14 23:01:25 user nova-compute[72766]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358 (non-flash)
Aug 14 23:01:25 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)
Aug 14 23:01:25 user nova-compute[72766]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba (non-flash)
Aug 14 23:01:25 user nova-compute[72766]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d (non-flash)
Aug 14 23:01:25 user nova-compute[72766]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 (non-flash)
Aug 14 23:01:25 user nova-compute[72766]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358 (non-flash)
Aug 14 23:01:25 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.472s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Refreshing inventories for resource provider 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.040s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21005e0-388b-43a4-b54f-5e674b8ca25d]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'holwfUcP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Updating ProviderTree inventory for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Updating inventory in ProviderTree for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 23:01:25 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Refreshing aggregate associations for resource provider 45c8ff08-bf31-4ab6-8452-2e293102f899, aggregates: None {{(pid=72766) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 23:01:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:26 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Refreshing trait associations for resource provider 45c8ff08-bf31-4ab6-8452-2e293102f899, traits: COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=72766) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 23:01:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:26 user nova-compute[72766]: DEBUG nova.compute.manager [req-795bc94b-1169-43db-9072-35e836b85e83 req-351defba-bd8b-4cf7-b96b-319e3e253972 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-vif-unplugged-5d0ea097-96cd-4d3b-8815-346a488703d2 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:01:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-795bc94b-1169-43db-9072-35e836b85e83 req-351defba-bd8b-4cf7-b96b-319e3e253972 service nova] Acquiring lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:01:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-795bc94b-1169-43db-9072-35e836b85e83 req-351defba-bd8b-4cf7-b96b-319e3e253972 service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:01:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-795bc94b-1169-43db-9072-35e836b85e83 req-351defba-bd8b-4cf7-b96b-319e3e253972 service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:01:26 user nova-compute[72766]: DEBUG nova.compute.manager [req-795bc94b-1169-43db-9072-35e836b85e83 req-351defba-bd8b-4cf7-b96b-319e3e253972 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] No waiting events found dispatching network-vif-unplugged-5d0ea097-96cd-4d3b-8815-346a488703d2 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:01:26 user nova-compute[72766]: DEBUG nova.compute.manager [req-795bc94b-1169-43db-9072-35e836b85e83 req-351defba-bd8b-4cf7-b96b-319e3e253972 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-vif-unplugged-5d0ea097-96cd-4d3b-8815-346a488703d2 for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:01:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:26 user nova-compute[72766]: DEBUG nova.compute.manager [req-5e1daeb2-373d-4f3f-8770-7856b6d9c581 req-980f586f-1c01-4a8b-9134-816813052581 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-vif-unplugged-0d0642a2-a76e-4de1-956c-fb58280caec3 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:01:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-5e1daeb2-373d-4f3f-8770-7856b6d9c581 req-980f586f-1c01-4a8b-9134-816813052581 service nova] Acquiring lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:01:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-5e1daeb2-373d-4f3f-8770-7856b6d9c581 req-980f586f-1c01-4a8b-9134-816813052581 service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:01:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-5e1daeb2-373d-4f3f-8770-7856b6d9c581 req-980f586f-1c01-4a8b-9134-816813052581 service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:01:26 user nova-compute[72766]: DEBUG nova.compute.manager [req-5e1daeb2-373d-4f3f-8770-7856b6d9c581 req-980f586f-1c01-4a8b-9134-816813052581 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] No waiting events found dispatching network-vif-unplugged-0d0642a2-a76e-4de1-956c-fb58280caec3 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:01:26 user nova-compute[72766]: DEBUG nova.compute.manager [req-5e1daeb2-373d-4f3f-8770-7856b6d9c581 req-980f586f-1c01-4a8b-9134-816813052581 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-vif-unplugged-0d0642a2-a76e-4de1-956c-fb58280caec3 for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:01:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:26 user nova-compute[72766]: DEBUG nova.network.neutron [req-9c571eb1-53cb-4a3c-98e0-6f0b955d6ab0 req-13ee1de1-85b4-4819-a85d-66d1fe7ebd51 service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Updated VIF entry in instance network info cache for port baa7e0c2-91d4-4077-8405-abb537475df2. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:01:26 user nova-compute[72766]: DEBUG nova.network.neutron [req-9c571eb1-53cb-4a3c-98e0-6f0b955d6ab0 req-13ee1de1-85b4-4819-a85d-66d1fe7ebd51 service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Updating instance_info_cache with network_info: [{"id": "baa7e0c2-91d4-4077-8405-abb537475df2", "address": "fa:16:3e:88:35:14", "network": {"id": "aff4f146-97db-4102-abf1-6528e74cad55", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1894452367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6942d31258304de68c9f7f8bb9304acb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa7e0c2-91", "ovs_interfaceid": "baa7e0c2-91d4-4077-8405-abb537475df2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:01:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9c571eb1-53cb-4a3c-98e0-6f0b955d6ab0 req-13ee1de1-85b4-4819-a85d-66d1fe7ebd51 service nova] Releasing lock "refresh_cache-87712dfd-d67b-4e5e-a75d-ca2dd7c764b1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:01:26 user nova-compute[72766]: DEBUG nova.compute.manager [req-9c571eb1-53cb-4a3c-98e0-6f0b955d6ab0 req-13ee1de1-85b4-4819-a85d-66d1fe7ebd51 service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Received event network-vif-plugged-baa7e0c2-91d4-4077-8405-abb537475df2 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:01:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9c571eb1-53cb-4a3c-98e0-6f0b955d6ab0 req-13ee1de1-85b4-4819-a85d-66d1fe7ebd51 service nova] Acquiring lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:01:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9c571eb1-53cb-4a3c-98e0-6f0b955d6ab0 req-13ee1de1-85b4-4819-a85d-66d1fe7ebd51 service nova] Lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:01:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9c571eb1-53cb-4a3c-98e0-6f0b955d6ab0 req-13ee1de1-85b4-4819-a85d-66d1fe7ebd51 service nova] Lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:01:26 user nova-compute[72766]: DEBUG nova.compute.manager [req-9c571eb1-53cb-4a3c-98e0-6f0b955d6ab0 req-13ee1de1-85b4-4819-a85d-66d1fe7ebd51 service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] No waiting events found dispatching network-vif-plugged-baa7e0c2-91d4-4077-8405-abb537475df2 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:01:26 user nova-compute[72766]: WARNING nova.compute.manager [req-9c571eb1-53cb-4a3c-98e0-6f0b955d6ab0 req-13ee1de1-85b4-4819-a85d-66d1fe7ebd51 service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Received unexpected event network-vif-plugged-baa7e0c2-91d4-4077-8405-abb537475df2 for instance with vm_state rescued and task_state unrescuing.
Aug 14 23:01:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:26 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:01:26 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:01:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:26 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:01:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.168s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:01:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.542s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:01:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] <== connect_volume: return (1545ms) {'type': 'block', 'scsi_wwn': '23165643332313537', 'path': '/dev/sdb'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:01:26 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165643332313537', 'path': '/dev/sdb'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 23:01:26 user nova-compute[72766]: DEBUG nova.objects.instance [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Lazy-loading 'flavor' on Instance uuid c02e6fd7-e712-45da-b35b-2fe21675e2f1 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:01:26 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 23:01:26 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:01:26 user nova-compute[72766]:   <source dev="/dev/sdb"/>
Aug 14 23:01:26 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:01:26 user nova-compute[72766]:   <serial>423f7a5d-4684-430d-a086-5fa5ce06c358</serial>
Aug 14 23:01:26 user nova-compute[72766]: </disk>
Aug 14 23:01:26 user nova-compute[72766]:  {{(pid=72766) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG nova.compute.manager [req-70ca913b-2052-4daf-ab78-d822f9677c6d req-cfc89ee4-6706-44f1-901d-6f3dc20a71ed service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-vif-unplugged-098834fb-ad7d-4032-9f2c-28b8a206d4c4 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-70ca913b-2052-4daf-ab78-d822f9677c6d req-cfc89ee4-6706-44f1-901d-6f3dc20a71ed service nova] Acquiring lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-70ca913b-2052-4daf-ab78-d822f9677c6d req-cfc89ee4-6706-44f1-901d-6f3dc20a71ed service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-70ca913b-2052-4daf-ab78-d822f9677c6d req-cfc89ee4-6706-44f1-901d-6f3dc20a71ed service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG nova.compute.manager [req-70ca913b-2052-4daf-ab78-d822f9677c6d req-cfc89ee4-6706-44f1-901d-6f3dc20a71ed service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] No waiting events found dispatching network-vif-unplugged-098834fb-ad7d-4032-9f2c-28b8a206d4c4 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG nova.compute.manager [req-70ca913b-2052-4daf-ab78-d822f9677c6d req-cfc89ee4-6706-44f1-901d-6f3dc20a71ed service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-vif-unplugged-098834fb-ad7d-4032-9f2c-28b8a206d4c4 for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] No VIF found with MAC fa:16:3e:3e:c1:d6, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:01:27 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Instance destroyed successfully.
Aug 14 23:01:27 user nova-compute[72766]: DEBUG nova.objects.instance [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Lazy-loading 'resources' on Instance uuid e503ad35-1d9e-47d8-9a25-58e2a503ff02 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T22:59:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1980704616',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1980704616',id=15,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTW3JotsHqkkXvtJosiuyB+jgYCyIIaBk4uEzRhxiHlu66v6Cs2FyC8xKi4GfKh+FPWzxjQ/1KSY3IeIfVhlQtrhAM8ckKpiQQi+W90XzsZXKKfsCNaLVEhiUmmOF0MbA==',key_name='tempest-keypair-1244565067',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:00:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fa34f06852ad4fc9aaa9f542232d711b',ramdisk_id='',reservation_id='r-jdcne46q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-507110939',owner_user_name='tempest-TaggedBootDevicesTest-507110939-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:00:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb06afcc445148a9aaba54ee872cd38b',uuid=e503ad35-1d9e-47d8-9a25-58e2a503ff02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "098834fb-ad7d-4032-9f2c-28b8a206d4c4", "address": "fa:16:3e:5e:72:4a", "network": {"id": "6991af8d-255f-45a5-8be0-f6d851affa68", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1760061206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap098834fb-ad", "ovs_interfaceid": "098834fb-ad7d-4032-9f2c-28b8a206d4c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Converting VIF {"id": "098834fb-ad7d-4032-9f2c-28b8a206d4c4", "address": "fa:16:3e:5e:72:4a", "network": {"id": "6991af8d-255f-45a5-8be0-f6d851affa68", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1760061206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap098834fb-ad", "ovs_interfaceid": "098834fb-ad7d-4032-9f2c-28b8a206d4c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:72:4a,bridge_name='br-int',has_traffic_filtering=True,id=098834fb-ad7d-4032-9f2c-28b8a206d4c4,network=Network(6991af8d-255f-45a5-8be0-f6d851affa68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap098834fb-ad') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG os_vif [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:72:4a,bridge_name='br-int',has_traffic_filtering=True,id=098834fb-ad7d-4032-9f2c-28b8a206d4c4,network=Network(6991af8d-255f-45a5-8be0-f6d851affa68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap098834fb-ad') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap098834fb-ad, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Triggering sync for uuid b563c62d-d117-4bb5-9157-7387c51ed641 {{(pid=72766) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Triggering sync for uuid 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1 {{(pid=72766) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Triggering sync for uuid 0850bb6c-6e3e-4007-8478-8eba53089158 {{(pid=72766) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Triggering sync for uuid c3c0a004-8d70-4253-bf17-b83088e30031 {{(pid=72766) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Triggering sync for uuid c02e6fd7-e712-45da-b35b-2fe21675e2f1 {{(pid=72766) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Triggering sync for uuid e503ad35-1d9e-47d8-9a25-58e2a503ff02 {{(pid=72766) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Triggering sync for uuid 78f02883-99a1-493d-b6be-e43500bfba37 {{(pid=72766) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Triggering sync for uuid 3ff300ff-34fd-4e94-9d2d-681fb133ba32 {{(pid=72766) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "b563c62d-d117-4bb5-9157-7387c51ed641" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "b563c62d-d117-4bb5-9157-7387c51ed641" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "0850bb6c-6e3e-4007-8478-8eba53089158" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "0850bb6c-6e3e-4007-8478-8eba53089158" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "c3c0a004-8d70-4253-bf17-b83088e30031" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "c3c0a004-8d70-4253-bf17-b83088e30031" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "c02e6fd7-e712-45da-b35b-2fe21675e2f1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "78f02883-99a1-493d-b6be-e43500bfba37" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "78f02883-99a1-493d-b6be-e43500bfba37" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "3ff300ff-34fd-4e94-9d2d-681fb133ba32" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "3ff300ff-34fd-4e94-9d2d-681fb133ba32" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:27 user nova-compute[72766]: INFO os_vif [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:72:4a,bridge_name='br-int',has_traffic_filtering=True,id=098834fb-ad7d-4032-9f2c-28b8a206d4c4,network=Network(6991af8d-255f-45a5-8be0-f6d851affa68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap098834fb-ad')
Aug 14 23:01:27 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T22:59:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1980704616',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1980704616',id=15,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTW3JotsHqkkXvtJosiuyB+jgYCyIIaBk4uEzRhxiHlu66v6Cs2FyC8xKi4GfKh+FPWzxjQ/1KSY3IeIfVhlQtrhAM8ckKpiQQi+W90XzsZXKKfsCNaLVEhiUmmOF0MbA==',key_name='tempest-keypair-1244565067',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:00:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fa34f06852ad4fc9aaa9f542232d711b',ramdisk_id='',reservation_id='r-jdcne46q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-507110939',owner_user_name='tempest-TaggedBootDevicesTest-507110939-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:00:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb06afcc445148a9aaba54ee872cd38b',uuid=e503ad35-1d9e-47d8-9a25-58e2a503ff02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ad9f734-e280-4596-a00e-672de5d6ecb6", "address": "fa:16:3e:8c:7f:fe", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ad9f734-e2", "ovs_interfaceid": "4ad9f734-e280-4596-a00e-672de5d6ecb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Converting VIF {"id": "4ad9f734-e280-4596-a00e-672de5d6ecb6", "address": "fa:16:3e:8c:7f:fe", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ad9f734-e2", "ovs_interfaceid": "4ad9f734-e280-4596-a00e-672de5d6ecb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:7f:fe,bridge_name='br-int',has_traffic_filtering=True,id=4ad9f734-e280-4596-a00e-672de5d6ecb6,network=Network(140290ed-5e86-4fc4-a97d-169e77a3d9d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4ad9f734-e2') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG os_vif [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:7f:fe,bridge_name='br-int',has_traffic_filtering=True,id=4ad9f734-e280-4596-a00e-672de5d6ecb6,network=Network(140290ed-5e86-4fc4-a97d-169e77a3d9d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4ad9f734-e2') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ad9f734-e2, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "b563c62d-d117-4bb5-9157-7387c51ed641" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.134s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.133s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "78f02883-99a1-493d-b6be-e43500bfba37" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.134s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "c3c0a004-8d70-4253-bf17-b83088e30031" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.147s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:01:27 user nova-compute[72766]: INFO os_vif [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:7f:fe,bridge_name='br-int',has_traffic_filtering=True,id=4ad9f734-e280-4596-a00e-672de5d6ecb6,network=Network(140290ed-5e86-4fc4-a97d-169e77a3d9d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4ad9f734-e2')
Aug 14 23:01:27 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T22:59:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1980704616',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1980704616',id=15,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTW3JotsHqkkXvtJosiuyB+jgYCyIIaBk4uEzRhxiHlu66v6Cs2FyC8xKi4GfKh+FPWzxjQ/1KSY3IeIfVhlQtrhAM8ckKpiQQi+W90XzsZXKKfsCNaLVEhiUmmOF0MbA==',key_name='tempest-keypair-1244565067',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:00:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fa34f06852ad4fc9aaa9f542232d711b',ramdisk_id='',reservation_id='r-jdcne46q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-507110939',owner_user_name='tempest-TaggedBootDevicesTest-507110939-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:00:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb06afcc445148a9aaba54ee872cd38b',uuid=e503ad35-1d9e-47d8-9a25-58e2a503ff02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d0ea097-96cd-4d3b-8815-346a488703d2", "address": "fa:16:3e:46:88:4e", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0ea097-96", "ovs_interfaceid": "5d0ea097-96cd-4d3b-8815-346a488703d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Converting VIF {"id": "5d0ea097-96cd-4d3b-8815-346a488703d2", "address": "fa:16:3e:46:88:4e", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0ea097-96", "ovs_interfaceid": "5d0ea097-96cd-4d3b-8815-346a488703d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:88:4e,bridge_name='br-int',has_traffic_filtering=True,id=5d0ea097-96cd-4d3b-8815-346a488703d2,network=Network(140290ed-5e86-4fc4-a97d-169e77a3d9d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5d0ea097-96') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG os_vif [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:88:4e,bridge_name='br-int',has_traffic_filtering=True,id=5d0ea097-96cd-4d3b-8815-346a488703d2,network=Network(140290ed-5e86-4fc4-a97d-169e77a3d9d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5d0ea097-96') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "0850bb6c-6e3e-4007-8478-8eba53089158" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.159s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "3ff300ff-34fd-4e94-9d2d-681fb133ba32" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.154s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d0ea097-96, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-626f8c66-0081-44f2-ad04-e3850492d02d tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Lock "c02e6fd7-e712-45da-b35b-2fe21675e2f1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.346s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "c02e6fd7-e712-45da-b35b-2fe21675e2f1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.170s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "c02e6fd7-e712-45da-b35b-2fe21675e2f1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:01:27 user nova-compute[72766]: INFO os_vif [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:88:4e,bridge_name='br-int',has_traffic_filtering=True,id=5d0ea097-96cd-4d3b-8815-346a488703d2,network=Network(140290ed-5e86-4fc4-a97d-169e77a3d9d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5d0ea097-96')
Aug 14 23:01:27 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T22:59:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1980704616',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1980704616',id=15,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTW3JotsHqkkXvtJosiuyB+jgYCyIIaBk4uEzRhxiHlu66v6Cs2FyC8xKi4GfKh+FPWzxjQ/1KSY3IeIfVhlQtrhAM8ckKpiQQi+W90XzsZXKKfsCNaLVEhiUmmOF0MbA==',key_name='tempest-keypair-1244565067',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:00:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fa34f06852ad4fc9aaa9f542232d711b',ramdisk_id='',reservation_id='r-jdcne46q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-507110939',owner_user_name='tempest-TaggedBootDevicesTest-507110939-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:00:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb06afcc445148a9aaba54ee872cd38b',uuid=e503ad35-1d9e-47d8-9a25-58e2a503ff02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d0642a2-a76e-4de1-956c-fb58280caec3", "address": "fa:16:3e:d9:c2:f7", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d0642a2-a7", "ovs_interfaceid": "0d0642a2-a76e-4de1-956c-fb58280caec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Converting VIF {"id": "0d0642a2-a76e-4de1-956c-fb58280caec3", "address": "fa:16:3e:d9:c2:f7", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d0642a2-a7", "ovs_interfaceid": "0d0642a2-a76e-4de1-956c-fb58280caec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:c2:f7,bridge_name='br-int',has_traffic_filtering=True,id=0d0642a2-a76e-4de1-956c-fb58280caec3,network=Network(140290ed-5e86-4fc4-a97d-169e77a3d9d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d0642a2-a7') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG os_vif [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:c2:f7,bridge_name='br-int',has_traffic_filtering=True,id=0d0642a2-a76e-4de1-956c-fb58280caec3,network=Network(140290ed-5e86-4fc4-a97d-169e77a3d9d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d0642a2-a7') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d0642a2-a7, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:27 user nova-compute[72766]: INFO os_vif [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:c2:f7,bridge_name='br-int',has_traffic_filtering=True,id=0d0642a2-a76e-4de1-956c-fb58280caec3,network=Network(140290ed-5e86-4fc4-a97d-169e77a3d9d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d0642a2-a7')
Aug 14 23:01:27 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T22:59:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1980704616',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1980704616',id=15,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTW3JotsHqkkXvtJosiuyB+jgYCyIIaBk4uEzRhxiHlu66v6Cs2FyC8xKi4GfKh+FPWzxjQ/1KSY3IeIfVhlQtrhAM8ckKpiQQi+W90XzsZXKKfsCNaLVEhiUmmOF0MbA==',key_name='tempest-keypair-1244565067',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:00:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fa34f06852ad4fc9aaa9f542232d711b',ramdisk_id='',reservation_id='r-jdcne46q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-507110939',owner_user_name='tempest-TaggedBootDevicesTest-507110939-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:00:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb06afcc445148a9aaba54ee872cd38b',uuid=e503ad35-1d9e-47d8-9a25-58e2a503ff02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9ba4ad3-e5eb-436a-8514-567d511f1999", "address": "fa:16:3e:30:f6:50", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9ba4ad3-e5", "ovs_interfaceid": "a9ba4ad3-e5eb-436a-8514-567d511f1999", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Converting VIF {"id": "a9ba4ad3-e5eb-436a-8514-567d511f1999", "address": "fa:16:3e:30:f6:50", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9ba4ad3-e5", "ovs_interfaceid": "a9ba4ad3-e5eb-436a-8514-567d511f1999", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:f6:50,bridge_name='br-int',has_traffic_filtering=True,id=a9ba4ad3-e5eb-436a-8514-567d511f1999,network=Network(140290ed-5e86-4fc4-a97d-169e77a3d9d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9ba4ad3-e5') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG os_vif [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:f6:50,bridge_name='br-int',has_traffic_filtering=True,id=a9ba4ad3-e5eb-436a-8514-567d511f1999,network=Network(140290ed-5e86-4fc4-a97d-169e77a3d9d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9ba4ad3-e5') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9ba4ad3-e5, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:27 user nova-compute[72766]: INFO os_vif [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:f6:50,bridge_name='br-int',has_traffic_filtering=True,id=a9ba4ad3-e5eb-436a-8514-567d511f1999,network=Network(140290ed-5e86-4fc4-a97d-169e77a3d9d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9ba4ad3-e5')
Aug 14 23:01:27 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T22:59:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1980704616',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1980704616',id=15,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTW3JotsHqkkXvtJosiuyB+jgYCyIIaBk4uEzRhxiHlu66v6Cs2FyC8xKi4GfKh+FPWzxjQ/1KSY3IeIfVhlQtrhAM8ckKpiQQi+W90XzsZXKKfsCNaLVEhiUmmOF0MbA==',key_name='tempest-keypair-1244565067',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:00:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fa34f06852ad4fc9aaa9f542232d711b',ramdisk_id='',reservation_id='r-jdcne46q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-507110939',owner_user_name='tempest-TaggedBootDevicesTest-507110939-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:00:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb06afcc445148a9aaba54ee872cd38b',uuid=e503ad35-1d9e-47d8-9a25-58e2a503ff02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2774a932-7806-4c06-a128-e067a3072ebc", "address": "fa:16:3e:35:ec:2f", "network": {"id": "1f7634cf-e63f-4d83-8a75-65d21e863a21", "bridge": "br-int", "label": "tempest-device-tagging-net2-388612262", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2774a932-78", "ovs_interfaceid": "2774a932-7806-4c06-a128-e067a3072ebc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Converting VIF {"id": "2774a932-7806-4c06-a128-e067a3072ebc", "address": "fa:16:3e:35:ec:2f", "network": {"id": "1f7634cf-e63f-4d83-8a75-65d21e863a21", "bridge": "br-int", "label": "tempest-device-tagging-net2-388612262", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2774a932-78", "ovs_interfaceid": "2774a932-7806-4c06-a128-e067a3072ebc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:ec:2f,bridge_name='br-int',has_traffic_filtering=True,id=2774a932-7806-4c06-a128-e067a3072ebc,network=Network(1f7634cf-e63f-4d83-8a75-65d21e863a21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2774a932-78') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG os_vif [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:ec:2f,bridge_name='br-int',has_traffic_filtering=True,id=2774a932-7806-4c06-a128-e067a3072ebc,network=Network(1f7634cf-e63f-4d83-8a75-65d21e863a21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2774a932-78') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2774a932-78, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:27 user nova-compute[72766]: INFO os_vif [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:ec:2f,bridge_name='br-int',has_traffic_filtering=True,id=2774a932-7806-4c06-a128-e067a3072ebc,network=Network(1f7634cf-e63f-4d83-8a75-65d21e863a21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2774a932-78')
Aug 14 23:01:27 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T22:59:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1980704616',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1980704616',id=15,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTW3JotsHqkkXvtJosiuyB+jgYCyIIaBk4uEzRhxiHlu66v6Cs2FyC8xKi4GfKh+FPWzxjQ/1KSY3IeIfVhlQtrhAM8ckKpiQQi+W90XzsZXKKfsCNaLVEhiUmmOF0MbA==',key_name='tempest-keypair-1244565067',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:00:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fa34f06852ad4fc9aaa9f542232d711b',ramdisk_id='',reservation_id='r-jdcne46q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-507110939',owner_user_name='tempest-TaggedBootDevicesTest-507110939-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:00:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb06afcc445148a9aaba54ee872cd38b',uuid=e503ad35-1d9e-47d8-9a25-58e2a503ff02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c7d05ab-1414-4892-a28e-18b3816a1040", "address": "fa:16:3e:1f:5e:13", "network": {"id": "1f7634cf-e63f-4d83-8a75-65d21e863a21", "bridge": "br-int", "label": "tempest-device-tagging-net2-388612262", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c7d05ab-14", "ovs_interfaceid": "0c7d05ab-1414-4892-a28e-18b3816a1040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Converting VIF {"id": "0c7d05ab-1414-4892-a28e-18b3816a1040", "address": "fa:16:3e:1f:5e:13", "network": {"id": "1f7634cf-e63f-4d83-8a75-65d21e863a21", "bridge": "br-int", "label": "tempest-device-tagging-net2-388612262", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c7d05ab-14", "ovs_interfaceid": "0c7d05ab-1414-4892-a28e-18b3816a1040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:5e:13,bridge_name='br-int',has_traffic_filtering=True,id=0c7d05ab-1414-4892-a28e-18b3816a1040,network=Network(1f7634cf-e63f-4d83-8a75-65d21e863a21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c7d05ab-14') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG os_vif [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:5e:13,bridge_name='br-int',has_traffic_filtering=True,id=0c7d05ab-1414-4892-a28e-18b3816a1040,network=Network(1f7634cf-e63f-4d83-8a75-65d21e863a21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c7d05ab-14') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c7d05ab-14, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:27 user nova-compute[72766]: INFO os_vif [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:5e:13,bridge_name='br-int',has_traffic_filtering=True,id=0c7d05ab-1414-4892-a28e-18b3816a1040,network=Network(1f7634cf-e63f-4d83-8a75-65d21e863a21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c7d05ab-14')
Aug 14 23:01:27 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eFimLPAu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:01:27 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:01:27 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e390f03-bee1-4351-b034-719315536556]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada7d444-97cb-46b4-b541-3f76661475da]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)
Aug 14 23:01:28 user nova-compute[72766]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba (non-flash)
Aug 14 23:01:28 user nova-compute[72766]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d (non-flash)
Aug 14 23:01:28 user nova-compute[72766]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 (non-flash)
Aug 14 23:01:28 user nova-compute[72766]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358 (non-flash)
Aug 14 23:01:28 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)
Aug 14 23:01:28 user nova-compute[72766]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba (non-flash)
Aug 14 23:01:28 user nova-compute[72766]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d (non-flash)
Aug 14 23:01:28 user nova-compute[72766]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 (non-flash)
Aug 14 23:01:28 user nova-compute[72766]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358 (non-flash)
Aug 14 23:01:28 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff15446b880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79'): ({'sdg'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Removing single pathed devices sdg {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f589b8-1f01-4c6c-b8fb-84e43a68ea20]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8df38b-fa3e-4575-88ef-fec6ff4ef95c]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Flushing IO for device /dev/sdg {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe4e2d7-5081-486b-8ddd-ab0238086157]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.040s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a39bdc8-5527-4053-b294-e67307443eb1]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] SCSI volumes sdg have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32b872e-6699-4de6-8e9c-d15c2a0b3f9a]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca0abb8-ba3d-4c78-8fa9-e3fdad5a7bc7]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79, portal: 172.16.0.220,3260]
Aug 14 23:01:28 user nova-compute[72766]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79, portal: 172.16.0.220,3260] successful.
Aug 14 23:01:28 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9900a64e-33db-4cad-95c1-2561e727dd79 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edc2c34-4464-4902-9c4c-c1c163af70b1]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] <== disconnect_volume: return (300ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfSsALwa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:01:28 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6fd9a7-3fd2-4a17-9dfc-5a937c49c8cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG nova.compute.manager [req-61f7cbd8-5e22-4a5f-b037-5b32630f86ce req-4e290778-273f-44ce-97df-b89710cb26d6 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-vif-plugged-5d0ea097-96cd-4d3b-8815-346a488703d2 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-61f7cbd8-5e22-4a5f-b037-5b32630f86ce req-4e290778-273f-44ce-97df-b89710cb26d6 service nova] Acquiring lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-61f7cbd8-5e22-4a5f-b037-5b32630f86ce req-4e290778-273f-44ce-97df-b89710cb26d6 service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-61f7cbd8-5e22-4a5f-b037-5b32630f86ce req-4e290778-273f-44ce-97df-b89710cb26d6 service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG nova.compute.manager [req-61f7cbd8-5e22-4a5f-b037-5b32630f86ce req-4e290778-273f-44ce-97df-b89710cb26d6 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] No waiting events found dispatching network-vif-plugged-5d0ea097-96cd-4d3b-8815-346a488703d2 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:01:28 user nova-compute[72766]: WARNING nova.compute.manager [req-61f7cbd8-5e22-4a5f-b037-5b32630f86ce req-4e290778-273f-44ce-97df-b89710cb26d6 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received unexpected event network-vif-plugged-5d0ea097-96cd-4d3b-8815-346a488703d2 for instance with vm_state active and task_state deleting.
Aug 14 23:01:28 user nova-compute[72766]: DEBUG nova.compute.manager [req-61f7cbd8-5e22-4a5f-b037-5b32630f86ce req-4e290778-273f-44ce-97df-b89710cb26d6 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-vif-unplugged-a9ba4ad3-e5eb-436a-8514-567d511f1999 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-61f7cbd8-5e22-4a5f-b037-5b32630f86ce req-4e290778-273f-44ce-97df-b89710cb26d6 service nova] Acquiring lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-61f7cbd8-5e22-4a5f-b037-5b32630f86ce req-4e290778-273f-44ce-97df-b89710cb26d6 service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-61f7cbd8-5e22-4a5f-b037-5b32630f86ce req-4e290778-273f-44ce-97df-b89710cb26d6 service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG nova.compute.manager [req-61f7cbd8-5e22-4a5f-b037-5b32630f86ce req-4e290778-273f-44ce-97df-b89710cb26d6 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] No waiting events found dispatching network-vif-unplugged-a9ba4ad3-e5eb-436a-8514-567d511f1999 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG nova.compute.manager [req-61f7cbd8-5e22-4a5f-b037-5b32630f86ce req-4e290778-273f-44ce-97df-b89710cb26d6 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-vif-unplugged-a9ba4ad3-e5eb-436a-8514-567d511f1999 for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG nova.compute.manager [req-61f7cbd8-5e22-4a5f-b037-5b32630f86ce req-4e290778-273f-44ce-97df-b89710cb26d6 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-vif-plugged-a9ba4ad3-e5eb-436a-8514-567d511f1999 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-61f7cbd8-5e22-4a5f-b037-5b32630f86ce req-4e290778-273f-44ce-97df-b89710cb26d6 service nova] Acquiring lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-61f7cbd8-5e22-4a5f-b037-5b32630f86ce req-4e290778-273f-44ce-97df-b89710cb26d6 service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-61f7cbd8-5e22-4a5f-b037-5b32630f86ce req-4e290778-273f-44ce-97df-b89710cb26d6 service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG nova.compute.manager [req-61f7cbd8-5e22-4a5f-b037-5b32630f86ce req-4e290778-273f-44ce-97df-b89710cb26d6 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] No waiting events found dispatching network-vif-plugged-a9ba4ad3-e5eb-436a-8514-567d511f1999 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:01:28 user nova-compute[72766]: WARNING nova.compute.manager [req-61f7cbd8-5e22-4a5f-b037-5b32630f86ce req-4e290778-273f-44ce-97df-b89710cb26d6 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received unexpected event network-vif-plugged-a9ba4ad3-e5eb-436a-8514-567d511f1999 for instance with vm_state active and task_state deleting.
Aug 14 23:01:28 user nova-compute[72766]: DEBUG nova.compute.manager [req-61f7cbd8-5e22-4a5f-b037-5b32630f86ce req-4e290778-273f-44ce-97df-b89710cb26d6 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-vif-unplugged-0c7d05ab-1414-4892-a28e-18b3816a1040 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-61f7cbd8-5e22-4a5f-b037-5b32630f86ce req-4e290778-273f-44ce-97df-b89710cb26d6 service nova] Acquiring lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-61f7cbd8-5e22-4a5f-b037-5b32630f86ce req-4e290778-273f-44ce-97df-b89710cb26d6 service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-61f7cbd8-5e22-4a5f-b037-5b32630f86ce req-4e290778-273f-44ce-97df-b89710cb26d6 service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG nova.compute.manager [req-61f7cbd8-5e22-4a5f-b037-5b32630f86ce req-4e290778-273f-44ce-97df-b89710cb26d6 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] No waiting events found dispatching network-vif-unplugged-0c7d05ab-1414-4892-a28e-18b3816a1040 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG nova.compute.manager [req-61f7cbd8-5e22-4a5f-b037-5b32630f86ce req-4e290778-273f-44ce-97df-b89710cb26d6 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-vif-unplugged-0c7d05ab-1414-4892-a28e-18b3816a1040 for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG nova.compute.manager [req-61f7cbd8-5e22-4a5f-b037-5b32630f86ce req-4e290778-273f-44ce-97df-b89710cb26d6 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-vif-plugged-0c7d05ab-1414-4892-a28e-18b3816a1040 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-61f7cbd8-5e22-4a5f-b037-5b32630f86ce req-4e290778-273f-44ce-97df-b89710cb26d6 service nova] Acquiring lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-61f7cbd8-5e22-4a5f-b037-5b32630f86ce req-4e290778-273f-44ce-97df-b89710cb26d6 service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-61f7cbd8-5e22-4a5f-b037-5b32630f86ce req-4e290778-273f-44ce-97df-b89710cb26d6 service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG nova.compute.manager [req-61f7cbd8-5e22-4a5f-b037-5b32630f86ce req-4e290778-273f-44ce-97df-b89710cb26d6 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] No waiting events found dispatching network-vif-plugged-0c7d05ab-1414-4892-a28e-18b3816a1040 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:01:28 user nova-compute[72766]: WARNING nova.compute.manager [req-61f7cbd8-5e22-4a5f-b037-5b32630f86ce req-4e290778-273f-44ce-97df-b89710cb26d6 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received unexpected event network-vif-plugged-0c7d05ab-1414-4892-a28e-18b3816a1040 for instance with vm_state active and task_state deleting.
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f454782-8f4d-4303-908f-c4d79baea7d8]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)
Aug 14 23:01:28 user nova-compute[72766]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba (non-flash)
Aug 14 23:01:28 user nova-compute[72766]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d (non-flash)
Aug 14 23:01:28 user nova-compute[72766]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358 (non-flash)
Aug 14 23:01:28 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)
Aug 14 23:01:28 user nova-compute[72766]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba (non-flash)
Aug 14 23:01:28 user nova-compute[72766]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d (non-flash)
Aug 14 23:01:28 user nova-compute[72766]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358 (non-flash)
Aug 14 23:01:28 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff15446b880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d'): ({'sdf'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Removing single pathed devices sdf {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG nova.compute.manager [req-d229e529-4e45-4dae-a536-c38505e2c1e6 req-ce7a562a-e875-40ef-98cd-afd0114516bc service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-vif-plugged-0d0642a2-a76e-4de1-956c-fb58280caec3 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d229e529-4e45-4dae-a536-c38505e2c1e6 req-ce7a562a-e875-40ef-98cd-afd0114516bc service nova] Acquiring lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d229e529-4e45-4dae-a536-c38505e2c1e6 req-ce7a562a-e875-40ef-98cd-afd0114516bc service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d229e529-4e45-4dae-a536-c38505e2c1e6 req-ce7a562a-e875-40ef-98cd-afd0114516bc service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG nova.compute.manager [req-d229e529-4e45-4dae-a536-c38505e2c1e6 req-ce7a562a-e875-40ef-98cd-afd0114516bc service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] No waiting events found dispatching network-vif-plugged-0d0642a2-a76e-4de1-956c-fb58280caec3 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:01:28 user nova-compute[72766]: WARNING nova.compute.manager [req-d229e529-4e45-4dae-a536-c38505e2c1e6 req-ce7a562a-e875-40ef-98cd-afd0114516bc service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received unexpected event network-vif-plugged-0d0642a2-a76e-4de1-956c-fb58280caec3 for instance with vm_state active and task_state deleting.
Aug 14 23:01:28 user nova-compute[72766]: DEBUG nova.compute.manager [req-d229e529-4e45-4dae-a536-c38505e2c1e6 req-ce7a562a-e875-40ef-98cd-afd0114516bc service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-vif-unplugged-2774a932-7806-4c06-a128-e067a3072ebc {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d229e529-4e45-4dae-a536-c38505e2c1e6 req-ce7a562a-e875-40ef-98cd-afd0114516bc service nova] Acquiring lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d229e529-4e45-4dae-a536-c38505e2c1e6 req-ce7a562a-e875-40ef-98cd-afd0114516bc service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d229e529-4e45-4dae-a536-c38505e2c1e6 req-ce7a562a-e875-40ef-98cd-afd0114516bc service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG nova.compute.manager [req-d229e529-4e45-4dae-a536-c38505e2c1e6 req-ce7a562a-e875-40ef-98cd-afd0114516bc service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] No waiting events found dispatching network-vif-unplugged-2774a932-7806-4c06-a128-e067a3072ebc {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG nova.compute.manager [req-d229e529-4e45-4dae-a536-c38505e2c1e6 req-ce7a562a-e875-40ef-98cd-afd0114516bc service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-vif-unplugged-2774a932-7806-4c06-a128-e067a3072ebc for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG nova.compute.manager [req-d229e529-4e45-4dae-a536-c38505e2c1e6 req-ce7a562a-e875-40ef-98cd-afd0114516bc service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-vif-plugged-2774a932-7806-4c06-a128-e067a3072ebc {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d229e529-4e45-4dae-a536-c38505e2c1e6 req-ce7a562a-e875-40ef-98cd-afd0114516bc service nova] Acquiring lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d229e529-4e45-4dae-a536-c38505e2c1e6 req-ce7a562a-e875-40ef-98cd-afd0114516bc service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d229e529-4e45-4dae-a536-c38505e2c1e6 req-ce7a562a-e875-40ef-98cd-afd0114516bc service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG nova.compute.manager [req-d229e529-4e45-4dae-a536-c38505e2c1e6 req-ce7a562a-e875-40ef-98cd-afd0114516bc service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] No waiting events found dispatching network-vif-plugged-2774a932-7806-4c06-a128-e067a3072ebc {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:01:28 user nova-compute[72766]: WARNING nova.compute.manager [req-d229e529-4e45-4dae-a536-c38505e2c1e6 req-ce7a562a-e875-40ef-98cd-afd0114516bc service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received unexpected event network-vif-plugged-2774a932-7806-4c06-a128-e067a3072ebc for instance with vm_state active and task_state deleting.
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f08316-c92d-4af5-bbe9-f42fa896375d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[010c3c02-d790-4e9e-8028-edacfaf4d807]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Flushing IO for device /dev/sdf {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4cface-5f66-4b5b-97ea-7a012e2003d3]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.035s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c328a25-4d75-4779-99be-e44eab95d6e1]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] SCSI volumes sdf have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef50fe09-e413-4312-8fbf-9e6a1719a123]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f3be56-2a43-40cc-ae65-1a101e816505]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d, portal: 172.16.0.220,3260]
Aug 14 23:01:28 user nova-compute[72766]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d, portal: 172.16.0.220,3260] successful.
Aug 14 23:01:28 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdc00e2e-604f-428f-bfb4-7451d23a1c9d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[09134d1a-d879-46eb-9c92-c1e24ebaf27c]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] <== disconnect_volume: return (294ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fCUzoLOg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:01:28 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2b984e-880c-40a6-9e11-22b79536d4e7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[332cd5ab-43bc-40a4-9091-0d4f32f6d456]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)
Aug 14 23:01:28 user nova-compute[72766]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba (non-flash)
Aug 14 23:01:28 user nova-compute[72766]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358 (non-flash)
Aug 14 23:01:28 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)
Aug 14 23:01:28 user nova-compute[72766]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba (non-flash)
Aug 14 23:01:28 user nova-compute[72766]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358 (non-flash)
Aug 14 23:01:28 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff16c0ed360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba'): ({'sdd'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Removing single pathed devices sdd {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e52e004-b48a-4946-86b8-552a1fe67e68]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eec59de-c174-4171-9bc1-008c24dc20f5]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Flushing IO for device /dev/sdd {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d0a94d-9bd4-449d-b9ef-427b7250d658]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.056s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[15aaafdf-0b93-4077-b2b0-98dfee543848]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] SCSI volumes sdd have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7c7ac5-96ae-4daa-b42f-eaf718f349fa]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcc32e6-8a53-4b6d-b714-83f1b1bc6e74]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba, portal: 172.16.0.220,3260]
Aug 14 23:01:28 user nova-compute[72766]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba, portal: 172.16.0.220,3260] successful.
Aug 14 23:01:28 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf11e175-5cef-45e6-94a6-0198c4db16ba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[077e600e-4f15-4b17-8abb-d13d80b4e5f1]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] <== disconnect_volume: return (296ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:01:28 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Deleting instance files /opt/stack/data/nova/instances/e503ad35-1d9e-47d8-9a25-58e2a503ff02_del
Aug 14 23:01:28 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Deletion of /opt/stack/data/nova/instances/e503ad35-1d9e-47d8-9a25-58e2a503ff02_del complete
Aug 14 23:01:28 user nova-compute[72766]: INFO nova.compute.manager [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Took 3.61 seconds to destroy the instance on the hypervisor.
Aug 14 23:01:28 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:01:28 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:01:29 user nova-compute[72766]: DEBUG nova.compute.manager [req-9e78ae0a-7db0-4d41-ba13-ad2c6585b3bf req-11b250f8-a6db-47b0-a7b4-bf882b271257 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-vif-plugged-098834fb-ad7d-4032-9f2c-28b8a206d4c4 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:01:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9e78ae0a-7db0-4d41-ba13-ad2c6585b3bf req-11b250f8-a6db-47b0-a7b4-bf882b271257 service nova] Acquiring lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:01:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9e78ae0a-7db0-4d41-ba13-ad2c6585b3bf req-11b250f8-a6db-47b0-a7b4-bf882b271257 service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:01:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9e78ae0a-7db0-4d41-ba13-ad2c6585b3bf req-11b250f8-a6db-47b0-a7b4-bf882b271257 service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:01:29 user nova-compute[72766]: DEBUG nova.compute.manager [req-9e78ae0a-7db0-4d41-ba13-ad2c6585b3bf req-11b250f8-a6db-47b0-a7b4-bf882b271257 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] No waiting events found dispatching network-vif-plugged-098834fb-ad7d-4032-9f2c-28b8a206d4c4 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:01:29 user nova-compute[72766]: WARNING nova.compute.manager [req-9e78ae0a-7db0-4d41-ba13-ad2c6585b3bf req-11b250f8-a6db-47b0-a7b4-bf882b271257 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received unexpected event network-vif-plugged-098834fb-ad7d-4032-9f2c-28b8a206d4c4 for instance with vm_state active and task_state deleting.
Aug 14 23:01:29 user nova-compute[72766]: DEBUG nova.compute.manager [req-9e78ae0a-7db0-4d41-ba13-ad2c6585b3bf req-11b250f8-a6db-47b0-a7b4-bf882b271257 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-vif-unplugged-4ad9f734-e280-4596-a00e-672de5d6ecb6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:01:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9e78ae0a-7db0-4d41-ba13-ad2c6585b3bf req-11b250f8-a6db-47b0-a7b4-bf882b271257 service nova] Acquiring lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:01:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9e78ae0a-7db0-4d41-ba13-ad2c6585b3bf req-11b250f8-a6db-47b0-a7b4-bf882b271257 service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:01:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9e78ae0a-7db0-4d41-ba13-ad2c6585b3bf req-11b250f8-a6db-47b0-a7b4-bf882b271257 service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:01:29 user nova-compute[72766]: DEBUG nova.compute.manager [req-9e78ae0a-7db0-4d41-ba13-ad2c6585b3bf req-11b250f8-a6db-47b0-a7b4-bf882b271257 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] No waiting events found dispatching network-vif-unplugged-4ad9f734-e280-4596-a00e-672de5d6ecb6 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:01:29 user nova-compute[72766]: DEBUG nova.compute.manager [req-9e78ae0a-7db0-4d41-ba13-ad2c6585b3bf req-11b250f8-a6db-47b0-a7b4-bf882b271257 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-vif-unplugged-4ad9f734-e280-4596-a00e-672de5d6ecb6 for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:01:29 user nova-compute[72766]: DEBUG nova.compute.manager [req-9e78ae0a-7db0-4d41-ba13-ad2c6585b3bf req-11b250f8-a6db-47b0-a7b4-bf882b271257 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-vif-plugged-4ad9f734-e280-4596-a00e-672de5d6ecb6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:01:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9e78ae0a-7db0-4d41-ba13-ad2c6585b3bf req-11b250f8-a6db-47b0-a7b4-bf882b271257 service nova] Acquiring lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:01:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9e78ae0a-7db0-4d41-ba13-ad2c6585b3bf req-11b250f8-a6db-47b0-a7b4-bf882b271257 service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:01:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9e78ae0a-7db0-4d41-ba13-ad2c6585b3bf req-11b250f8-a6db-47b0-a7b4-bf882b271257 service nova] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:01:29 user nova-compute[72766]: DEBUG nova.compute.manager [req-9e78ae0a-7db0-4d41-ba13-ad2c6585b3bf req-11b250f8-a6db-47b0-a7b4-bf882b271257 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] No waiting events found dispatching network-vif-plugged-4ad9f734-e280-4596-a00e-672de5d6ecb6 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:01:29 user nova-compute[72766]: WARNING nova.compute.manager [req-9e78ae0a-7db0-4d41-ba13-ad2c6585b3bf req-11b250f8-a6db-47b0-a7b4-bf882b271257 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received unexpected event network-vif-plugged-4ad9f734-e280-4596-a00e-672de5d6ecb6 for instance with vm_state active and task_state deleting.
Aug 14 23:01:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a89497f6-977e-462c-9ed3-6ee92438f0b3 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Acquiring lock "c02e6fd7-e712-45da-b35b-2fe21675e2f1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:01:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a89497f6-977e-462c-9ed3-6ee92438f0b3 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Lock "c02e6fd7-e712-45da-b35b-2fe21675e2f1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:01:29 user nova-compute[72766]: INFO nova.compute.manager [None req-a89497f6-977e-462c-9ed3-6ee92438f0b3 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Detaching volume 423f7a5d-4684-430d-a086-5fa5ce06c358
Aug 14 23:01:29 user nova-compute[72766]: INFO nova.virt.block_device [None req-a89497f6-977e-462c-9ed3-6ee92438f0b3 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Attempting to driver detach volume 423f7a5d-4684-430d-a086-5fa5ce06c358 from mountpoint /dev/vdb
Aug 14 23:01:29 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a89497f6-977e-462c-9ed3-6ee92438f0b3 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Attempting to detach device vdb from instance c02e6fd7-e712-45da-b35b-2fe21675e2f1 from the persistent domain config. {{(pid=72766) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 23:01:29 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-a89497f6-977e-462c-9ed3-6ee92438f0b3 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 23:01:29 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:01:29 user nova-compute[72766]:   <source dev="/dev/sdb"/>
Aug 14 23:01:29 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:01:29 user nova-compute[72766]:   <serial>423f7a5d-4684-430d-a086-5fa5ce06c358</serial>
Aug 14 23:01:29 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 23:01:29 user nova-compute[72766]: </disk>
Aug 14 23:01:29 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 23:01:29 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-a89497f6-977e-462c-9ed3-6ee92438f0b3 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Successfully detached device vdb from instance c02e6fd7-e712-45da-b35b-2fe21675e2f1 from the persistent domain config.
Aug 14 23:01:29 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a89497f6-977e-462c-9ed3-6ee92438f0b3 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c02e6fd7-e712-45da-b35b-2fe21675e2f1 from the live domain config. {{(pid=72766) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 23:01:29 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-a89497f6-977e-462c-9ed3-6ee92438f0b3 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 23:01:29 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:01:29 user nova-compute[72766]:   <source dev="/dev/sdb"/>
Aug 14 23:01:29 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:01:29 user nova-compute[72766]:   <serial>423f7a5d-4684-430d-a086-5fa5ce06c358</serial>
Aug 14 23:01:29 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 23:01:29 user nova-compute[72766]: </disk>
Aug 14 23:01:29 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Received event <DeviceRemovedEvent: 1692054090.4162855, c02e6fd7-e712-45da-b35b-2fe21675e2f1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72766) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a89497f6-977e-462c-9ed3-6ee92438f0b3 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c02e6fd7-e712-45da-b35b-2fe21675e2f1 {{(pid=72766) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 23:01:30 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-a89497f6-977e-462c-9ed3-6ee92438f0b3 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Successfully detached device vdb from instance c02e6fd7-e712-45da-b35b-2fe21675e2f1 from the live domain config.
Aug 14 23:01:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a89497f6-977e-462c-9ed3-6ee92438f0b3 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89497f6-977e-462c-9ed3-6ee92438f0b3 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'holwfUcP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:01:30 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-a89497f6-977e-462c-9ed3-6ee92438f0b3 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:01:30 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-a89497f6-977e-462c-9ed3-6ee92438f0b3 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-a89497f6-977e-462c-9ed3-6ee92438f0b3 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89497f6-977e-462c-9ed3-6ee92438f0b3 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[67fd505f-d0a4-4080-8f83-345b1953f82f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ecf7e4-3617-4420-8816-65fce235cff5]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89497f6-977e-462c-9ed3-6ee92438f0b3 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)
Aug 14 23:01:30 user nova-compute[72766]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358 (non-flash)
Aug 14 23:01:30 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89497f6-977e-462c-9ed3-6ee92438f0b3 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)
Aug 14 23:01:30 user nova-compute[72766]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358 (non-flash)
Aug 14 23:01:30 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89497f6-977e-462c-9ed3-6ee92438f0b3 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff16c367130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358'): ({'sdb'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-a89497f6-977e-462c-9ed3-6ee92438f0b3 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Removing single pathed devices sdb {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[936025fa-a095-4ebf-8535-91de9c0ef989]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b71bad-9ed3-4bfb-a7dc-6137146e48b0]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-a89497f6-977e-462c-9ed3-6ee92438f0b3 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Flushing IO for device /dev/sdb {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2985037-17df-4a21-a05e-fd95c321ff0f]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-a89497f6-977e-462c-9ed3-6ee92438f0b3 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e547273-bc7b-495c-ab0c-9182b0e052ee]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-a89497f6-977e-462c-9ed3-6ee92438f0b3 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-a89497f6-977e-462c-9ed3-6ee92438f0b3 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] SCSI volumes sdb have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89497f6-977e-462c-9ed3-6ee92438f0b3 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7d6953-f92d-43a8-ac3b-a27bbe2ae58d]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89497f6-977e-462c-9ed3-6ee92438f0b3 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358 -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66c51bd-fa47-4119-9764-4ac4e536debd]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89497f6-977e-462c-9ed3-6ee92438f0b3 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358, portal: 172.16.0.220,3260]
Aug 14 23:01:30 user nova-compute[72766]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358, portal: 172.16.0.220,3260] successful.
Aug 14 23:01:30 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358 -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:423f7a5d-4684-430d-a086-5fa5ce06c358 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ced9c6-da68-4687-ae23-e19d2f5c932d]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89497f6-977e-462c-9ed3-6ee92438f0b3 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-a89497f6-977e-462c-9ed3-6ee92438f0b3 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89497f6-977e-462c-9ed3-6ee92438f0b3 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] <== disconnect_volume: return (284ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:01:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a89497f6-977e-462c-9ed3-6ee92438f0b3 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:01:31 user nova-compute[72766]: DEBUG nova.compute.manager [req-6a435756-3e28-413c-9895-aa579f2e72b2 req-5614a7ba-a96b-49f0-a1b3-67c9e9a5dc4d service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-vif-deleted-098834fb-ad7d-4032-9f2c-28b8a206d4c4 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:01:31 user nova-compute[72766]: INFO nova.compute.manager [req-6a435756-3e28-413c-9895-aa579f2e72b2 req-5614a7ba-a96b-49f0-a1b3-67c9e9a5dc4d service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Neutron deleted interface 098834fb-ad7d-4032-9f2c-28b8a206d4c4; detaching it from the instance and deleting it from the info cache
Aug 14 23:01:31 user nova-compute[72766]: DEBUG nova.network.neutron [req-6a435756-3e28-413c-9895-aa579f2e72b2 req-5614a7ba-a96b-49f0-a1b3-67c9e9a5dc4d service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Updating instance_info_cache with network_info: [{"id": "4ad9f734-e280-4596-a00e-672de5d6ecb6", "address": "fa:16:3e:8c:7f:fe", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ad9f734-e2", "ovs_interfaceid": "4ad9f734-e280-4596-a00e-672de5d6ecb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5d0ea097-96cd-4d3b-8815-346a488703d2", "address": "fa:16:3e:46:88:4e", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d0ea097-96", "ovs_interfaceid": "5d0ea097-96cd-4d3b-8815-346a488703d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0d0642a2-a76e-4de1-956c-fb58280caec3", "address": "fa:16:3e:d9:c2:f7", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d0642a2-a7", "ovs_interfaceid": "0d0642a2-a76e-4de1-956c-fb58280caec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a9ba4ad3-e5eb-436a-8514-567d511f1999", "address": "fa:16:3e:30:f6:50", "network": {"id": "140290ed-5e86-4fc4-a97d-169e77a3d9d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1144325533", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9ba4ad3-e5", "ovs_interfaceid": "a9ba4ad3-e5eb-436a-8514-567d511f1999", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2774a932-7806-4c06-a128-e067a3072ebc", "address": "fa:16:3e:35:ec:2f", "network": {"id": "1f7634cf-e63f-4d83-8a75-65d21e863a21", "bridge": "br-int", "label": "tempest-device-tagging-net2-388612262", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2774a932-78", "ovs_interfaceid": "2774a932-7806-4c06-a128-e067a3072ebc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0c7d05ab-1414-4892-a28e-18b3816a1040", "address": "fa:16:3e:1f:5e:13", "network": {"id": "1f7634cf-e63f-4d83-8a75-65d21e863a21", "bridge": "br-int", "label": "tempest-device-tagging-net2-388612262", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa34f06852ad4fc9aaa9f542232d711b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c7d05ab-14", "ovs_interfaceid": "0c7d05ab-1414-4892-a28e-18b3816a1040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:01:31 user nova-compute[72766]: DEBUG nova.compute.manager [req-6a435756-3e28-413c-9895-aa579f2e72b2 req-5614a7ba-a96b-49f0-a1b3-67c9e9a5dc4d service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Detach interface failed, port_id=098834fb-ad7d-4032-9f2c-28b8a206d4c4, reason: Instance e503ad35-1d9e-47d8-9a25-58e2a503ff02 could not be found. {{(pid=72766) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 23:01:31 user nova-compute[72766]: DEBUG nova.objects.instance [None req-a89497f6-977e-462c-9ed3-6ee92438f0b3 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Lazy-loading 'flavor' on Instance uuid c02e6fd7-e712-45da-b35b-2fe21675e2f1 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:01:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a89497f6-977e-462c-9ed3-6ee92438f0b3 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Lock "c02e6fd7-e712-45da-b35b-2fe21675e2f1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.772s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:01:32 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:01:32 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Took 3.97 seconds to deallocate network for instance.
Aug 14 23:01:32 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-0e5bde2e-57dc-4c51-8277-508c41617288 req-399ca5cf-2bba-4e02-8fca-d6de64336c55 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-vif-deleted-2774a932-7806-4c06-a128-e067a3072ebc {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:01:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-0e5bde2e-57dc-4c51-8277-508c41617288 req-399ca5cf-2bba-4e02-8fca-d6de64336c55 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-vif-deleted-0d0642a2-a76e-4de1-956c-fb58280caec3 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:01:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-0e5bde2e-57dc-4c51-8277-508c41617288 req-399ca5cf-2bba-4e02-8fca-d6de64336c55 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-vif-deleted-0c7d05ab-1414-4892-a28e-18b3816a1040 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:01:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-0e5bde2e-57dc-4c51-8277-508c41617288 req-399ca5cf-2bba-4e02-8fca-d6de64336c55 service nova] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Received event network-vif-deleted-a9ba4ad3-e5eb-436a-8514-567d511f1999 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:01:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-21ee3753-46c8-483e-95f1-86c5676400a6 req-a01ffd77-3e2b-4f5a-b583-686568742b88 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Received event network-changed-8e7e311b-453d-4e17-9652-45723c7a2944 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:01:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-21ee3753-46c8-483e-95f1-86c5676400a6 req-a01ffd77-3e2b-4f5a-b583-686568742b88 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Refreshing instance network info cache due to event network-changed-8e7e311b-453d-4e17-9652-45723c7a2944. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:01:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-21ee3753-46c8-483e-95f1-86c5676400a6 req-a01ffd77-3e2b-4f5a-b583-686568742b88 service nova] Acquiring lock "refresh_cache-78f02883-99a1-493d-b6be-e43500bfba37" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:01:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-21ee3753-46c8-483e-95f1-86c5676400a6 req-a01ffd77-3e2b-4f5a-b583-686568742b88 service nova] Acquired lock "refresh_cache-78f02883-99a1-493d-b6be-e43500bfba37" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:01:33 user nova-compute[72766]: DEBUG nova.network.neutron [req-21ee3753-46c8-483e-95f1-86c5676400a6 req-a01ffd77-3e2b-4f5a-b583-686568742b88 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Refreshing network info cache for port 8e7e311b-453d-4e17-9652-45723c7a2944 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:01:34 user nova-compute[72766]: DEBUG nova.network.neutron [req-21ee3753-46c8-483e-95f1-86c5676400a6 req-a01ffd77-3e2b-4f5a-b583-686568742b88 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Updated VIF entry in instance network info cache for port 8e7e311b-453d-4e17-9652-45723c7a2944. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:01:34 user nova-compute[72766]: DEBUG nova.network.neutron [req-21ee3753-46c8-483e-95f1-86c5676400a6 req-a01ffd77-3e2b-4f5a-b583-686568742b88 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Updating instance_info_cache with network_info: [{"id": "8e7e311b-453d-4e17-9652-45723c7a2944", "address": "fa:16:3e:7e:31:c1", "network": {"id": "c07935db-7a05-49df-a504-682549f30d55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-765423768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ff897ef00ec45258b22d76ca60447fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e7e311b-45", "ovs_interfaceid": "8e7e311b-453d-4e17-9652-45723c7a2944", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:01:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-21ee3753-46c8-483e-95f1-86c5676400a6 req-a01ffd77-3e2b-4f5a-b583-686568742b88 service nova] Releasing lock "refresh_cache-78f02883-99a1-493d-b6be-e43500bfba37" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:01:35 user nova-compute[72766]: INFO nova.compute.manager [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Took 2.36 seconds to detach 3 volumes for instance.
Aug 14 23:01:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:01:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:01:35 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:01:35 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:01:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.277s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:01:35 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Deleted allocations for instance e503ad35-1d9e-47d8-9a25-58e2a503ff02
Aug 14 23:01:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b284c4a4-a805-4bc9-86ab-3ccfef4472d4 tempest-TaggedBootDevicesTest-507110939 tempest-TaggedBootDevicesTest-507110939-project-member] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.438s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:01:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 8.141s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:01:35 user nova-compute[72766]: INFO nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] During sync_power_state the instance has a pending task (deleting). Skip.
Aug 14 23:01:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "e503ad35-1d9e-47d8-9a25-58e2a503ff02" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:01:37 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:39 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:42 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692054087.5278049, e503ad35-1d9e-47d8-9a25-58e2a503ff02 => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:01:42 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] VM Stopped (Lifecycle Event)
Aug 14 23:01:42 user nova-compute[72766]: DEBUG nova.compute.manager [None req-ff9a6251-4f7a-4ecf-b297-be4e4ccf40c3 None None] [instance: e503ad35-1d9e-47d8-9a25-58e2a503ff02] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:01:42 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:47 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Acquiring lock "c3c0a004-8d70-4253-bf17-b83088e30031" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:01:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "c3c0a004-8d70-4253-bf17-b83088e30031" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:01:48 user nova-compute[72766]: DEBUG nova.objects.instance [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lazy-loading 'flavor' on Instance uuid c3c0a004-8d70-4253-bf17-b83088e30031 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:01:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "c3c0a004-8d70-4253-bf17-b83088e30031" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:01:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Acquiring lock "c3c0a004-8d70-4253-bf17-b83088e30031" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:01:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "c3c0a004-8d70-4253-bf17-b83088e30031" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:01:48 user nova-compute[72766]: INFO nova.compute.manager [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Attaching volume cf395def-9336-4cb6-9e96-b218aee5d8c3 to /dev/vdb
Aug 14 23:01:48 user nova-compute[72766]: DEBUG os_brick.utils [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:01:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:48 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[100eb5b6-1a63-4e0e-ab2c-7d317f31ce51]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:48 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a85660-17be-49a8-9336-4f38ca02d339]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:48 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d489ec04-6678-40f7-ab02-2cb4fe53a9f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:48 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[84272549-ac16-4c8d-988f-9957a1f19891]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:01:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 23:01:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:01:48 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 23:01:48 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[15beac1b-30ce-4344-b704-b84b8245fd59]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 23:01:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 23:01:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 23:01:48 user nova-compute[72766]: DEBUG os_brick.utils [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:01:48 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Updating existing volume attachment record: e6444e45-1342-4980-a961-faad66cca9ac {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 23:01:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1013e976-ea4a-4b49-88f4-3d698f4aa299 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Acquiring lock "0850bb6c-6e3e-4007-8478-8eba53089158" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:01:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1013e976-ea4a-4b49-88f4-3d698f4aa299 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lock "0850bb6c-6e3e-4007-8478-8eba53089158" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:01:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1013e976-ea4a-4b49-88f4-3d698f4aa299 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Acquiring lock "0850bb6c-6e3e-4007-8478-8eba53089158-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:01:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1013e976-ea4a-4b49-88f4-3d698f4aa299 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lock "0850bb6c-6e3e-4007-8478-8eba53089158-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:01:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1013e976-ea4a-4b49-88f4-3d698f4aa299 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lock "0850bb6c-6e3e-4007-8478-8eba53089158-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:01:52 user nova-compute[72766]: INFO nova.compute.manager [None req-1013e976-ea4a-4b49-88f4-3d698f4aa299 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Terminating instance
Aug 14 23:01:52 user nova-compute[72766]: DEBUG nova.compute.manager [None req-1013e976-ea4a-4b49-88f4-3d698f4aa299 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:01:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f62d9d55-429b-4800-936a-4a5ac6046250 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Acquiring lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:01:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f62d9d55-429b-4800-936a-4a5ac6046250 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:01:52 user nova-compute[72766]: DEBUG nova.compute.manager [req-fccacbb1-d03c-4698-b505-5d00ce09c547 req-6a91e307-d409-4c30-b437-49c3e2085018 service nova] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Received event network-vif-unplugged-9c7ce835-f163-4f4a-bd47-26d5e06ff451 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:01:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-fccacbb1-d03c-4698-b505-5d00ce09c547 req-6a91e307-d409-4c30-b437-49c3e2085018 service nova] Acquiring lock "0850bb6c-6e3e-4007-8478-8eba53089158-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:01:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-fccacbb1-d03c-4698-b505-5d00ce09c547 req-6a91e307-d409-4c30-b437-49c3e2085018 service nova] Lock "0850bb6c-6e3e-4007-8478-8eba53089158-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:01:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-fccacbb1-d03c-4698-b505-5d00ce09c547 req-6a91e307-d409-4c30-b437-49c3e2085018 service nova] Lock "0850bb6c-6e3e-4007-8478-8eba53089158-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:01:52 user nova-compute[72766]: DEBUG nova.compute.manager [req-fccacbb1-d03c-4698-b505-5d00ce09c547 req-6a91e307-d409-4c30-b437-49c3e2085018 service nova] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] No waiting events found dispatching network-vif-unplugged-9c7ce835-f163-4f4a-bd47-26d5e06ff451 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:01:52 user nova-compute[72766]: DEBUG nova.compute.manager [req-fccacbb1-d03c-4698-b505-5d00ce09c547 req-6a91e307-d409-4c30-b437-49c3e2085018 service nova] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Received event network-vif-unplugged-9c7ce835-f163-4f4a-bd47-26d5e06ff451 for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:01:52 user nova-compute[72766]: INFO nova.compute.manager [None req-f62d9d55-429b-4800-936a-4a5ac6046250 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Detaching volume b5405a72-4678-4dd0-a1b6-67ec1f44c492
Aug 14 23:01:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:53 user nova-compute[72766]: INFO nova.virt.block_device [None req-f62d9d55-429b-4800-936a-4a5ac6046250 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Attempting to driver detach volume b5405a72-4678-4dd0-a1b6-67ec1f44c492 from mountpoint /dev/vdb
Aug 14 23:01:53 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f62d9d55-429b-4800-936a-4a5ac6046250 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Attempting to detach device vdb from instance 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1 from the persistent domain config. {{(pid=72766) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-f62d9d55-429b-4800-936a-4a5ac6046250 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 23:01:53 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:01:53 user nova-compute[72766]:   <source dev="/dev/sde"/>
Aug 14 23:01:53 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:01:53 user nova-compute[72766]:   <serial>b5405a72-4678-4dd0-a1b6-67ec1f44c492</serial>
Aug 14 23:01:53 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 23:01:53 user nova-compute[72766]: </disk>
Aug 14 23:01:53 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 23:01:53 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-f62d9d55-429b-4800-936a-4a5ac6046250 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Successfully detached device vdb from instance 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1 from the persistent domain config.
Aug 14 23:01:53 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f62d9d55-429b-4800-936a-4a5ac6046250 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1 from the live domain config. {{(pid=72766) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-f62d9d55-429b-4800-936a-4a5ac6046250 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 23:01:53 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:01:53 user nova-compute[72766]:   <source dev="/dev/sde"/>
Aug 14 23:01:53 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:01:53 user nova-compute[72766]:   <serial>b5405a72-4678-4dd0-a1b6-67ec1f44c492</serial>
Aug 14 23:01:53 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 23:01:53 user nova-compute[72766]: </disk>
Aug 14 23:01:53 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Received event <DeviceRemovedEvent: 1692054113.5398946, 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72766) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f62d9d55-429b-4800-936a-4a5ac6046250 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1 {{(pid=72766) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 23:01:53 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-f62d9d55-429b-4800-936a-4a5ac6046250 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Successfully detached device vdb from instance 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1 from the live domain config.
Aug 14 23:01:53 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f62d9d55-429b-4800-936a-4a5ac6046250 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-f62d9d55-429b-4800-936a-4a5ac6046250 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DxudpZVQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:01:53 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-f62d9d55-429b-4800-936a-4a5ac6046250 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:01:53 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-f62d9d55-429b-4800-936a-4a5ac6046250 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-f62d9d55-429b-4800-936a-4a5ac6046250 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-f62d9d55-429b-4800-936a-4a5ac6046250 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:01:53 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Instance destroyed successfully.
Aug 14 23:01:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG nova.objects.instance [None req-1013e976-ea4a-4b49-88f4-3d698f4aa299 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lazy-loading 'resources' on Instance uuid 0850bb6c-6e3e-4007-8478-8eba53089158 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-1013e976-ea4a-4b49-88f4-3d698f4aa299 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:55:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1199111164',display_name='tempest-VolumesAdminNegativeTest-server-1199111164',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1199111164',id=4,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKscx0W5tsfUh4bXGIBtAwBDMFfny4vbkncDw1/ponDrbPfWg+ZWPoWUnztMgmYr+df3EkK7oDm/K4We5xOWgKz+OsVYZgd+z7QnzX3Fejs56HmJrNxo3evVaP8WPz0uew==',key_name='tempest-keypair-1632503232',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:55:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61a77920bef94526816c1a9c95531cb2',ramdisk_id='',reservation_id='r-wfudu0yb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1115082797',owner_user_name='tempest-VolumesAdminNegativeTest-1115082797-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:55:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7df5fafd6ca47179dec9cd295c46233',uuid=0850bb6c-6e3e-4007-8478-8eba53089158,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c7ce835-f163-4f4a-bd47-26d5e06ff451", "address": "fa:16:3e:38:75:a9", "network": {"id": "9bdd38f5-9734-4c5a-8a1c-5296215e6944", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1610393487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61a77920bef94526816c1a9c95531cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7ce835-f1", "ovs_interfaceid": "9c7ce835-f163-4f4a-bd47-26d5e06ff451", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-1013e976-ea4a-4b49-88f4-3d698f4aa299 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Converting VIF {"id": "9c7ce835-f163-4f4a-bd47-26d5e06ff451", "address": "fa:16:3e:38:75:a9", "network": {"id": "9bdd38f5-9734-4c5a-8a1c-5296215e6944", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1610393487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61a77920bef94526816c1a9c95531cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c7ce835-f1", "ovs_interfaceid": "9c7ce835-f163-4f4a-bd47-26d5e06ff451", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-1013e976-ea4a-4b49-88f4-3d698f4aa299 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:75:a9,bridge_name='br-int',has_traffic_filtering=True,id=9c7ce835-f163-4f4a-bd47-26d5e06ff451,network=Network(9bdd38f5-9734-4c5a-8a1c-5296215e6944),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c7ce835-f1') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG os_vif [None req-1013e976-ea4a-4b49-88f4-3d698f4aa299 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:75:a9,bridge_name='br-int',has_traffic_filtering=True,id=9c7ce835-f163-4f4a-bd47-26d5e06ff451,network=Network(9bdd38f5-9734-4c5a-8a1c-5296215e6944),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c7ce835-f1') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca39be59-97b2-4e93-a456-e836ce02a152]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c7ce835-f1, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:01:53 user nova-compute[72766]: INFO os_vif [None req-1013e976-ea4a-4b49-88f4-3d698f4aa299 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:75:a9,bridge_name='br-int',has_traffic_filtering=True,id=9c7ce835-f163-4f4a-bd47-26d5e06ff451,network=Network(9bdd38f5-9734-4c5a-8a1c-5296215e6944),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c7ce835-f1')
Aug 14 23:01:53 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-1013e976-ea4a-4b49-88f4-3d698f4aa299 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Deleting instance files /opt/stack/data/nova/instances/0850bb6c-6e3e-4007-8478-8eba53089158_del
Aug 14 23:01:53 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-1013e976-ea4a-4b49-88f4-3d698f4aa299 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Deletion of /opt/stack/data/nova/instances/0850bb6c-6e3e-4007-8478-8eba53089158_del complete
Aug 14 23:01:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[696173b6-1bbf-4e6f-a0dc-77e4e0b92af3]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Acquiring lock "391b2d43-3c9d-42db-bfae-09e8410bf367" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-f62d9d55-429b-4800-936a-4a5ac6046250 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)
Aug 14 23:01:53 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-f62d9d55-429b-4800-936a-4a5ac6046250 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 (non-flash)
Aug 14 23:01:53 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-f62d9d55-429b-4800-936a-4a5ac6046250 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff154443130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492'): ({'sde'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-f62d9d55-429b-4800-936a-4a5ac6046250 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Removing single pathed devices sde {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG nova.compute.manager [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd615c6c-a6a3-4a09-978e-831fab0e84db]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:53 user nova-compute[72766]: INFO nova.compute.manager [None req-1013e976-ea4a-4b49-88f4-3d698f4aa299 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Took 1.22 seconds to destroy the instance on the hypervisor.
Aug 14 23:01:53 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-1013e976-ea4a-4b49-88f4-3d698f4aa299 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[750b672c-372d-4f98-b7a0-8ab5c7da6f2f]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-f62d9d55-429b-4800-936a-4a5ac6046250 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Flushing IO for device /dev/sde {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0940a8-a389-450a-9c87-c919c15fd2f4]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-f62d9d55-429b-4800-936a-4a5ac6046250 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 23:01:53 user nova-compute[72766]: INFO nova.compute.claims [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Claim successful on node user
Aug 14 23:01:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff2cf93-e3f9-4be1-a738-e3c367a10b46]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-f62d9d55-429b-4800-936a-4a5ac6046250 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-f62d9d55-429b-4800-936a-4a5ac6046250 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] SCSI volumes sde have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-f62d9d55-429b-4800-936a-4a5ac6046250 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc06509-906d-49c9-937b-bd67426ab258]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-f62d9d55-429b-4800-936a-4a5ac6046250 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[949fd3e2-9e0a-4912-9df3-af173fd551a7]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-f62d9d55-429b-4800-936a-4a5ac6046250 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492, portal: 172.16.0.220,3260]
Aug 14 23:01:53 user nova-compute[72766]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492, portal: 172.16.0.220,3260] successful.
Aug 14 23:01:53 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5405a72-4678-4dd0-a1b6-67ec1f44c492 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ddee0a-b3ec-46d6-96e4-7e121f78506c]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-f62d9d55-429b-4800-936a-4a5ac6046250 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-f62d9d55-429b-4800-936a-4a5ac6046250 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-f62d9d55-429b-4800-936a-4a5ac6046250 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] <== disconnect_volume: return (337ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:01:53 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f62d9d55-429b-4800-936a-4a5ac6046250 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:01:54 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:01:54 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:01:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.418s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:01:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 23:01:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 23:01:54 user nova-compute[72766]: DEBUG nova.network.neutron [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 23:01:54 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 23:01:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 23:01:54 user nova-compute[72766]: INFO nova.virt.block_device [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Booting with volume f56da68f-0792-4fe2-b21f-5a00a5c912b9 at /dev/vda
Aug 14 23:01:54 user nova-compute[72766]: DEBUG os_brick.utils [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:01:54 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:54 user nova-compute[72766]: DEBUG nova.policy [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d27477e14d64946a9ba1aa553b28ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6b2b6ac4b246ff90b646e9d1ffc9c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 23:01:54 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:54 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[33500be9-17f0-4a9a-a768-377f606f9965]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:54 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:54 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:54 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8496c460-d03e-4e96-a878-5a63dbcbf800]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:54 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:54 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:54 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[455149b1-0ab5-4f12-9bf6-f495edf663b9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:54 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4eff4b7-b71d-4067-bfad-f52ee1cfbe17]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:54 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:54 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:01:54 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 23:01:54 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:54 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:01:54 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 23:01:54 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaedfcd0-24d1-4c0f-be39-49bf088651a3]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:54 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 23:01:54 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 23:01:54 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 23:01:54 user nova-compute[72766]: DEBUG os_brick.utils [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:01:54 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Updating existing volume attachment record: c2447fae-10e9-4494-b921-32a43f2d8971 {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 23:01:54 user nova-compute[72766]: DEBUG nova.objects.instance [None req-f62d9d55-429b-4800-936a-4a5ac6046250 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lazy-loading 'flavor' on Instance uuid 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:01:54 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:01:54 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Took 1.19 seconds to deallocate network for instance.
Aug 14 23:01:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f62d9d55-429b-4800-936a-4a5ac6046250 tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.957s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:01:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1013e976-ea4a-4b49-88f4-3d698f4aa299 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:01:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1013e976-ea4a-4b49-88f4-3d698f4aa299 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:01:54 user nova-compute[72766]: DEBUG nova.compute.manager [req-844a349b-3491-47dc-a468-9bce8078986e req-6db16122-567f-4b50-92d9-7c7f0a0e65d6 service nova] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Received event network-vif-plugged-9c7ce835-f163-4f4a-bd47-26d5e06ff451 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:01:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-844a349b-3491-47dc-a468-9bce8078986e req-6db16122-567f-4b50-92d9-7c7f0a0e65d6 service nova] Acquiring lock "0850bb6c-6e3e-4007-8478-8eba53089158-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:01:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-844a349b-3491-47dc-a468-9bce8078986e req-6db16122-567f-4b50-92d9-7c7f0a0e65d6 service nova] Lock "0850bb6c-6e3e-4007-8478-8eba53089158-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:01:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-844a349b-3491-47dc-a468-9bce8078986e req-6db16122-567f-4b50-92d9-7c7f0a0e65d6 service nova] Lock "0850bb6c-6e3e-4007-8478-8eba53089158-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:01:55 user nova-compute[72766]: DEBUG nova.compute.manager [req-844a349b-3491-47dc-a468-9bce8078986e req-6db16122-567f-4b50-92d9-7c7f0a0e65d6 service nova] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] No waiting events found dispatching network-vif-plugged-9c7ce835-f163-4f4a-bd47-26d5e06ff451 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:01:55 user nova-compute[72766]: WARNING nova.compute.manager [req-844a349b-3491-47dc-a468-9bce8078986e req-6db16122-567f-4b50-92d9-7c7f0a0e65d6 service nova] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Received unexpected event network-vif-plugged-9c7ce835-f163-4f4a-bd47-26d5e06ff451 for instance with vm_state deleted and task_state None.
Aug 14 23:01:55 user nova-compute[72766]: DEBUG nova.compute.manager [req-844a349b-3491-47dc-a468-9bce8078986e req-6db16122-567f-4b50-92d9-7c7f0a0e65d6 service nova] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Received event network-vif-deleted-9c7ce835-f163-4f4a-bd47-26d5e06ff451 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:01:55 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-1013e976-ea4a-4b49-88f4-3d698f4aa299 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:01:55 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-1013e976-ea4a-4b49-88f4-3d698f4aa299 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:01:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1013e976-ea4a-4b49-88f4-3d698f4aa299 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.316s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:01:55 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-1013e976-ea4a-4b49-88f4-3d698f4aa299 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Deleted allocations for instance 0850bb6c-6e3e-4007-8478-8eba53089158
Aug 14 23:01:55 user nova-compute[72766]: DEBUG nova.network.neutron [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Successfully created port: a084e92b-2287-4ac4-a9a5-db86f3d3249e {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 23:01:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1013e976-ea4a-4b49-88f4-3d698f4aa299 tempest-VolumesAdminNegativeTest-1115082797 tempest-VolumesAdminNegativeTest-1115082797-project-member] Lock "0850bb6c-6e3e-4007-8478-8eba53089158" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.935s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:01:55 user nova-compute[72766]: DEBUG nova.network.neutron [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Successfully created port: c48d46cf-70b1-408c-aee6-8965fb8356b0 {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 23:01:56 user nova-compute[72766]: DEBUG nova.network.neutron [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Successfully created port: e418f46c-a8f2-4cbe-b422-b8aad6f84236 {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 23:01:57 user nova-compute[72766]: DEBUG nova.network.neutron [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Successfully created port: 10cc8607-5dd0-4310-b2eb-ff4f5196573c {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 23:01:57 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 23:01:57 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qRFvyifB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:01:57 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:01:57 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:01:57 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:01:57 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:01:57 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:01:57 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:01:57 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 23:01:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3 -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:57 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[050d5d30-7941-4382-9024-6f775d8e72b5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:57 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 23:01:57 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:01:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:57 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e71196-753e-444b-a5eb-a6dc71e632ff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:57 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3] added
Aug 14 23:01:57 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:01:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:57 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcdf9b4-e3d2-4563-97d1-057aac5eaab1]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:57 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:01:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:57 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a483c8-96c1-4287-b0dd-0b0801048786]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:57 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:01:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qRFvyifB {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qRFvyifB" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:57 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[77838414-6bb4-4148-a112-386243cd2b10]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:57 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qRFvyifB'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:01:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:57 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa9bb13-736c-4e79-97a3-d525791f5897]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:57 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:01:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:57 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed87ba7-53fa-4cef-bb18-9648651e0853]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:57 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 23:01:57 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:01:57 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 23:01:57 user nova-compute[72766]:  {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:01:57 user nova-compute[72766]: WARNING os_brick.initiator.connectors.iscsi [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 23:01:57 user nova-compute[72766]: 
Aug 14 23:01:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3 -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:58 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a704bc7-6f8a-4317-95c2-1e5007c45c4c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3, portal: 172.16.0.220,3260]
Aug 14 23:01:58 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3, portal: 172.16.0.220,3260] successful.
Aug 14 23:01:58 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:01:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:58 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0848bb-6c51-423e-8bd0-62ba14d79535]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:01:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:58 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[eefb1162-709b-48bf-a364-df0f5bf33245]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3 (non-flash)
Aug 14 23:01:58 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:01:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3 (non-flash)
Aug 14 23:01:58 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:01:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:01:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 23:01:58 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 23:01:58 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 23:01:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:01:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:01:58 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[46207537-3a98-4ed4-94ef-3e49e6889ae8]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:01:58 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: None {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:01:58 user nova-compute[72766]: DEBUG nova.network.neutron [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Successfully created port: f59675e3-d424-46f3-b3ef-ea1133f0aafd {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 23:01:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:01:59 user nova-compute[72766]: DEBUG nova.network.neutron [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Successfully updated port: a084e92b-2287-4ac4-a9a5-db86f3d3249e {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 23:01:59 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:01:59 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qRFvyifB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 23:01:59 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:01:59 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '26137656366663564', 'path': '/dev/sdb'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:01:59 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137656366663564', 'path': '/dev/sdb'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 23:01:59 user nova-compute[72766]: DEBUG nova.objects.instance [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lazy-loading 'flavor' on Instance uuid c3c0a004-8d70-4253-bf17-b83088e30031 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:01:59 user nova-compute[72766]: DEBUG nova.compute.manager [req-1c056663-fa73-4eec-8ab4-1c542c2202d0 req-fb416f1b-47b9-4a8b-a2bd-80124db7f507 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-changed-a084e92b-2287-4ac4-a9a5-db86f3d3249e {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:01:59 user nova-compute[72766]: DEBUG nova.compute.manager [req-1c056663-fa73-4eec-8ab4-1c542c2202d0 req-fb416f1b-47b9-4a8b-a2bd-80124db7f507 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Refreshing instance network info cache due to event network-changed-a084e92b-2287-4ac4-a9a5-db86f3d3249e. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:01:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-1c056663-fa73-4eec-8ab4-1c542c2202d0 req-fb416f1b-47b9-4a8b-a2bd-80124db7f507 service nova] Acquiring lock "refresh_cache-391b2d43-3c9d-42db-bfae-09e8410bf367" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:01:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-1c056663-fa73-4eec-8ab4-1c542c2202d0 req-fb416f1b-47b9-4a8b-a2bd-80124db7f507 service nova] Acquired lock "refresh_cache-391b2d43-3c9d-42db-bfae-09e8410bf367" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:01:59 user nova-compute[72766]: DEBUG nova.network.neutron [req-1c056663-fa73-4eec-8ab4-1c542c2202d0 req-fb416f1b-47b9-4a8b-a2bd-80124db7f507 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Refreshing network info cache for port a084e92b-2287-4ac4-a9a5-db86f3d3249e {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:01:59 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 23:01:59 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:01:59 user nova-compute[72766]:   <source dev="/dev/sdb"/>
Aug 14 23:01:59 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:01:59 user nova-compute[72766]:   <serial>cf395def-9336-4cb6-9e96-b218aee5d8c3</serial>
Aug 14 23:01:59 user nova-compute[72766]: </disk>
Aug 14 23:01:59 user nova-compute[72766]:  {{(pid=72766) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 23:01:59 user nova-compute[72766]: DEBUG nova.network.neutron [req-1c056663-fa73-4eec-8ab4-1c542c2202d0 req-fb416f1b-47b9-4a8b-a2bd-80124db7f507 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 23:01:59 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:01:59 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:01:59 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] No VIF found with MAC fa:16:3e:96:85:b3, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:01:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ea7bec8b-97c8-450f-889f-0f96273de076 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "c3c0a004-8d70-4253-bf17-b83088e30031" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.310s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:01:59 user nova-compute[72766]: DEBUG nova.network.neutron [req-1c056663-fa73-4eec-8ab4-1c542c2202d0 req-fb416f1b-47b9-4a8b-a2bd-80124db7f507 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:01:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-1c056663-fa73-4eec-8ab4-1c542c2202d0 req-fb416f1b-47b9-4a8b-a2bd-80124db7f507 service nova] Releasing lock "refresh_cache-391b2d43-3c9d-42db-bfae-09e8410bf367" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:02:00 user nova-compute[72766]: DEBUG nova.network.neutron [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Successfully updated port: 458b086a-58f5-451f-936d-6f64a04ad64e {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 23:02:01 user nova-compute[72766]: DEBUG nova.network.neutron [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Successfully updated port: 437cdad2-00fb-4ac6-9fce-a67767cd4bda {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 23:02:01 user nova-compute[72766]: DEBUG nova.compute.manager [req-a6fe2089-0c08-4c56-affa-1870cc401148 req-dc28f292-ce1c-4622-908c-4b7c4778d8a8 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-changed-458b086a-58f5-451f-936d-6f64a04ad64e {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:02:01 user nova-compute[72766]: DEBUG nova.compute.manager [req-a6fe2089-0c08-4c56-affa-1870cc401148 req-dc28f292-ce1c-4622-908c-4b7c4778d8a8 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Refreshing instance network info cache due to event network-changed-458b086a-58f5-451f-936d-6f64a04ad64e. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:02:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a6fe2089-0c08-4c56-affa-1870cc401148 req-dc28f292-ce1c-4622-908c-4b7c4778d8a8 service nova] Acquiring lock "refresh_cache-391b2d43-3c9d-42db-bfae-09e8410bf367" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:02:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a6fe2089-0c08-4c56-affa-1870cc401148 req-dc28f292-ce1c-4622-908c-4b7c4778d8a8 service nova] Acquired lock "refresh_cache-391b2d43-3c9d-42db-bfae-09e8410bf367" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:02:01 user nova-compute[72766]: DEBUG nova.network.neutron [req-a6fe2089-0c08-4c56-affa-1870cc401148 req-dc28f292-ce1c-4622-908c-4b7c4778d8a8 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Refreshing network info cache for port 458b086a-58f5-451f-936d-6f64a04ad64e {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:02:01 user nova-compute[72766]: DEBUG nova.network.neutron [req-a6fe2089-0c08-4c56-affa-1870cc401148 req-dc28f292-ce1c-4622-908c-4b7c4778d8a8 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 23:02:01 user nova-compute[72766]: DEBUG nova.network.neutron [req-a6fe2089-0c08-4c56-affa-1870cc401148 req-dc28f292-ce1c-4622-908c-4b7c4778d8a8 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:02:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a6fe2089-0c08-4c56-affa-1870cc401148 req-dc28f292-ce1c-4622-908c-4b7c4778d8a8 service nova] Releasing lock "refresh_cache-391b2d43-3c9d-42db-bfae-09e8410bf367" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:02:02 user nova-compute[72766]: DEBUG nova.network.neutron [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Successfully updated port: c48d46cf-70b1-408c-aee6-8965fb8356b0 {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 23:02:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-58b8beaf-2b58-4347-9f70-e0379786153d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Acquiring lock "c3c0a004-8d70-4253-bf17-b83088e30031" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:02:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-58b8beaf-2b58-4347-9f70-e0379786153d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "c3c0a004-8d70-4253-bf17-b83088e30031" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:02:02 user nova-compute[72766]: INFO nova.compute.manager [None req-58b8beaf-2b58-4347-9f70-e0379786153d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Detaching volume cf395def-9336-4cb6-9e96-b218aee5d8c3
Aug 14 23:02:02 user nova-compute[72766]: INFO nova.virt.block_device [None req-58b8beaf-2b58-4347-9f70-e0379786153d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Attempting to driver detach volume cf395def-9336-4cb6-9e96-b218aee5d8c3 from mountpoint /dev/vdb
Aug 14 23:02:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-58b8beaf-2b58-4347-9f70-e0379786153d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Attempting to detach device vdb from instance c3c0a004-8d70-4253-bf17-b83088e30031 from the persistent domain config. {{(pid=72766) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 23:02:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-58b8beaf-2b58-4347-9f70-e0379786153d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 23:02:02 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:02:02 user nova-compute[72766]:   <source dev="/dev/sdb"/>
Aug 14 23:02:02 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:02:02 user nova-compute[72766]:   <serial>cf395def-9336-4cb6-9e96-b218aee5d8c3</serial>
Aug 14 23:02:02 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 23:02:02 user nova-compute[72766]: </disk>
Aug 14 23:02:02 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 23:02:02 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-58b8beaf-2b58-4347-9f70-e0379786153d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Successfully detached device vdb from instance c3c0a004-8d70-4253-bf17-b83088e30031 from the persistent domain config.
Aug 14 23:02:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-58b8beaf-2b58-4347-9f70-e0379786153d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c3c0a004-8d70-4253-bf17-b83088e30031 from the live domain config. {{(pid=72766) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 23:02:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-58b8beaf-2b58-4347-9f70-e0379786153d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 23:02:02 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:02:02 user nova-compute[72766]:   <source dev="/dev/sdb"/>
Aug 14 23:02:02 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:02:02 user nova-compute[72766]:   <serial>cf395def-9336-4cb6-9e96-b218aee5d8c3</serial>
Aug 14 23:02:02 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 23:02:02 user nova-compute[72766]: </disk>
Aug 14 23:02:02 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 23:02:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Received event <DeviceRemovedEvent: 1692054122.959906, c3c0a004-8d70-4253-bf17-b83088e30031 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72766) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 23:02:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-58b8beaf-2b58-4347-9f70-e0379786153d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c3c0a004-8d70-4253-bf17-b83088e30031 {{(pid=72766) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 23:02:02 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-58b8beaf-2b58-4347-9f70-e0379786153d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Successfully detached device vdb from instance c3c0a004-8d70-4253-bf17-b83088e30031 from the live domain config.
Aug 14 23:02:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58b8beaf-2b58-4347-9f70-e0379786153d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:02:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-58b8beaf-2b58-4347-9f70-e0379786153d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qRFvyifB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:02:02 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-58b8beaf-2b58-4347-9f70-e0379786153d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:02:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-58b8beaf-2b58-4347-9f70-e0379786153d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:02:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-58b8beaf-2b58-4347-9f70-e0379786153d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:02:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-58b8beaf-2b58-4347-9f70-e0379786153d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:02:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:02 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[879b8277-0399-4b9b-a814-2c07e33fc433]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61f037b-fb09-4798-a546-66e2458f66b7]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-58b8beaf-2b58-4347-9f70-e0379786153d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3 (non-flash)
Aug 14 23:02:03 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-58b8beaf-2b58-4347-9f70-e0379786153d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3 (non-flash)
Aug 14 23:02:03 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-58b8beaf-2b58-4347-9f70-e0379786153d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff1544c7b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3'): ({'sdb'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-58b8beaf-2b58-4347-9f70-e0379786153d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Removing single pathed devices sdb {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d20ad1-bf5a-409b-bc58-75c9b8ac802e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d461132a-92a5-40a1-b21f-9cc4b544625a]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-58b8beaf-2b58-4347-9f70-e0379786153d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Flushing IO for device /dev/sdb {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c95ae5d-be37-4c00-9812-fc930d3e4613]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-58b8beaf-2b58-4347-9f70-e0379786153d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[0137f451-83dc-4657-b007-f7a5e208f859]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-58b8beaf-2b58-4347-9f70-e0379786153d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-58b8beaf-2b58-4347-9f70-e0379786153d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] SCSI volumes sdb have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-58b8beaf-2b58-4347-9f70-e0379786153d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd76be2-a206-432f-8761-917020cd056b]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-58b8beaf-2b58-4347-9f70-e0379786153d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3 -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[294587f0-a035-4a38-bbf5-66157571950a]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-58b8beaf-2b58-4347-9f70-e0379786153d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3, portal: 172.16.0.220,3260]
Aug 14 23:02:03 user nova-compute[72766]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3, portal: 172.16.0.220,3260] successful.
Aug 14 23:02:03 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3 -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf395def-9336-4cb6-9e96-b218aee5d8c3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5bc344-b25b-4bdc-a3c2-08b19097adc8]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-58b8beaf-2b58-4347-9f70-e0379786153d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-58b8beaf-2b58-4347-9f70-e0379786153d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-58b8beaf-2b58-4347-9f70-e0379786153d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] <== disconnect_volume: return (269ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58b8beaf-2b58-4347-9f70-e0379786153d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG nova.compute.manager [req-eda98056-0bb6-4384-928d-2f663c4f679c req-b9333a69-3439-47d2-baed-8c2fa0b6717e service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-changed-437cdad2-00fb-4ac6-9fce-a67767cd4bda {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG nova.compute.manager [req-eda98056-0bb6-4384-928d-2f663c4f679c req-b9333a69-3439-47d2-baed-8c2fa0b6717e service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Refreshing instance network info cache due to event network-changed-437cdad2-00fb-4ac6-9fce-a67767cd4bda. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-eda98056-0bb6-4384-928d-2f663c4f679c req-b9333a69-3439-47d2-baed-8c2fa0b6717e service nova] Acquiring lock "refresh_cache-391b2d43-3c9d-42db-bfae-09e8410bf367" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-eda98056-0bb6-4384-928d-2f663c4f679c req-b9333a69-3439-47d2-baed-8c2fa0b6717e service nova] Acquired lock "refresh_cache-391b2d43-3c9d-42db-bfae-09e8410bf367" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG nova.network.neutron [req-eda98056-0bb6-4384-928d-2f663c4f679c req-b9333a69-3439-47d2-baed-8c2fa0b6717e service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Refreshing network info cache for port 437cdad2-00fb-4ac6-9fce-a67767cd4bda {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG nova.network.neutron [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Successfully updated port: e418f46c-a8f2-4cbe-b422-b8aad6f84236 {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG nova.network.neutron [req-eda98056-0bb6-4384-928d-2f663c4f679c req-b9333a69-3439-47d2-baed-8c2fa0b6717e service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG nova.network.neutron [req-eda98056-0bb6-4384-928d-2f663c4f679c req-b9333a69-3439-47d2-baed-8c2fa0b6717e service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-eda98056-0bb6-4384-928d-2f663c4f679c req-b9333a69-3439-47d2-baed-8c2fa0b6717e service nova] Releasing lock "refresh_cache-391b2d43-3c9d-42db-bfae-09e8410bf367" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG nova.compute.manager [req-eda98056-0bb6-4384-928d-2f663c4f679c req-b9333a69-3439-47d2-baed-8c2fa0b6717e service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-changed-c48d46cf-70b1-408c-aee6-8965fb8356b0 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG nova.compute.manager [req-eda98056-0bb6-4384-928d-2f663c4f679c req-b9333a69-3439-47d2-baed-8c2fa0b6717e service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Refreshing instance network info cache due to event network-changed-c48d46cf-70b1-408c-aee6-8965fb8356b0. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-eda98056-0bb6-4384-928d-2f663c4f679c req-b9333a69-3439-47d2-baed-8c2fa0b6717e service nova] Acquiring lock "refresh_cache-391b2d43-3c9d-42db-bfae-09e8410bf367" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-eda98056-0bb6-4384-928d-2f663c4f679c req-b9333a69-3439-47d2-baed-8c2fa0b6717e service nova] Acquired lock "refresh_cache-391b2d43-3c9d-42db-bfae-09e8410bf367" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG nova.network.neutron [req-eda98056-0bb6-4384-928d-2f663c4f679c req-b9333a69-3439-47d2-baed-8c2fa0b6717e service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Refreshing network info cache for port c48d46cf-70b1-408c-aee6-8965fb8356b0 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG nova.network.neutron [req-eda98056-0bb6-4384-928d-2f663c4f679c req-b9333a69-3439-47d2-baed-8c2fa0b6717e service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG nova.network.neutron [req-eda98056-0bb6-4384-928d-2f663c4f679c req-b9333a69-3439-47d2-baed-8c2fa0b6717e service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:02:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-eda98056-0bb6-4384-928d-2f663c4f679c req-b9333a69-3439-47d2-baed-8c2fa0b6717e service nova] Releasing lock "refresh_cache-391b2d43-3c9d-42db-bfae-09e8410bf367" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:02:04 user nova-compute[72766]: DEBUG nova.objects.instance [None req-58b8beaf-2b58-4347-9f70-e0379786153d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lazy-loading 'flavor' on Instance uuid c3c0a004-8d70-4253-bf17-b83088e30031 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:02:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-58b8beaf-2b58-4347-9f70-e0379786153d tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "c3c0a004-8d70-4253-bf17-b83088e30031" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.702s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:02:04 user nova-compute[72766]: DEBUG nova.network.neutron [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Successfully updated port: 10cc8607-5dd0-4310-b2eb-ff4f5196573c {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 23:02:04 user nova-compute[72766]: INFO nova.virt.block_device [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Booting with volume 0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 at /dev/vdb
Aug 14 23:02:04 user nova-compute[72766]: DEBUG os_brick.utils [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:02:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:04 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e6939d-9041-48a8-a8b5-c8c476866f19]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:04 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2370969d-ff99-4b1a-8d24-bbf58a36f06f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:04 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf88d286-d13c-4e36-b876-9cc187545949]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:04 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ca177e-060c-40d0-956c-73bd8fb0918c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:02:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 23:02:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:02:04 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 23:02:04 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[221451d1-b698-4496-bbd9-06663a6c40f8]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 23:02:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 23:02:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 23:02:04 user nova-compute[72766]: DEBUG os_brick.utils [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:02:04 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Updating existing volume attachment record: e21d7443-bd21-4964-b1c1-41f69310b2d5 {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 23:02:05 user nova-compute[72766]: DEBUG nova.network.neutron [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Successfully updated port: f59675e3-d424-46f3-b3ef-ea1133f0aafd {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 23:02:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Acquiring lock "refresh_cache-391b2d43-3c9d-42db-bfae-09e8410bf367" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:02:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Acquired lock "refresh_cache-391b2d43-3c9d-42db-bfae-09e8410bf367" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:02:05 user nova-compute[72766]: DEBUG nova.network.neutron [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:02:05 user nova-compute[72766]: DEBUG nova.network.neutron [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 23:02:05 user nova-compute[72766]: DEBUG nova.compute.manager [req-0ebdb0d7-1dd2-4f1f-af2f-5d4835f6d23c req-9d3d5418-cd6c-44f8-bf1e-50cdcb232e4e service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-changed-e418f46c-a8f2-4cbe-b422-b8aad6f84236 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:02:05 user nova-compute[72766]: DEBUG nova.compute.manager [req-0ebdb0d7-1dd2-4f1f-af2f-5d4835f6d23c req-9d3d5418-cd6c-44f8-bf1e-50cdcb232e4e service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Refreshing instance network info cache due to event network-changed-e418f46c-a8f2-4cbe-b422-b8aad6f84236. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:02:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0ebdb0d7-1dd2-4f1f-af2f-5d4835f6d23c req-9d3d5418-cd6c-44f8-bf1e-50cdcb232e4e service nova] Acquiring lock "refresh_cache-391b2d43-3c9d-42db-bfae-09e8410bf367" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:02:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Acquiring lock "4d919875-5f24-4bed-bf26-cf437e0de3e2" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:02:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Lock "4d919875-5f24-4bed-bf26-cf437e0de3e2" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:02:06 user nova-compute[72766]: INFO nova.compute.manager [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Unshelving
Aug 14 23:02:06 user nova-compute[72766]: INFO nova.virt.block_device [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Booting with volume cc05004f-3360-4071-bd51-ce172fb18886 at /dev/vda
Aug 14 23:02:06 user nova-compute[72766]: DEBUG os_brick.utils [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:02:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:06 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5104a08-198c-4541-8774-270fb4783f2e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:07 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7175cd-7d85-4a68-99a1-40c1b2c2a7b2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:07 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8115cd5c-5d9b-404b-905e-ed4c69a82ef0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:07 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[705d95a9-06eb-4f2a-b07f-15f38a0ca9f3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:02:07 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 23:02:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:02:07 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 23:02:07 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab569a39-0599-44fd-b643-7a47fbd63772]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:07 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 23:02:07 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 23:02:07 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 23:02:07 user nova-compute[72766]: DEBUG os_brick.utils [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:02:07 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Updating existing volume attachment record: 11eb2e43-1f44-4320-a58d-d0f7335e4db1 {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 23:02:07 user nova-compute[72766]: DEBUG nova.compute.manager [None req-4d838356-c799-4fac-a298-0ecf2e8f0ec6 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:02:07 user nova-compute[72766]: INFO nova.compute.manager [None req-4d838356-c799-4fac-a298-0ecf2e8f0ec6 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] instance snapshotting
Aug 14 23:02:07 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-4d838356-c799-4fac-a298-0ecf2e8f0ec6 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Beginning live snapshot process
Aug 14 23:02:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-4d838356-c799-4fac-a298-0ecf2e8f0ec6 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json -f qcow2 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-4d838356-c799-4fac-a298-0ecf2e8f0ec6 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json -f qcow2" returned: 0 in 0.187s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-4d838356-c799-4fac-a298-0ecf2e8f0ec6 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json -f qcow2 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-4d838356-c799-4fac-a298-0ecf2e8f0ec6 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-4d838356-c799-4fac-a298-0ecf2e8f0ec6 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-4d838356-c799-4fac-a298-0ecf2e8f0ec6 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.183s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-4d838356-c799-4fac-a298-0ecf2e8f0ec6 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpwmr7blqj/6e03a151dc7c4cfd9046498980f7ba6d.delta 1073741824 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-4d838356-c799-4fac-a298-0ecf2e8f0ec6 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpwmr7blqj/6e03a151dc7c4cfd9046498980f7ba6d.delta 1073741824" returned: 0 in 0.048s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:08 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-4d838356-c799-4fac-a298-0ecf2e8f0ec6 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 14 23:02:08 user nova-compute[72766]: DEBUG nova.network.neutron [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Updating instance_info_cache with network_info: [{"id": "a084e92b-2287-4ac4-a9a5-db86f3d3249e", "address": "fa:16:3e:c1:4c:ad", "network": {"id": "480be190-a4a8-46bd-b68f-c9f2241cfd5f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-734889840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa084e92b-22", "ovs_interfaceid": "a084e92b-2287-4ac4-a9a5-db86f3d3249e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "458b086a-58f5-451f-936d-6f64a04ad64e", "address": "fa:16:3e:23:3a:7d", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap458b086a-58", "ovs_interfaceid": "458b086a-58f5-451f-936d-6f64a04ad64e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "437cdad2-00fb-4ac6-9fce-a67767cd4bda", "address": "fa:16:3e:29:78:c5", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap437cdad2-00", "ovs_interfaceid": "437cdad2-00fb-4ac6-9fce-a67767cd4bda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c48d46cf-70b1-408c-aee6-8965fb8356b0", "address": "fa:16:3e:23:98:99", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48d46cf-70", "ovs_interfaceid": "c48d46cf-70b1-408c-aee6-8965fb8356b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e418f46c-a8f2-4cbe-b422-b8aad6f84236", "address": "fa:16:3e:5b:c8:16", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape418f46c-a8", "ovs_interfaceid": "e418f46c-a8f2-4cbe-b422-b8aad6f84236", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10cc8607-5dd0-4310-b2eb-ff4f5196573c", "address": "fa:16:3e:53:23:da", "network": {"id": "48e40549-72ed-45cc-ba38-e2155151f40c", "bridge": "br-int", "label": "tempest-device-tagging-net2-669256899", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10cc8607-5d", "ovs_interfaceid": "10cc8607-5dd0-4310-b2eb-ff4f5196573c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f59675e3-d424-46f3-b3ef-ea1133f0aafd", "address": "fa:16:3e:b3:a0:b6", "network": {"id": "48e40549-72ed-45cc-ba38-e2155151f40c", "bridge": "br-int", "label": "tempest-device-tagging-net2-669256899", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59675e3-d4", "ovs_interfaceid": "f59675e3-d424-46f3-b3ef-ea1133f0aafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:02:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Releasing lock "refresh_cache-391b2d43-3c9d-42db-bfae-09e8410bf367" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:02:08 user nova-compute[72766]: DEBUG nova.compute.manager [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Instance network_info: |[{"id": "a084e92b-2287-4ac4-a9a5-db86f3d3249e", "address": "fa:16:3e:c1:4c:ad", "network": {"id": "480be190-a4a8-46bd-b68f-c9f2241cfd5f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-734889840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa084e92b-22", "ovs_interfaceid": "a084e92b-2287-4ac4-a9a5-db86f3d3249e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "458b086a-58f5-451f-936d-6f64a04ad64e", "address": "fa:16:3e:23:3a:7d", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap458b086a-58", "ovs_interfaceid": "458b086a-58f5-451f-936d-6f64a04ad64e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "437cdad2-00fb-4ac6-9fce-a67767cd4bda", "address": "fa:16:3e:29:78:c5", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap437cdad2-00", "ovs_interfaceid": "437cdad2-00fb-4ac6-9fce-a67767cd4bda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c48d46cf-70b1-408c-aee6-8965fb8356b0", "address": "fa:16:3e:23:98:99", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48d46cf-70", "ovs_interfaceid": "c48d46cf-70b1-408c-aee6-8965fb8356b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e418f46c-a8f2-4cbe-b422-b8aad6f84236", "address": "fa:16:3e:5b:c8:16", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape418f46c-a8", "ovs_interfaceid": "e418f46c-a8f2-4cbe-b422-b8aad6f84236", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10cc8607-5dd0-4310-b2eb-ff4f5196573c", "address": "fa:16:3e:53:23:da", "network": {"id": "48e40549-72ed-45cc-ba38-e2155151f40c", "bridge": "br-int", "label": "tempest-device-tagging-net2-669256899", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10cc8607-5d", "ovs_interfaceid": "10cc8607-5dd0-4310-b2eb-ff4f5196573c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f59675e3-d424-46f3-b3ef-ea1133f0aafd", "address": "fa:16:3e:b3:a0:b6", "network": {"id": "48e40549-72ed-45cc-ba38-e2155151f40c", "bridge": "br-int", "label": "tempest-device-tagging-net2-669256899", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59675e3-d4", "ovs_interfaceid": "f59675e3-d424-46f3-b3ef-ea1133f0aafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 23:02:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0ebdb0d7-1dd2-4f1f-af2f-5d4835f6d23c req-9d3d5418-cd6c-44f8-bf1e-50cdcb232e4e service nova] Acquired lock "refresh_cache-391b2d43-3c9d-42db-bfae-09e8410bf367" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:02:08 user nova-compute[72766]: DEBUG nova.network.neutron [req-0ebdb0d7-1dd2-4f1f-af2f-5d4835f6d23c req-9d3d5418-cd6c-44f8-bf1e-50cdcb232e4e service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Refreshing network info cache for port e418f46c-a8f2-4cbe-b422-b8aad6f84236 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:02:08 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692054113.5537488, 0850bb6c-6e3e-4007-8478-8eba53089158 => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:02:08 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] VM Stopped (Lifecycle Event)
Aug 14 23:02:08 user nova-compute[72766]: DEBUG nova.compute.manager [None req-66ebe477-7662-48c9-8dfb-1ad8c8ef6614 None None] [instance: 0850bb6c-6e3e-4007-8478-8eba53089158] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:02:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:08 user nova-compute[72766]: DEBUG nova.network.neutron [req-0ebdb0d7-1dd2-4f1f-af2f-5d4835f6d23c req-9d3d5418-cd6c-44f8-bf1e-50cdcb232e4e service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Updated VIF entry in instance network info cache for port e418f46c-a8f2-4cbe-b422-b8aad6f84236. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:02:08 user nova-compute[72766]: DEBUG nova.network.neutron [req-0ebdb0d7-1dd2-4f1f-af2f-5d4835f6d23c req-9d3d5418-cd6c-44f8-bf1e-50cdcb232e4e service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Updating instance_info_cache with network_info: [{"id": "a084e92b-2287-4ac4-a9a5-db86f3d3249e", "address": "fa:16:3e:c1:4c:ad", "network": {"id": "480be190-a4a8-46bd-b68f-c9f2241cfd5f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-734889840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa084e92b-22", "ovs_interfaceid": "a084e92b-2287-4ac4-a9a5-db86f3d3249e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "458b086a-58f5-451f-936d-6f64a04ad64e", "address": "fa:16:3e:23:3a:7d", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap458b086a-58", "ovs_interfaceid": "458b086a-58f5-451f-936d-6f64a04ad64e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "437cdad2-00fb-4ac6-9fce-a67767cd4bda", "address": "fa:16:3e:29:78:c5", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap437cdad2-00", "ovs_interfaceid": "437cdad2-00fb-4ac6-9fce-a67767cd4bda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c48d46cf-70b1-408c-aee6-8965fb8356b0", "address": "fa:16:3e:23:98:99", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48d46cf-70", "ovs_interfaceid": "c48d46cf-70b1-408c-aee6-8965fb8356b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e418f46c-a8f2-4cbe-b422-b8aad6f84236", "address": "fa:16:3e:5b:c8:16", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape418f46c-a8", "ovs_interfaceid": "e418f46c-a8f2-4cbe-b422-b8aad6f84236", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10cc8607-5dd0-4310-b2eb-ff4f5196573c", "address": "fa:16:3e:53:23:da", "network": {"id": "48e40549-72ed-45cc-ba38-e2155151f40c", "bridge": "br-int", "label": "tempest-device-tagging-net2-669256899", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10cc8607-5d", "ovs_interfaceid": "10cc8607-5dd0-4310-b2eb-ff4f5196573c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f59675e3-d424-46f3-b3ef-ea1133f0aafd", "address": "fa:16:3e:b3:a0:b6", "network": {"id": "48e40549-72ed-45cc-ba38-e2155151f40c", "bridge": "br-int", "label": "tempest-device-tagging-net2-669256899", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59675e3-d4", "ovs_interfaceid": "f59675e3-d424-46f3-b3ef-ea1133f0aafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:02:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0ebdb0d7-1dd2-4f1f-af2f-5d4835f6d23c req-9d3d5418-cd6c-44f8-bf1e-50cdcb232e4e service nova] Releasing lock "refresh_cache-391b2d43-3c9d-42db-bfae-09e8410bf367" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:02:08 user nova-compute[72766]: DEBUG nova.compute.manager [req-0ebdb0d7-1dd2-4f1f-af2f-5d4835f6d23c req-9d3d5418-cd6c-44f8-bf1e-50cdcb232e4e service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-changed-10cc8607-5dd0-4310-b2eb-ff4f5196573c {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:02:08 user nova-compute[72766]: DEBUG nova.compute.manager [req-0ebdb0d7-1dd2-4f1f-af2f-5d4835f6d23c req-9d3d5418-cd6c-44f8-bf1e-50cdcb232e4e service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Refreshing instance network info cache due to event network-changed-10cc8607-5dd0-4310-b2eb-ff4f5196573c. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:02:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0ebdb0d7-1dd2-4f1f-af2f-5d4835f6d23c req-9d3d5418-cd6c-44f8-bf1e-50cdcb232e4e service nova] Acquiring lock "refresh_cache-391b2d43-3c9d-42db-bfae-09e8410bf367" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:02:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0ebdb0d7-1dd2-4f1f-af2f-5d4835f6d23c req-9d3d5418-cd6c-44f8-bf1e-50cdcb232e4e service nova] Acquired lock "refresh_cache-391b2d43-3c9d-42db-bfae-09e8410bf367" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:02:08 user nova-compute[72766]: DEBUG nova.network.neutron [req-0ebdb0d7-1dd2-4f1f-af2f-5d4835f6d23c req-9d3d5418-cd6c-44f8-bf1e-50cdcb232e4e service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Refreshing network info cache for port 10cc8607-5dd0-4310-b2eb-ff4f5196573c {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:02:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-4d838356-c799-4fac-a298-0ecf2e8f0ec6 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72766) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 23:02:09 user nova-compute[72766]: DEBUG nova.network.neutron [req-0ebdb0d7-1dd2-4f1f-af2f-5d4835f6d23c req-9d3d5418-cd6c-44f8-bf1e-50cdcb232e4e service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Updated VIF entry in instance network info cache for port 10cc8607-5dd0-4310-b2eb-ff4f5196573c. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:02:09 user nova-compute[72766]: DEBUG nova.network.neutron [req-0ebdb0d7-1dd2-4f1f-af2f-5d4835f6d23c req-9d3d5418-cd6c-44f8-bf1e-50cdcb232e4e service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Updating instance_info_cache with network_info: [{"id": "a084e92b-2287-4ac4-a9a5-db86f3d3249e", "address": "fa:16:3e:c1:4c:ad", "network": {"id": "480be190-a4a8-46bd-b68f-c9f2241cfd5f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-734889840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa084e92b-22", "ovs_interfaceid": "a084e92b-2287-4ac4-a9a5-db86f3d3249e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "458b086a-58f5-451f-936d-6f64a04ad64e", "address": "fa:16:3e:23:3a:7d", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap458b086a-58", "ovs_interfaceid": "458b086a-58f5-451f-936d-6f64a04ad64e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "437cdad2-00fb-4ac6-9fce-a67767cd4bda", "address": "fa:16:3e:29:78:c5", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap437cdad2-00", "ovs_interfaceid": "437cdad2-00fb-4ac6-9fce-a67767cd4bda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c48d46cf-70b1-408c-aee6-8965fb8356b0", "address": "fa:16:3e:23:98:99", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48d46cf-70", "ovs_interfaceid": "c48d46cf-70b1-408c-aee6-8965fb8356b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e418f46c-a8f2-4cbe-b422-b8aad6f84236", "address": "fa:16:3e:5b:c8:16", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape418f46c-a8", "ovs_interfaceid": "e418f46c-a8f2-4cbe-b422-b8aad6f84236", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10cc8607-5dd0-4310-b2eb-ff4f5196573c", "address": "fa:16:3e:53:23:da", "network": {"id": "48e40549-72ed-45cc-ba38-e2155151f40c", "bridge": "br-int", "label": "tempest-device-tagging-net2-669256899", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10cc8607-5d", "ovs_interfaceid": "10cc8607-5dd0-4310-b2eb-ff4f5196573c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f59675e3-d424-46f3-b3ef-ea1133f0aafd", "address": "fa:16:3e:b3:a0:b6", "network": {"id": "48e40549-72ed-45cc-ba38-e2155151f40c", "bridge": "br-int", "label": "tempest-device-tagging-net2-669256899", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59675e3-d4", "ovs_interfaceid": "f59675e3-d424-46f3-b3ef-ea1133f0aafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:02:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0ebdb0d7-1dd2-4f1f-af2f-5d4835f6d23c req-9d3d5418-cd6c-44f8-bf1e-50cdcb232e4e service nova] Releasing lock "refresh_cache-391b2d43-3c9d-42db-bfae-09e8410bf367" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:02:09 user nova-compute[72766]: DEBUG nova.compute.manager [req-0ebdb0d7-1dd2-4f1f-af2f-5d4835f6d23c req-9d3d5418-cd6c-44f8-bf1e-50cdcb232e4e service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-changed-f59675e3-d424-46f3-b3ef-ea1133f0aafd {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:02:09 user nova-compute[72766]: DEBUG nova.compute.manager [req-0ebdb0d7-1dd2-4f1f-af2f-5d4835f6d23c req-9d3d5418-cd6c-44f8-bf1e-50cdcb232e4e service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Refreshing instance network info cache due to event network-changed-f59675e3-d424-46f3-b3ef-ea1133f0aafd. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:02:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0ebdb0d7-1dd2-4f1f-af2f-5d4835f6d23c req-9d3d5418-cd6c-44f8-bf1e-50cdcb232e4e service nova] Acquiring lock "refresh_cache-391b2d43-3c9d-42db-bfae-09e8410bf367" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:02:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0ebdb0d7-1dd2-4f1f-af2f-5d4835f6d23c req-9d3d5418-cd6c-44f8-bf1e-50cdcb232e4e service nova] Acquired lock "refresh_cache-391b2d43-3c9d-42db-bfae-09e8410bf367" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:02:09 user nova-compute[72766]: DEBUG nova.network.neutron [req-0ebdb0d7-1dd2-4f1f-af2f-5d4835f6d23c req-9d3d5418-cd6c-44f8-bf1e-50cdcb232e4e service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Refreshing network info cache for port f59675e3-d424-46f3-b3ef-ea1133f0aafd {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:02:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-4d838356-c799-4fac-a298-0ecf2e8f0ec6 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72766) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 23:02:09 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-4d838356-c799-4fac-a298-0ecf2e8f0ec6 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 14 23:02:09 user nova-compute[72766]: DEBUG nova.privsep.utils [None req-4d838356-c799-4fac-a298-0ecf2e8f0ec6 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72766) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 23:02:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-4d838356-c799-4fac-a298-0ecf2e8f0ec6 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpwmr7blqj/6e03a151dc7c4cfd9046498980f7ba6d.delta /opt/stack/data/nova/instances/snapshots/tmpwmr7blqj/6e03a151dc7c4cfd9046498980f7ba6d {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:10 user nova-compute[72766]: DEBUG nova.network.neutron [req-0ebdb0d7-1dd2-4f1f-af2f-5d4835f6d23c req-9d3d5418-cd6c-44f8-bf1e-50cdcb232e4e service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Updated VIF entry in instance network info cache for port f59675e3-d424-46f3-b3ef-ea1133f0aafd. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:02:10 user nova-compute[72766]: DEBUG nova.network.neutron [req-0ebdb0d7-1dd2-4f1f-af2f-5d4835f6d23c req-9d3d5418-cd6c-44f8-bf1e-50cdcb232e4e service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Updating instance_info_cache with network_info: [{"id": "a084e92b-2287-4ac4-a9a5-db86f3d3249e", "address": "fa:16:3e:c1:4c:ad", "network": {"id": "480be190-a4a8-46bd-b68f-c9f2241cfd5f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-734889840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa084e92b-22", "ovs_interfaceid": "a084e92b-2287-4ac4-a9a5-db86f3d3249e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "458b086a-58f5-451f-936d-6f64a04ad64e", "address": "fa:16:3e:23:3a:7d", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap458b086a-58", "ovs_interfaceid": "458b086a-58f5-451f-936d-6f64a04ad64e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "437cdad2-00fb-4ac6-9fce-a67767cd4bda", "address": "fa:16:3e:29:78:c5", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap437cdad2-00", "ovs_interfaceid": "437cdad2-00fb-4ac6-9fce-a67767cd4bda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c48d46cf-70b1-408c-aee6-8965fb8356b0", "address": "fa:16:3e:23:98:99", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48d46cf-70", "ovs_interfaceid": "c48d46cf-70b1-408c-aee6-8965fb8356b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e418f46c-a8f2-4cbe-b422-b8aad6f84236", "address": "fa:16:3e:5b:c8:16", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape418f46c-a8", "ovs_interfaceid": "e418f46c-a8f2-4cbe-b422-b8aad6f84236", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10cc8607-5dd0-4310-b2eb-ff4f5196573c", "address": "fa:16:3e:53:23:da", "network": {"id": "48e40549-72ed-45cc-ba38-e2155151f40c", "bridge": "br-int", "label": "tempest-device-tagging-net2-669256899", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10cc8607-5d", "ovs_interfaceid": "10cc8607-5dd0-4310-b2eb-ff4f5196573c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f59675e3-d424-46f3-b3ef-ea1133f0aafd", "address": "fa:16:3e:b3:a0:b6", "network": {"id": "48e40549-72ed-45cc-ba38-e2155151f40c", "bridge": "br-int", "label": "tempest-device-tagging-net2-669256899", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59675e3-d4", "ovs_interfaceid": "f59675e3-d424-46f3-b3ef-ea1133f0aafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:02:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0ebdb0d7-1dd2-4f1f-af2f-5d4835f6d23c req-9d3d5418-cd6c-44f8-bf1e-50cdcb232e4e service nova] Releasing lock "refresh_cache-391b2d43-3c9d-42db-bfae-09e8410bf367" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:02:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-4d838356-c799-4fac-a298-0ecf2e8f0ec6 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpwmr7blqj/6e03a151dc7c4cfd9046498980f7ba6d.delta /opt/stack/data/nova/instances/snapshots/tmpwmr7blqj/6e03a151dc7c4cfd9046498980f7ba6d" returned: 0 in 0.480s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:10 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-4d838356-c799-4fac-a298-0ecf2e8f0ec6 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Snapshot extracted, beginning image upload
Aug 14 23:02:12 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-4d838356-c799-4fac-a298-0ecf2e8f0ec6 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Snapshot image upload complete
Aug 14 23:02:12 user nova-compute[72766]: INFO nova.compute.manager [None req-4d838356-c799-4fac-a298-0ecf2e8f0ec6 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Took 5.33 seconds to snapshot the instance on the hypervisor.
Aug 14 23:02:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:13 user nova-compute[72766]: INFO nova.virt.block_device [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Booting with volume 70d02f68-0a90-4579-b065-d44fd4884b01 at /dev/vdc
Aug 14 23:02:13 user nova-compute[72766]: DEBUG os_brick.utils [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:02:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e514fd10-f1dc-49a4-adfd-bb1832323619]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe479d5-f73d-4f1a-a175-4ca8edceac73]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b82b42c-378b-4b34-b465-d0238991af4c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[5148ee8c-47a3-4ba5-a9f4-29ea15bf84c8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:02:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 23:02:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:02:13 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 23:02:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[09852bca-20b2-48c1-bbd3-5703980ef12f]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 23:02:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 23:02:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 23:02:13 user nova-compute[72766]: DEBUG os_brick.utils [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:02:13 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Updating existing volume attachment record: 88b187ae-ae8f-42a2-a6ef-3ea4d44315f7 {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 23:02:15 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:02:15 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:02:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-87712dfd-d67b-4e5e-a75d-ca2dd7c764b1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:02:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-87712dfd-d67b-4e5e-a75d-ca2dd7c764b1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:02:15 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:02:16 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Updating instance_info_cache with network_info: [{"id": "baa7e0c2-91d4-4077-8405-abb537475df2", "address": "fa:16:3e:88:35:14", "network": {"id": "aff4f146-97db-4102-abf1-6528e74cad55", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1894452367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6942d31258304de68c9f7f8bb9304acb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa7e0c2-91", "ovs_interfaceid": "baa7e0c2-91d4-4077-8405-abb537475df2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:02:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-87712dfd-d67b-4e5e-a75d-ca2dd7c764b1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:02:16 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:02:16 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:02:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:02:18 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:02:18 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:02:19 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:02:20 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:02:20 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:02:20 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:02:20 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:02:20 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:02:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:02:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:02:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:02:20 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:02:20 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c02e6fd7-e712-45da-b35b-2fe21675e2f1/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c02e6fd7-e712-45da-b35b-2fe21675e2f1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c02e6fd7-e712-45da-b35b-2fe21675e2f1/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c02e6fd7-e712-45da-b35b-2fe21675e2f1/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:23 user nova-compute[72766]: DEBUG nova.compute.manager [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 23:02:23 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 23:02:23 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Creating image(s)
Aug 14 23:02:23 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Did not create local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 23:02:23 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Ensure instance console log exists: /opt/stack/data/nova/instances/391b2d43-3c9d-42db-bfae-09e8410bf367/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 23:02:23 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:02:23 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:02:23 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:02:23 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Start _get_guest_xml network_info=[{"id": "a084e92b-2287-4ac4-a9a5-db86f3d3249e", "address": "fa:16:3e:c1:4c:ad", "network": {"id": "480be190-a4a8-46bd-b68f-c9f2241cfd5f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-734889840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa084e92b-22", "ovs_interfaceid": "a084e92b-2287-4ac4-a9a5-db86f3d3249e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "458b086a-58f5-451f-936d-6f64a04ad64e", "address": "fa:16:3e:23:3a:7d", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap458b086a-58", "ovs_interfaceid": "458b086a-58f5-451f-936d-6f64a04ad64e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "437cdad2-00fb-4ac6-9fce-a67767cd4bda", "address": "fa:16:3e:29:78:c5", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap437cdad2-00", "ovs_interfaceid": "437cdad2-00fb-4ac6-9fce-a67767cd4bda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c48d46cf-70b1-408c-aee6-8965fb8356b0", "address": "fa:16:3e:23:98:99", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48d46cf-70", "ovs_interfaceid": "c48d46cf-70b1-408c-aee6-8965fb8356b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e418f46c-a8f2-4cbe-b422-b8aad6f84236", "address": "fa:16:3e:5b:c8:16", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape418f46c-a8", "ovs_interfaceid": "e418f46c-a8f2-4cbe-b422-b8aad6f84236", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10cc8607-5dd0-4310-b2eb-ff4f5196573c", "address": "fa:16:3e:53:23:da", "network": {"id": "48e40549-72ed-45cc-ba38-e2155151f40c", "bridge": "br-int", "label": "tempest-device-tagging-net2-669256899", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10cc8607-5d", "ovs_interfaceid": "10cc8607-5dd0-4310-b2eb-ff4f5196573c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f59675e3-d424-46f3-b3ef-ea1133f0aafd", "address": "fa:16:3e:b3:a0:b6", "network": {"id": "48e40549-72ed-45cc-ba38-e2155151f40c", "bridge": "br-int", "label": "tempest-device-tagging-net2-669256899", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59675e3-d4", "ovs_interfaceid": "f59675e3-d424-46f3-b3ef-ea1133f0aafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'c2447fae-10e9-4494-b921-32a43f2d8971', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZEQyAdN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '391b2d43-3c9d-42db-bfae-09e8410bf367', 'attached_at': '', 'detached_at': '', 'volume_id': 'f56da68f-0792-4fe2-b21f-5a00a5c912b9', 'serial': 'f56da68f-0792-4fe2-b21f-5a00a5c912b9'}, 'volume_type': None}, {'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'boot_index': 1, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'e21d7443-bd21-4964-b1c1-41f69310b2d5', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BEbUFzqo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '391b2d43-3c9d-42db-bfae-09e8410bf367', 'attached_at': '', 'detached_at': '', 'volume_id': '0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2', 'serial': '0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2'}, 'volume_type': None}, {'mount_device': '/dev/vdc', 'guest_format': None, 'device_type': 'disk', 'boot_index': 2, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '88b187ae-ae8f-42a2-a6ef-3ea4d44315f7', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JLaPGNmC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '391b2d43-3c9d-42db-bfae-09e8410bf367', 'attached_at': '', 'detached_at': '', 'volume_id': '70d02f68-0a90-4579-b065-d44fd4884b01', 'serial': '70d02f68-0a90-4579-b065-d44fd4884b01'}, 'volume_type': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:02:23 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:02:23 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:02:23 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:02:23 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:02:23 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:02:23 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:02:23 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:02:23 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:02:23 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:02:23 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:02:23 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:02:23 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:02:23 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:02:23 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:02:23 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:02:23 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:02:23 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:02:23 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:02:23 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 23:02:23 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZEQyAdN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:02:23 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:02:23 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:02:23 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:02:23 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:02:23 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:02:23 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:02:23 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 23:02:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78a6096-06fa-4a63-9166-20f498079224]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 23:02:24 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:24 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:02:24 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:02:24 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=7741MB free_disk=25.55573272705078GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e2f1e5-d80a-44e3-b5b0-d06a5c94ad11]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9] added
Aug 14 23:02:24 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[826a952e-acc7-424b-bd17-8b29df4623fd]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c43355-9697-4784-a460-4ebce2ea2e86]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hZEQyAdN {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hZEQyAdN" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a3b06c-ee1c-4399-bedc-5989c12d7b8e]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hZEQyAdN'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a58272e-6db5-4926-bd7a-ac72a2f57ecc]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance b563c62d-d117-4bb5-9157-7387c51ed641 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance c3c0a004-8d70-4253-bf17-b83088e30031 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance c02e6fd7-e712-45da-b35b-2fe21675e2f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 78f02883-99a1-493d-b6be-e43500bfba37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 3ff300ff-34fd-4e94-9d2d-681fb133ba32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 391b2d43-3c9d-42db-bfae-09e8410bf367 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bd7502-5e1e-4877-8b64-eb0ec4d329f3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 23:02:24 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 23:02:24 user nova-compute[72766]:  {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:02:24 user nova-compute[72766]: WARNING os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 23:02:24 user nova-compute[72766]: 
Aug 14 23:02:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 4d919875-5f24-4bed-bf26-cf437e0de3e2 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7b4841-42f4-4c60-a41a-5fb71b9ec2d9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9, portal: 172.16.0.220,3260]
Aug 14 23:02:24 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9, portal: 172.16.0.220,3260] successful.
Aug 14 23:02:24 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa51d8f-d6b2-475f-938d-909e439808ee]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[301f83cc-41c1-498a-908d-38c92a053375]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)
Aug 14 23:02:24 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)
Aug 14 23:02:24 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.742s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f4b6f1-78a2-4e3b-a998-bc6520d95acd]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZEQyAdN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:02:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.499s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.776s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] <== connect_volume: return (1777ms) {'type': 'block', 'scsi_wwn': '23065393965303931', 'path': '/dev/sdb'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065393965303931', 'path': '/dev/sdb'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BEbUFzqo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:02:25 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:02:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:02:25 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:02:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:02:25 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 23:02:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a00f41-53c9-4bfc-b3c6-8615a84b1834]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 23:02:25 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[184586f2-9c64-4344-8422-c2a7d1853b88]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2] added
Aug 14 23:02:25 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ae740a-4a79-4ecc-8a12-45d03ac110fe]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[1966c64b-3133-49ec-9887-3d3654e5e7cb]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BEbUFzqo {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BEbUFzqo" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab899b71-871a-4e35-9742-a3145dcdb221]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BEbUFzqo'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b72d5a-d602-4d30-8c7d-7c0ee7202787]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e95479-eaff-44c2-8cb9-b3473e9dfa1e]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)
Aug 14 23:02:25 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)
Aug 14 23:02:25 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8ecd44-98d0-40f3-a8d1-6a75926cf6bb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2, portal: 172.16.0.220,3260]
Aug 14 23:02:25 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2, portal: 172.16.0.220,3260] successful.
Aug 14 23:02:25 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f47c6f3-73c8-46c5-9b80-2368dd9af1ad]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb579d4-abb6-46f1-926e-1a134fc6760d]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)
Aug 14 23:02:25 user nova-compute[72766]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 (non-flash)
Aug 14 23:02:25 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)
Aug 14 23:02:25 user nova-compute[72766]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 (non-flash)
Aug 14 23:02:25 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05b486b-3327-410a-a2d1-1ecc6ef71037]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:02:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BEbUFzqo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '26136356239613533', 'path': '/dev/sdc'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136356239613533', 'path': '/dev/sdc'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JLaPGNmC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:02:26 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:02:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:02:26 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:02:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:02:26 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 23:02:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-75d23578-21b4-452c-b6da-d98cc8039c62 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Acquiring lock "c02e6fd7-e712-45da-b35b-2fe21675e2f1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-75d23578-21b4-452c-b6da-d98cc8039c62 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Lock "c02e6fd7-e712-45da-b35b-2fe21675e2f1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-75d23578-21b4-452c-b6da-d98cc8039c62 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Acquiring lock "c02e6fd7-e712-45da-b35b-2fe21675e2f1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-75d23578-21b4-452c-b6da-d98cc8039c62 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Lock "c02e6fd7-e712-45da-b35b-2fe21675e2f1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-75d23578-21b4-452c-b6da-d98cc8039c62 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Lock "c02e6fd7-e712-45da-b35b-2fe21675e2f1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:02:26 user nova-compute[72766]: INFO nova.compute.manager [None req-75d23578-21b4-452c-b6da-d98cc8039c62 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Terminating instance
Aug 14 23:02:26 user nova-compute[72766]: DEBUG nova.compute.manager [None req-75d23578-21b4-452c-b6da-d98cc8039c62 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f34a99-1883-4d27-9846-b7c0c40e4b6f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 23:02:26 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9744f0-89bb-41ba-97fa-bc66dd2185a5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01] added
Aug 14 23:02:26 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[08be6090-7d4d-481d-9e73-771bdc2b25c9]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b65d714-e270-4e12-904a-ec61a374b797]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JLaPGNmC {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JLaPGNmC" returned: 0 in 0.036s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[31505340-894b-436d-9e74-ded83a6349fa]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JLaPGNmC'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ef37d0-a91f-47f6-bcf8-400a23916715]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7456710-bae4-4f17-8464-6ffda4a18a97]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)
Aug 14 23:02:26 user nova-compute[72766]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 (non-flash)
Aug 14 23:02:26 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)
Aug 14 23:02:26 user nova-compute[72766]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 (non-flash)
Aug 14 23:02:26 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:02:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:27 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[15506625-37aa-4099-b9ac-d81a47c61e19]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:27 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01, portal: 172.16.0.220,3260]
Aug 14 23:02:27 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01, portal: 172.16.0.220,3260] successful.
Aug 14 23:02:27 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:02:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:27 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb3e8b4-896a-47b8-a7ce-2b30f78a3537]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:27 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:02:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:27 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[455994cf-2bf4-4734-8e4b-4929ef161d54]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:27 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)
Aug 14 23:02:27 user nova-compute[72766]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 (non-flash)
Aug 14 23:02:27 user nova-compute[72766]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 (non-flash)
Aug 14 23:02:27 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:02:27 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)
Aug 14 23:02:27 user nova-compute[72766]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 (non-flash)
Aug 14 23:02:27 user nova-compute[72766]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 (non-flash)
Aug 14 23:02:27 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:02:27 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.376s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:02:27 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 23:02:27 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 23:02:27 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 23:02:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.027s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:27 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a03fa3b-629a-4832-b524-7a1fd91ec20e]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:27 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: None {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:02:27 user nova-compute[72766]: DEBUG nova.compute.manager [req-abb95b97-fa4f-4197-a95c-8277319da3e6 req-1b4228e9-1669-4919-bf29-73cdd6bafe7b service nova] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Received event network-vif-unplugged-3b9abe2a-2056-403c-bc2e-97bff0d04648 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:02:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-abb95b97-fa4f-4197-a95c-8277319da3e6 req-1b4228e9-1669-4919-bf29-73cdd6bafe7b service nova] Acquiring lock "c02e6fd7-e712-45da-b35b-2fe21675e2f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:02:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-abb95b97-fa4f-4197-a95c-8277319da3e6 req-1b4228e9-1669-4919-bf29-73cdd6bafe7b service nova] Lock "c02e6fd7-e712-45da-b35b-2fe21675e2f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:02:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-abb95b97-fa4f-4197-a95c-8277319da3e6 req-1b4228e9-1669-4919-bf29-73cdd6bafe7b service nova] Lock "c02e6fd7-e712-45da-b35b-2fe21675e2f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:02:27 user nova-compute[72766]: DEBUG nova.compute.manager [req-abb95b97-fa4f-4197-a95c-8277319da3e6 req-1b4228e9-1669-4919-bf29-73cdd6bafe7b service nova] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] No waiting events found dispatching network-vif-unplugged-3b9abe2a-2056-403c-bc2e-97bff0d04648 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:02:27 user nova-compute[72766]: DEBUG nova.compute.manager [req-abb95b97-fa4f-4197-a95c-8277319da3e6 req-1b4228e9-1669-4919-bf29-73cdd6bafe7b service nova] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Received event network-vif-unplugged-3b9abe2a-2056-403c-bc2e-97bff0d04648 for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:02:27 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Instance destroyed successfully.
Aug 14 23:02:27 user nova-compute[72766]: DEBUG nova.objects.instance [None req-75d23578-21b4-452c-b6da-d98cc8039c62 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Lazy-loading 'resources' on Instance uuid c02e6fd7-e712-45da-b35b-2fe21675e2f1 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:02:27 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-75d23578-21b4-452c-b6da-d98cc8039c62 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:59:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1422095618',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1422095618',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1422095',id=14,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONbY82+U/9BcNjMdo40EaVwa0DpR5h1vDX0P/Ya84vCD2XbpAUyitlCJcfLeDX4n4mnNgYV5y3bOzqPPLq8c5lbVlYH1FS9MmdG7Z3Mt1aUQfK4l3JRciswuFpedGQN5Q==',key_name='tempest-keypair-1608943488',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:59:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c2a15ce46cf545a8bd6e8e93f12a70a2',ramdisk_id='',reservation_id='r-yx0g0cyv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-767657021',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:59:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e26e35b2602f410a8413983d0fb53713',uuid=c02e6fd7-e712-45da-b35b-2fe21675e2f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b9abe2a-2056-403c-bc2e-97bff0d04648", "address": "fa:16:3e:3e:c1:d6", "network": {"id": "4b9625cb-278d-447f-8309-577dc3b6532f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2056420710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2a15ce46cf545a8bd6e8e93f12a70a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9abe2a-20", "ovs_interfaceid": "3b9abe2a-2056-403c-bc2e-97bff0d04648", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:02:27 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-75d23578-21b4-452c-b6da-d98cc8039c62 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Converting VIF {"id": "3b9abe2a-2056-403c-bc2e-97bff0d04648", "address": "fa:16:3e:3e:c1:d6", "network": {"id": "4b9625cb-278d-447f-8309-577dc3b6532f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2056420710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2a15ce46cf545a8bd6e8e93f12a70a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9abe2a-20", "ovs_interfaceid": "3b9abe2a-2056-403c-bc2e-97bff0d04648", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:02:27 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-75d23578-21b4-452c-b6da-d98cc8039c62 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:c1:d6,bridge_name='br-int',has_traffic_filtering=True,id=3b9abe2a-2056-403c-bc2e-97bff0d04648,network=Network(4b9625cb-278d-447f-8309-577dc3b6532f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b9abe2a-20') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:02:27 user nova-compute[72766]: DEBUG os_vif [None req-75d23578-21b4-452c-b6da-d98cc8039c62 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:c1:d6,bridge_name='br-int',has_traffic_filtering=True,id=3b9abe2a-2056-403c-bc2e-97bff0d04648,network=Network(4b9625cb-278d-447f-8309-577dc3b6532f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b9abe2a-20') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:02:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b9abe2a-20, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:02:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:02:27 user nova-compute[72766]: INFO os_vif [None req-75d23578-21b4-452c-b6da-d98cc8039c62 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:c1:d6,bridge_name='br-int',has_traffic_filtering=True,id=3b9abe2a-2056-403c-bc2e-97bff0d04648,network=Network(4b9625cb-278d-447f-8309-577dc3b6532f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b9abe2a-20')
Aug 14 23:02:27 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-75d23578-21b4-452c-b6da-d98cc8039c62 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Deleting instance files /opt/stack/data/nova/instances/c02e6fd7-e712-45da-b35b-2fe21675e2f1_del
Aug 14 23:02:27 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-75d23578-21b4-452c-b6da-d98cc8039c62 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Deletion of /opt/stack/data/nova/instances/c02e6fd7-e712-45da-b35b-2fe21675e2f1_del complete
Aug 14 23:02:27 user nova-compute[72766]: INFO nova.compute.manager [None req-75d23578-21b4-452c-b6da-d98cc8039c62 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 14 23:02:27 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-75d23578-21b4-452c-b6da-d98cc8039c62 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:02:27 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:02:27 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JLaPGNmC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.421s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] <== connect_volume: return (1422ms) {'type': 'block', 'scsi_wwn': '26635343966323261', 'path': '/dev/sdd'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635343966323261', 'path': '/dev/sdd'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T23:01:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2078583547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2078583547',id=18,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIeZZqtRVtgPVn1pVBb8bZPh3xgGlgKuQl6LUe4EpbdgvvZq2gTC/Dde6ksrfSoAZ8dqUguj9bwBGfQBJwt8dG1Fz3CREGps5wEjWKM5cHptDNZeQ/tI1EzuLyzihw2M2Q==',key_name='tempest-keypair-643381431',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac6b2b6ac4b246ff90b646e9d1ffc9c8',ramdisk_id='',reservation_id='r-781x6k7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-627581418',owner_user_name='tempest-TaggedBootDevicesTest_v242-627581418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:01:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d27477e14d64946a9ba1aa553b28ca3',uuid=391b2d43-3c9d-42db-bfae-09e8410bf367,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a084e92b-2287-4ac4-a9a5-db86f3d3249e", "address": "fa:16:3e:c1:4c:ad", "network": {"id": "480be190-a4a8-46bd-b68f-c9f2241cfd5f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-734889840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa084e92b-22", "ovs_interfaceid": "a084e92b-2287-4ac4-a9a5-db86f3d3249e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Converting VIF {"id": "a084e92b-2287-4ac4-a9a5-db86f3d3249e", "address": "fa:16:3e:c1:4c:ad", "network": {"id": "480be190-a4a8-46bd-b68f-c9f2241cfd5f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-734889840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa084e92b-22", "ovs_interfaceid": "a084e92b-2287-4ac4-a9a5-db86f3d3249e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:4c:ad,bridge_name='br-int',has_traffic_filtering=True,id=a084e92b-2287-4ac4-a9a5-db86f3d3249e,network=Network(480be190-a4a8-46bd-b68f-c9f2241cfd5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa084e92b-22') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T23:01:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2078583547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2078583547',id=18,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIeZZqtRVtgPVn1pVBb8bZPh3xgGlgKuQl6LUe4EpbdgvvZq2gTC/Dde6ksrfSoAZ8dqUguj9bwBGfQBJwt8dG1Fz3CREGps5wEjWKM5cHptDNZeQ/tI1EzuLyzihw2M2Q==',key_name='tempest-keypair-643381431',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac6b2b6ac4b246ff90b646e9d1ffc9c8',ramdisk_id='',reservation_id='r-781x6k7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-627581418',owner_user_name='tempest-TaggedBootDevicesTest_v242-627581418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:01:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d27477e14d64946a9ba1aa553b28ca3',uuid=391b2d43-3c9d-42db-bfae-09e8410bf367,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "458b086a-58f5-451f-936d-6f64a04ad64e", "address": "fa:16:3e:23:3a:7d", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap458b086a-58", "ovs_interfaceid": "458b086a-58f5-451f-936d-6f64a04ad64e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Converting VIF {"id": "458b086a-58f5-451f-936d-6f64a04ad64e", "address": "fa:16:3e:23:3a:7d", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap458b086a-58", "ovs_interfaceid": "458b086a-58f5-451f-936d-6f64a04ad64e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:3a:7d,bridge_name='br-int',has_traffic_filtering=True,id=458b086a-58f5-451f-936d-6f64a04ad64e,network=Network(0a345d47-5b12-4bbc-9e78-c6899871e7a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap458b086a-58') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T23:01:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2078583547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2078583547',id=18,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIeZZqtRVtgPVn1pVBb8bZPh3xgGlgKuQl6LUe4EpbdgvvZq2gTC/Dde6ksrfSoAZ8dqUguj9bwBGfQBJwt8dG1Fz3CREGps5wEjWKM5cHptDNZeQ/tI1EzuLyzihw2M2Q==',key_name='tempest-keypair-643381431',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac6b2b6ac4b246ff90b646e9d1ffc9c8',ramdisk_id='',reservation_id='r-781x6k7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-627581418',owner_user_name='tempest-TaggedBootDevicesTest_v242-627581418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:01:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d27477e14d64946a9ba1aa553b28ca3',uuid=391b2d43-3c9d-42db-bfae-09e8410bf367,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "437cdad2-00fb-4ac6-9fce-a67767cd4bda", "address": "fa:16:3e:29:78:c5", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap437cdad2-00", "ovs_interfaceid": "437cdad2-00fb-4ac6-9fce-a67767cd4bda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Converting VIF {"id": "437cdad2-00fb-4ac6-9fce-a67767cd4bda", "address": "fa:16:3e:29:78:c5", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap437cdad2-00", "ovs_interfaceid": "437cdad2-00fb-4ac6-9fce-a67767cd4bda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:78:c5,bridge_name='br-int',has_traffic_filtering=True,id=437cdad2-00fb-4ac6-9fce-a67767cd4bda,network=Network(0a345d47-5b12-4bbc-9e78-c6899871e7a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap437cdad2-00') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T23:01:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2078583547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2078583547',id=18,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIeZZqtRVtgPVn1pVBb8bZPh3xgGlgKuQl6LUe4EpbdgvvZq2gTC/Dde6ksrfSoAZ8dqUguj9bwBGfQBJwt8dG1Fz3CREGps5wEjWKM5cHptDNZeQ/tI1EzuLyzihw2M2Q==',key_name='tempest-keypair-643381431',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac6b2b6ac4b246ff90b646e9d1ffc9c8',ramdisk_id='',reservation_id='r-781x6k7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-627581418',owner_user_name='tempest-TaggedBootDevicesTest_v242-627581418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:01:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d27477e14d64946a9ba1aa553b28ca3',uuid=391b2d43-3c9d-42db-bfae-09e8410bf367,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c48d46cf-70b1-408c-aee6-8965fb8356b0", "address": "fa:16:3e:23:98:99", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48d46cf-70", "ovs_interfaceid": "c48d46cf-70b1-408c-aee6-8965fb8356b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Converting VIF {"id": "c48d46cf-70b1-408c-aee6-8965fb8356b0", "address": "fa:16:3e:23:98:99", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48d46cf-70", "ovs_interfaceid": "c48d46cf-70b1-408c-aee6-8965fb8356b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:98:99,bridge_name='br-int',has_traffic_filtering=True,id=c48d46cf-70b1-408c-aee6-8965fb8356b0,network=Network(0a345d47-5b12-4bbc-9e78-c6899871e7a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc48d46cf-70') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T23:01:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2078583547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2078583547',id=18,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIeZZqtRVtgPVn1pVBb8bZPh3xgGlgKuQl6LUe4EpbdgvvZq2gTC/Dde6ksrfSoAZ8dqUguj9bwBGfQBJwt8dG1Fz3CREGps5wEjWKM5cHptDNZeQ/tI1EzuLyzihw2M2Q==',key_name='tempest-keypair-643381431',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac6b2b6ac4b246ff90b646e9d1ffc9c8',ramdisk_id='',reservation_id='r-781x6k7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-627581418',owner_user_name='tempest-TaggedBootDevicesTest_v242-627581418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:01:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d27477e14d64946a9ba1aa553b28ca3',uuid=391b2d43-3c9d-42db-bfae-09e8410bf367,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e418f46c-a8f2-4cbe-b422-b8aad6f84236", "address": "fa:16:3e:5b:c8:16", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape418f46c-a8", "ovs_interfaceid": "e418f46c-a8f2-4cbe-b422-b8aad6f84236", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Converting VIF {"id": "e418f46c-a8f2-4cbe-b422-b8aad6f84236", "address": "fa:16:3e:5b:c8:16", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape418f46c-a8", "ovs_interfaceid": "e418f46c-a8f2-4cbe-b422-b8aad6f84236", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:c8:16,bridge_name='br-int',has_traffic_filtering=True,id=e418f46c-a8f2-4cbe-b422-b8aad6f84236,network=Network(0a345d47-5b12-4bbc-9e78-c6899871e7a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape418f46c-a8') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T23:01:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2078583547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2078583547',id=18,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIeZZqtRVtgPVn1pVBb8bZPh3xgGlgKuQl6LUe4EpbdgvvZq2gTC/Dde6ksrfSoAZ8dqUguj9bwBGfQBJwt8dG1Fz3CREGps5wEjWKM5cHptDNZeQ/tI1EzuLyzihw2M2Q==',key_name='tempest-keypair-643381431',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac6b2b6ac4b246ff90b646e9d1ffc9c8',ramdisk_id='',reservation_id='r-781x6k7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-627581418',owner_user_name='tempest-TaggedBootDevicesTest_v242-627581418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:01:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d27477e14d64946a9ba1aa553b28ca3',uuid=391b2d43-3c9d-42db-bfae-09e8410bf367,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10cc8607-5dd0-4310-b2eb-ff4f5196573c", "address": "fa:16:3e:53:23:da", "network": {"id": "48e40549-72ed-45cc-ba38-e2155151f40c", "bridge": "br-int", "label": "tempest-device-tagging-net2-669256899", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10cc8607-5d", "ovs_interfaceid": "10cc8607-5dd0-4310-b2eb-ff4f5196573c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Converting VIF {"id": "10cc8607-5dd0-4310-b2eb-ff4f5196573c", "address": "fa:16:3e:53:23:da", "network": {"id": "48e40549-72ed-45cc-ba38-e2155151f40c", "bridge": "br-int", "label": "tempest-device-tagging-net2-669256899", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10cc8607-5d", "ovs_interfaceid": "10cc8607-5dd0-4310-b2eb-ff4f5196573c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:23:da,bridge_name='br-int',has_traffic_filtering=True,id=10cc8607-5dd0-4310-b2eb-ff4f5196573c,network=Network(48e40549-72ed-45cc-ba38-e2155151f40c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10cc8607-5d') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T23:01:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2078583547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2078583547',id=18,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIeZZqtRVtgPVn1pVBb8bZPh3xgGlgKuQl6LUe4EpbdgvvZq2gTC/Dde6ksrfSoAZ8dqUguj9bwBGfQBJwt8dG1Fz3CREGps5wEjWKM5cHptDNZeQ/tI1EzuLyzihw2M2Q==',key_name='tempest-keypair-643381431',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac6b2b6ac4b246ff90b646e9d1ffc9c8',ramdisk_id='',reservation_id='r-781x6k7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-627581418',owner_user_name='tempest-TaggedBootDevicesTest_v242-627581418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:01:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d27477e14d64946a9ba1aa553b28ca3',uuid=391b2d43-3c9d-42db-bfae-09e8410bf367,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f59675e3-d424-46f3-b3ef-ea1133f0aafd", "address": "fa:16:3e:b3:a0:b6", "network": {"id": "48e40549-72ed-45cc-ba38-e2155151f40c", "bridge": "br-int", "label": "tempest-device-tagging-net2-669256899", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59675e3-d4", "ovs_interfaceid": "f59675e3-d424-46f3-b3ef-ea1133f0aafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Converting VIF {"id": "f59675e3-d424-46f3-b3ef-ea1133f0aafd", "address": "fa:16:3e:b3:a0:b6", "network": {"id": "48e40549-72ed-45cc-ba38-e2155151f40c", "bridge": "br-int", "label": "tempest-device-tagging-net2-669256899", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59675e3-d4", "ovs_interfaceid": "f59675e3-d424-46f3-b3ef-ea1133f0aafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:a0:b6,bridge_name='br-int',has_traffic_filtering=True,id=f59675e3-d424-46f3-b3ef-ea1133f0aafd,network=Network(48e40549-72ed-45cc-ba38-e2155151f40c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf59675e3-d4') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.objects.instance [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Lazy-loading 'pci_devices' on Instance uuid 391b2d43-3c9d-42db-bfae-09e8410bf367 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:02:28 user nova-compute[72766]:   <uuid>391b2d43-3c9d-42db-bfae-09e8410bf367</uuid>
Aug 14 23:02:28 user nova-compute[72766]:   <name>instance-00000012</name>
Aug 14 23:02:28 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:02:28 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:02:28 user nova-compute[72766]:   <metadata>
Aug 14 23:02:28 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:02:28 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:02:28 user nova-compute[72766]:       <nova:name>tempest-device-tagging-server-2078583547</nova:name>
Aug 14 23:02:28 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:02:23</nova:creationTime>
Aug 14 23:02:28 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:02:28 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:02:28 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:02:28 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:02:28 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:02:28 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:02:28 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:02:28 user nova-compute[72766]:       <nova:owner>
Aug 14 23:02:28 user nova-compute[72766]:         <nova:user uuid="4d27477e14d64946a9ba1aa553b28ca3">tempest-TaggedBootDevicesTest_v242-627581418-project-member</nova:user>
Aug 14 23:02:28 user nova-compute[72766]:         <nova:project uuid="ac6b2b6ac4b246ff90b646e9d1ffc9c8">tempest-TaggedBootDevicesTest_v242-627581418</nova:project>
Aug 14 23:02:28 user nova-compute[72766]:       </nova:owner>
Aug 14 23:02:28 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 23:02:28 user nova-compute[72766]:       <nova:ports>
Aug 14 23:02:28 user nova-compute[72766]:         <nova:port uuid="a084e92b-2287-4ac4-a9a5-db86f3d3249e">
Aug 14 23:02:28 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 23:02:28 user nova-compute[72766]:         </nova:port>
Aug 14 23:02:28 user nova-compute[72766]:         <nova:port uuid="458b086a-58f5-451f-936d-6f64a04ad64e">
Aug 14 23:02:28 user nova-compute[72766]:           <nova:ip type="fixed" address="10.1.1.230" ipVersion="4"/>
Aug 14 23:02:28 user nova-compute[72766]:         </nova:port>
Aug 14 23:02:28 user nova-compute[72766]:         <nova:port uuid="437cdad2-00fb-4ac6-9fce-a67767cd4bda">
Aug 14 23:02:28 user nova-compute[72766]:           <nova:ip type="fixed" address="10.1.1.60" ipVersion="4"/>
Aug 14 23:02:28 user nova-compute[72766]:         </nova:port>
Aug 14 23:02:28 user nova-compute[72766]:         <nova:port uuid="c48d46cf-70b1-408c-aee6-8965fb8356b0">
Aug 14 23:02:28 user nova-compute[72766]:           <nova:ip type="fixed" address="10.1.1.174" ipVersion="4"/>
Aug 14 23:02:28 user nova-compute[72766]:         </nova:port>
Aug 14 23:02:28 user nova-compute[72766]:         <nova:port uuid="e418f46c-a8f2-4cbe-b422-b8aad6f84236">
Aug 14 23:02:28 user nova-compute[72766]:           <nova:ip type="fixed" address="10.1.1.108" ipVersion="4"/>
Aug 14 23:02:28 user nova-compute[72766]:         </nova:port>
Aug 14 23:02:28 user nova-compute[72766]:         <nova:port uuid="10cc8607-5dd0-4310-b2eb-ff4f5196573c">
Aug 14 23:02:28 user nova-compute[72766]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 14 23:02:28 user nova-compute[72766]:         </nova:port>
Aug 14 23:02:28 user nova-compute[72766]:         <nova:port uuid="f59675e3-d424-46f3-b3ef-ea1133f0aafd">
Aug 14 23:02:28 user nova-compute[72766]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 14 23:02:28 user nova-compute[72766]:         </nova:port>
Aug 14 23:02:28 user nova-compute[72766]:       </nova:ports>
Aug 14 23:02:28 user nova-compute[72766]:     </nova:instance>
Aug 14 23:02:28 user nova-compute[72766]:   </metadata>
Aug 14 23:02:28 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:02:28 user nova-compute[72766]:     <system>
Aug 14 23:02:28 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:02:28 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:02:28 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:02:28 user nova-compute[72766]:       <entry name="serial">391b2d43-3c9d-42db-bfae-09e8410bf367</entry>
Aug 14 23:02:28 user nova-compute[72766]:       <entry name="uuid">391b2d43-3c9d-42db-bfae-09e8410bf367</entry>
Aug 14 23:02:28 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:02:28 user nova-compute[72766]:     </system>
Aug 14 23:02:28 user nova-compute[72766]:   </sysinfo>
Aug 14 23:02:28 user nova-compute[72766]:   <os>
Aug 14 23:02:28 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:02:28 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:02:28 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:02:28 user nova-compute[72766]:   </os>
Aug 14 23:02:28 user nova-compute[72766]:   <features>
Aug 14 23:02:28 user nova-compute[72766]:     <acpi/>
Aug 14 23:02:28 user nova-compute[72766]:     <apic/>
Aug 14 23:02:28 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:02:28 user nova-compute[72766]:   </features>
Aug 14 23:02:28 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:02:28 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:02:28 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:02:28 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:02:28 user nova-compute[72766]:   </clock>
Aug 14 23:02:28 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:02:28 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:02:28 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:02:28 user nova-compute[72766]:   </cpu>
Aug 14 23:02:28 user nova-compute[72766]:   <devices>
Aug 14 23:02:28 user nova-compute[72766]:     <disk type="file" device="cdrom">
Aug 14 23:02:28 user nova-compute[72766]:       <driver name="qemu" type="raw" cache="none"/>
Aug 14 23:02:28 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/391b2d43-3c9d-42db-bfae-09e8410bf367/disk.config"/>
Aug 14 23:02:28 user nova-compute[72766]:       <target dev="hda" bus="ide"/>
Aug 14 23:02:28 user nova-compute[72766]:     </disk>
Aug 14 23:02:28 user nova-compute[72766]:     <disk type="block" device="disk">
Aug 14 23:02:28 user nova-compute[72766]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:02:28 user nova-compute[72766]:       <source dev="/dev/sdb"/>
Aug 14 23:02:28 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:02:28 user nova-compute[72766]:       <serial>f56da68f-0792-4fe2-b21f-5a00a5c912b9</serial>
Aug 14 23:02:28 user nova-compute[72766]:     </disk>
Aug 14 23:02:28 user nova-compute[72766]:     <disk type="block" device="disk">
Aug 14 23:02:28 user nova-compute[72766]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:02:28 user nova-compute[72766]:       <source dev="/dev/sdc"/>
Aug 14 23:02:28 user nova-compute[72766]:       <target dev="vdb" bus="virtio"/>
Aug 14 23:02:28 user nova-compute[72766]:       <serial>0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2</serial>
Aug 14 23:02:28 user nova-compute[72766]:     </disk>
Aug 14 23:02:28 user nova-compute[72766]:     <disk type="block" device="disk">
Aug 14 23:02:28 user nova-compute[72766]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:02:28 user nova-compute[72766]:       <source dev="/dev/sdd"/>
Aug 14 23:02:28 user nova-compute[72766]:       <target dev="vdc" bus="virtio"/>
Aug 14 23:02:28 user nova-compute[72766]:       <serial>70d02f68-0a90-4579-b065-d44fd4884b01</serial>
Aug 14 23:02:28 user nova-compute[72766]:     </disk>
Aug 14 23:02:28 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:02:28 user nova-compute[72766]:       <mac address="fa:16:3e:c1:4c:ad"/>
Aug 14 23:02:28 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:02:28 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:02:28 user nova-compute[72766]:       <target dev="tapa084e92b-22"/>
Aug 14 23:02:28 user nova-compute[72766]:     </interface>
Aug 14 23:02:28 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:02:28 user nova-compute[72766]:       <mac address="fa:16:3e:23:3a:7d"/>
Aug 14 23:02:28 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:02:28 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:02:28 user nova-compute[72766]:       <target dev="tap458b086a-58"/>
Aug 14 23:02:28 user nova-compute[72766]:     </interface>
Aug 14 23:02:28 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:02:28 user nova-compute[72766]:       <mac address="fa:16:3e:29:78:c5"/>
Aug 14 23:02:28 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:02:28 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:02:28 user nova-compute[72766]:       <target dev="tap437cdad2-00"/>
Aug 14 23:02:28 user nova-compute[72766]:     </interface>
Aug 14 23:02:28 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:02:28 user nova-compute[72766]:       <mac address="fa:16:3e:23:98:99"/>
Aug 14 23:02:28 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:02:28 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:02:28 user nova-compute[72766]:       <target dev="tapc48d46cf-70"/>
Aug 14 23:02:28 user nova-compute[72766]:     </interface>
Aug 14 23:02:28 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:02:28 user nova-compute[72766]:       <mac address="fa:16:3e:5b:c8:16"/>
Aug 14 23:02:28 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:02:28 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:02:28 user nova-compute[72766]:       <target dev="tape418f46c-a8"/>
Aug 14 23:02:28 user nova-compute[72766]:     </interface>
Aug 14 23:02:28 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:02:28 user nova-compute[72766]:       <mac address="fa:16:3e:53:23:da"/>
Aug 14 23:02:28 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:02:28 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:02:28 user nova-compute[72766]:       <target dev="tap10cc8607-5d"/>
Aug 14 23:02:28 user nova-compute[72766]:     </interface>
Aug 14 23:02:28 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:02:28 user nova-compute[72766]:       <mac address="fa:16:3e:b3:a0:b6"/>
Aug 14 23:02:28 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:02:28 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:02:28 user nova-compute[72766]:       <target dev="tapf59675e3-d4"/>
Aug 14 23:02:28 user nova-compute[72766]:     </interface>
Aug 14 23:02:28 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:02:28 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/391b2d43-3c9d-42db-bfae-09e8410bf367/console.log" append="off"/>
Aug 14 23:02:28 user nova-compute[72766]:     </serial>
Aug 14 23:02:28 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:02:28 user nova-compute[72766]:     <video>
Aug 14 23:02:28 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:02:28 user nova-compute[72766]:     </video>
Aug 14 23:02:28 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:02:28 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:02:28 user nova-compute[72766]:     </rng>
Aug 14 23:02:28 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:02:28 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:02:28 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:02:28 user nova-compute[72766]:     </memballoon>
Aug 14 23:02:28 user nova-compute[72766]:   </devices>
Aug 14 23:02:28 user nova-compute[72766]: </domain>
Aug 14 23:02:28 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T23:01:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2078583547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2078583547',id=18,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIeZZqtRVtgPVn1pVBb8bZPh3xgGlgKuQl6LUe4EpbdgvvZq2gTC/Dde6ksrfSoAZ8dqUguj9bwBGfQBJwt8dG1Fz3CREGps5wEjWKM5cHptDNZeQ/tI1EzuLyzihw2M2Q==',key_name='tempest-keypair-643381431',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac6b2b6ac4b246ff90b646e9d1ffc9c8',ramdisk_id='',reservation_id='r-781x6k7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-627581418',owner_user_name='tempest-TaggedBootDevicesTest_v242-627581418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:01:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d27477e14d64946a9ba1aa553b28ca3',uuid=391b2d43-3c9d-42db-bfae-09e8410bf367,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a084e92b-2287-4ac4-a9a5-db86f3d3249e", "address": "fa:16:3e:c1:4c:ad", "network": {"id": "480be190-a4a8-46bd-b68f-c9f2241cfd5f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-734889840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa084e92b-22", "ovs_interfaceid": "a084e92b-2287-4ac4-a9a5-db86f3d3249e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Converting VIF {"id": "a084e92b-2287-4ac4-a9a5-db86f3d3249e", "address": "fa:16:3e:c1:4c:ad", "network": {"id": "480be190-a4a8-46bd-b68f-c9f2241cfd5f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-734889840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa084e92b-22", "ovs_interfaceid": "a084e92b-2287-4ac4-a9a5-db86f3d3249e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:4c:ad,bridge_name='br-int',has_traffic_filtering=True,id=a084e92b-2287-4ac4-a9a5-db86f3d3249e,network=Network(480be190-a4a8-46bd-b68f-c9f2241cfd5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa084e92b-22') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG os_vif [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:4c:ad,bridge_name='br-int',has_traffic_filtering=True,id=a084e92b-2287-4ac4-a9a5-db86f3d3249e,network=Network(480be190-a4a8-46bd-b68f-c9f2241cfd5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa084e92b-22') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa084e92b-22, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa084e92b-22, col_values=(('external_ids', {'iface-id': 'a084e92b-2287-4ac4-a9a5-db86f3d3249e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:4c:ad', 'vm-uuid': '391b2d43-3c9d-42db-bfae-09e8410bf367'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:28 user nova-compute[72766]: INFO os_vif [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:4c:ad,bridge_name='br-int',has_traffic_filtering=True,id=a084e92b-2287-4ac4-a9a5-db86f3d3249e,network=Network(480be190-a4a8-46bd-b68f-c9f2241cfd5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa084e92b-22')
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T23:01:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2078583547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2078583547',id=18,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIeZZqtRVtgPVn1pVBb8bZPh3xgGlgKuQl6LUe4EpbdgvvZq2gTC/Dde6ksrfSoAZ8dqUguj9bwBGfQBJwt8dG1Fz3CREGps5wEjWKM5cHptDNZeQ/tI1EzuLyzihw2M2Q==',key_name='tempest-keypair-643381431',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac6b2b6ac4b246ff90b646e9d1ffc9c8',ramdisk_id='',reservation_id='r-781x6k7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-627581418',owner_user_name='tempest-TaggedBootDevicesTest_v242-627581418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:01:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d27477e14d64946a9ba1aa553b28ca3',uuid=391b2d43-3c9d-42db-bfae-09e8410bf367,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "458b086a-58f5-451f-936d-6f64a04ad64e", "address": "fa:16:3e:23:3a:7d", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap458b086a-58", "ovs_interfaceid": "458b086a-58f5-451f-936d-6f64a04ad64e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Converting VIF {"id": "458b086a-58f5-451f-936d-6f64a04ad64e", "address": "fa:16:3e:23:3a:7d", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap458b086a-58", "ovs_interfaceid": "458b086a-58f5-451f-936d-6f64a04ad64e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:3a:7d,bridge_name='br-int',has_traffic_filtering=True,id=458b086a-58f5-451f-936d-6f64a04ad64e,network=Network(0a345d47-5b12-4bbc-9e78-c6899871e7a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap458b086a-58') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG os_vif [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:3a:7d,bridge_name='br-int',has_traffic_filtering=True,id=458b086a-58f5-451f-936d-6f64a04ad64e,network=Network(0a345d47-5b12-4bbc-9e78-c6899871e7a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap458b086a-58') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap458b086a-58, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap458b086a-58, col_values=(('external_ids', {'iface-id': '458b086a-58f5-451f-936d-6f64a04ad64e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:3a:7d', 'vm-uuid': '391b2d43-3c9d-42db-bfae-09e8410bf367'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:28 user nova-compute[72766]: INFO os_vif [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:3a:7d,bridge_name='br-int',has_traffic_filtering=True,id=458b086a-58f5-451f-936d-6f64a04ad64e,network=Network(0a345d47-5b12-4bbc-9e78-c6899871e7a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap458b086a-58')
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T23:01:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2078583547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2078583547',id=18,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIeZZqtRVtgPVn1pVBb8bZPh3xgGlgKuQl6LUe4EpbdgvvZq2gTC/Dde6ksrfSoAZ8dqUguj9bwBGfQBJwt8dG1Fz3CREGps5wEjWKM5cHptDNZeQ/tI1EzuLyzihw2M2Q==',key_name='tempest-keypair-643381431',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac6b2b6ac4b246ff90b646e9d1ffc9c8',ramdisk_id='',reservation_id='r-781x6k7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-627581418',owner_user_name='tempest-TaggedBootDevicesTest_v242-627581418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:01:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d27477e14d64946a9ba1aa553b28ca3',uuid=391b2d43-3c9d-42db-bfae-09e8410bf367,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "437cdad2-00fb-4ac6-9fce-a67767cd4bda", "address": "fa:16:3e:29:78:c5", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap437cdad2-00", "ovs_interfaceid": "437cdad2-00fb-4ac6-9fce-a67767cd4bda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Converting VIF {"id": "437cdad2-00fb-4ac6-9fce-a67767cd4bda", "address": "fa:16:3e:29:78:c5", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap437cdad2-00", "ovs_interfaceid": "437cdad2-00fb-4ac6-9fce-a67767cd4bda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:78:c5,bridge_name='br-int',has_traffic_filtering=True,id=437cdad2-00fb-4ac6-9fce-a67767cd4bda,network=Network(0a345d47-5b12-4bbc-9e78-c6899871e7a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap437cdad2-00') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG os_vif [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:78:c5,bridge_name='br-int',has_traffic_filtering=True,id=437cdad2-00fb-4ac6-9fce-a67767cd4bda,network=Network(0a345d47-5b12-4bbc-9e78-c6899871e7a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap437cdad2-00') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap437cdad2-00, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap437cdad2-00, col_values=(('external_ids', {'iface-id': '437cdad2-00fb-4ac6-9fce-a67767cd4bda', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:78:c5', 'vm-uuid': '391b2d43-3c9d-42db-bfae-09e8410bf367'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:28 user nova-compute[72766]: INFO os_vif [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:78:c5,bridge_name='br-int',has_traffic_filtering=True,id=437cdad2-00fb-4ac6-9fce-a67767cd4bda,network=Network(0a345d47-5b12-4bbc-9e78-c6899871e7a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap437cdad2-00')
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T23:01:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2078583547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2078583547',id=18,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIeZZqtRVtgPVn1pVBb8bZPh3xgGlgKuQl6LUe4EpbdgvvZq2gTC/Dde6ksrfSoAZ8dqUguj9bwBGfQBJwt8dG1Fz3CREGps5wEjWKM5cHptDNZeQ/tI1EzuLyzihw2M2Q==',key_name='tempest-keypair-643381431',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac6b2b6ac4b246ff90b646e9d1ffc9c8',ramdisk_id='',reservation_id='r-781x6k7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-627581418',owner_user_name='tempest-TaggedBootDevicesTest_v242-627581418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:01:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d27477e14d64946a9ba1aa553b28ca3',uuid=391b2d43-3c9d-42db-bfae-09e8410bf367,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c48d46cf-70b1-408c-aee6-8965fb8356b0", "address": "fa:16:3e:23:98:99", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48d46cf-70", "ovs_interfaceid": "c48d46cf-70b1-408c-aee6-8965fb8356b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Converting VIF {"id": "c48d46cf-70b1-408c-aee6-8965fb8356b0", "address": "fa:16:3e:23:98:99", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48d46cf-70", "ovs_interfaceid": "c48d46cf-70b1-408c-aee6-8965fb8356b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:98:99,bridge_name='br-int',has_traffic_filtering=True,id=c48d46cf-70b1-408c-aee6-8965fb8356b0,network=Network(0a345d47-5b12-4bbc-9e78-c6899871e7a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc48d46cf-70') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG os_vif [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:98:99,bridge_name='br-int',has_traffic_filtering=True,id=c48d46cf-70b1-408c-aee6-8965fb8356b0,network=Network(0a345d47-5b12-4bbc-9e78-c6899871e7a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc48d46cf-70') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc48d46cf-70, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc48d46cf-70, col_values=(('external_ids', {'iface-id': 'c48d46cf-70b1-408c-aee6-8965fb8356b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:98:99', 'vm-uuid': '391b2d43-3c9d-42db-bfae-09e8410bf367'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:28 user nova-compute[72766]: INFO os_vif [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:98:99,bridge_name='br-int',has_traffic_filtering=True,id=c48d46cf-70b1-408c-aee6-8965fb8356b0,network=Network(0a345d47-5b12-4bbc-9e78-c6899871e7a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc48d46cf-70')
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T23:01:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2078583547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2078583547',id=18,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIeZZqtRVtgPVn1pVBb8bZPh3xgGlgKuQl6LUe4EpbdgvvZq2gTC/Dde6ksrfSoAZ8dqUguj9bwBGfQBJwt8dG1Fz3CREGps5wEjWKM5cHptDNZeQ/tI1EzuLyzihw2M2Q==',key_name='tempest-keypair-643381431',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac6b2b6ac4b246ff90b646e9d1ffc9c8',ramdisk_id='',reservation_id='r-781x6k7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-627581418',owner_user_name='tempest-TaggedBootDevicesTest_v242-627581418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:01:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d27477e14d64946a9ba1aa553b28ca3',uuid=391b2d43-3c9d-42db-bfae-09e8410bf367,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e418f46c-a8f2-4cbe-b422-b8aad6f84236", "address": "fa:16:3e:5b:c8:16", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape418f46c-a8", "ovs_interfaceid": "e418f46c-a8f2-4cbe-b422-b8aad6f84236", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Converting VIF {"id": "e418f46c-a8f2-4cbe-b422-b8aad6f84236", "address": "fa:16:3e:5b:c8:16", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape418f46c-a8", "ovs_interfaceid": "e418f46c-a8f2-4cbe-b422-b8aad6f84236", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:c8:16,bridge_name='br-int',has_traffic_filtering=True,id=e418f46c-a8f2-4cbe-b422-b8aad6f84236,network=Network(0a345d47-5b12-4bbc-9e78-c6899871e7a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape418f46c-a8') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG os_vif [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:c8:16,bridge_name='br-int',has_traffic_filtering=True,id=e418f46c-a8f2-4cbe-b422-b8aad6f84236,network=Network(0a345d47-5b12-4bbc-9e78-c6899871e7a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape418f46c-a8') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape418f46c-a8, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape418f46c-a8, col_values=(('external_ids', {'iface-id': 'e418f46c-a8f2-4cbe-b422-b8aad6f84236', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:c8:16', 'vm-uuid': '391b2d43-3c9d-42db-bfae-09e8410bf367'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:28 user nova-compute[72766]: INFO os_vif [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:c8:16,bridge_name='br-int',has_traffic_filtering=True,id=e418f46c-a8f2-4cbe-b422-b8aad6f84236,network=Network(0a345d47-5b12-4bbc-9e78-c6899871e7a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape418f46c-a8')
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T23:01:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2078583547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2078583547',id=18,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIeZZqtRVtgPVn1pVBb8bZPh3xgGlgKuQl6LUe4EpbdgvvZq2gTC/Dde6ksrfSoAZ8dqUguj9bwBGfQBJwt8dG1Fz3CREGps5wEjWKM5cHptDNZeQ/tI1EzuLyzihw2M2Q==',key_name='tempest-keypair-643381431',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac6b2b6ac4b246ff90b646e9d1ffc9c8',ramdisk_id='',reservation_id='r-781x6k7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-627581418',owner_user_name='tempest-TaggedBootDevicesTest_v242-627581418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:01:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d27477e14d64946a9ba1aa553b28ca3',uuid=391b2d43-3c9d-42db-bfae-09e8410bf367,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10cc8607-5dd0-4310-b2eb-ff4f5196573c", "address": "fa:16:3e:53:23:da", "network": {"id": "48e40549-72ed-45cc-ba38-e2155151f40c", "bridge": "br-int", "label": "tempest-device-tagging-net2-669256899", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10cc8607-5d", "ovs_interfaceid": "10cc8607-5dd0-4310-b2eb-ff4f5196573c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Converting VIF {"id": "10cc8607-5dd0-4310-b2eb-ff4f5196573c", "address": "fa:16:3e:53:23:da", "network": {"id": "48e40549-72ed-45cc-ba38-e2155151f40c", "bridge": "br-int", "label": "tempest-device-tagging-net2-669256899", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10cc8607-5d", "ovs_interfaceid": "10cc8607-5dd0-4310-b2eb-ff4f5196573c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:23:da,bridge_name='br-int',has_traffic_filtering=True,id=10cc8607-5dd0-4310-b2eb-ff4f5196573c,network=Network(48e40549-72ed-45cc-ba38-e2155151f40c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10cc8607-5d') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG os_vif [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:23:da,bridge_name='br-int',has_traffic_filtering=True,id=10cc8607-5dd0-4310-b2eb-ff4f5196573c,network=Network(48e40549-72ed-45cc-ba38-e2155151f40c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10cc8607-5d') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap10cc8607-5d, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap10cc8607-5d, col_values=(('external_ids', {'iface-id': '10cc8607-5dd0-4310-b2eb-ff4f5196573c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:23:da', 'vm-uuid': '391b2d43-3c9d-42db-bfae-09e8410bf367'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:28 user nova-compute[72766]: INFO os_vif [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:23:da,bridge_name='br-int',has_traffic_filtering=True,id=10cc8607-5dd0-4310-b2eb-ff4f5196573c,network=Network(48e40549-72ed-45cc-ba38-e2155151f40c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10cc8607-5d')
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T23:01:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2078583547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2078583547',id=18,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIeZZqtRVtgPVn1pVBb8bZPh3xgGlgKuQl6LUe4EpbdgvvZq2gTC/Dde6ksrfSoAZ8dqUguj9bwBGfQBJwt8dG1Fz3CREGps5wEjWKM5cHptDNZeQ/tI1EzuLyzihw2M2Q==',key_name='tempest-keypair-643381431',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac6b2b6ac4b246ff90b646e9d1ffc9c8',ramdisk_id='',reservation_id='r-781x6k7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-627581418',owner_user_name='tempest-TaggedBootDevicesTest_v242-627581418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:01:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d27477e14d64946a9ba1aa553b28ca3',uuid=391b2d43-3c9d-42db-bfae-09e8410bf367,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f59675e3-d424-46f3-b3ef-ea1133f0aafd", "address": "fa:16:3e:b3:a0:b6", "network": {"id": "48e40549-72ed-45cc-ba38-e2155151f40c", "bridge": "br-int", "label": "tempest-device-tagging-net2-669256899", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59675e3-d4", "ovs_interfaceid": "f59675e3-d424-46f3-b3ef-ea1133f0aafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Converting VIF {"id": "f59675e3-d424-46f3-b3ef-ea1133f0aafd", "address": "fa:16:3e:b3:a0:b6", "network": {"id": "48e40549-72ed-45cc-ba38-e2155151f40c", "bridge": "br-int", "label": "tempest-device-tagging-net2-669256899", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59675e3-d4", "ovs_interfaceid": "f59675e3-d424-46f3-b3ef-ea1133f0aafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:a0:b6,bridge_name='br-int',has_traffic_filtering=True,id=f59675e3-d424-46f3-b3ef-ea1133f0aafd,network=Network(48e40549-72ed-45cc-ba38-e2155151f40c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf59675e3-d4') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG os_vif [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:a0:b6,bridge_name='br-int',has_traffic_filtering=True,id=f59675e3-d424-46f3-b3ef-ea1133f0aafd,network=Network(48e40549-72ed-45cc-ba38-e2155151f40c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf59675e3-d4') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf59675e3-d4, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf59675e3-d4, col_values=(('external_ids', {'iface-id': 'f59675e3-d424-46f3-b3ef-ea1133f0aafd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:a0:b6', 'vm-uuid': '391b2d43-3c9d-42db-bfae-09e8410bf367'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:28 user nova-compute[72766]: INFO os_vif [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:a0:b6,bridge_name='br-int',has_traffic_filtering=True,id=f59675e3-d424-46f3-b3ef-ea1133f0aafd,network=Network(48e40549-72ed-45cc-ba38-e2155151f40c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf59675e3-d4')
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.compute.manager [req-d2b7ca22-5003-4c0b-9fad-7a73a9e0962c req-6610bb10-ddb2-4765-9841-caa797b18b8e service nova] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Received event network-vif-deleted-3b9abe2a-2056-403c-bc2e-97bff0d04648 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:02:28 user nova-compute[72766]: INFO nova.compute.manager [req-d2b7ca22-5003-4c0b-9fad-7a73a9e0962c req-6610bb10-ddb2-4765-9841-caa797b18b8e service nova] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Neutron deleted interface 3b9abe2a-2056-403c-bc2e-97bff0d04648; detaching it from the instance and deleting it from the info cache
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.network.neutron [req-d2b7ca22-5003-4c0b-9fad-7a73a9e0962c req-6610bb10-ddb2-4765-9841-caa797b18b8e service nova] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:02:28 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Took 0.99 seconds to deallocate network for instance.
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.compute.manager [req-d2b7ca22-5003-4c0b-9fad-7a73a9e0962c req-6610bb10-ddb2-4765-9841-caa797b18b8e service nova] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Detach interface failed, port_id=3b9abe2a-2056-403c-bc2e-97bff0d04648, reason: Instance c02e6fd7-e712-45da-b35b-2fe21675e2f1 could not be found. {{(pid=72766) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] No BDM found with device name hda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] No VIF found with MAC fa:16:3e:c1:4c:ad, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] No VIF found with MAC fa:16:3e:5b:c8:16, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:02:28 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Using config drive
Aug 14 23:02:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-75d23578-21b4-452c-b6da-d98cc8039c62 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-75d23578-21b4-452c-b6da-d98cc8039c62 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:02:28 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Creating config drive at /opt/stack/data/nova/instances/391b2d43-3c9d-42db-bfae-09e8410bf367/disk.config
Aug 14 23:02:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/391b2d43-3c9d-42db-bfae-09e8410bf367/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpy3ciqvzs {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/391b2d43-3c9d-42db-bfae-09e8410bf367/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpy3ciqvzs" returned: 0 in 0.062s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:29 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-75d23578-21b4-452c-b6da-d98cc8039c62 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:02:29 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-75d23578-21b4-452c-b6da-d98cc8039c62 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:02:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-75d23578-21b4-452c-b6da-d98cc8039c62 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.363s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:02:29 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-75d23578-21b4-452c-b6da-d98cc8039c62 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Deleted allocations for instance c02e6fd7-e712-45da-b35b-2fe21675e2f1
Aug 14 23:02:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-75d23578-21b4-452c-b6da-d98cc8039c62 tempest-TestServerVolumeAttachScenarioOldVersion-767657021 tempest-TestServerVolumeAttachScenarioOldVersion-767657021-project-member] Lock "c02e6fd7-e712-45da-b35b-2fe21675e2f1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.474s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:02:29 user nova-compute[72766]: DEBUG nova.compute.manager [req-76d6724b-01d6-42fb-a02a-11e03a104342 req-c46e985f-e18c-4662-9c29-d73e69accef5 service nova] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Received event network-vif-plugged-3b9abe2a-2056-403c-bc2e-97bff0d04648 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:02:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-76d6724b-01d6-42fb-a02a-11e03a104342 req-c46e985f-e18c-4662-9c29-d73e69accef5 service nova] Acquiring lock "c02e6fd7-e712-45da-b35b-2fe21675e2f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:02:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-76d6724b-01d6-42fb-a02a-11e03a104342 req-c46e985f-e18c-4662-9c29-d73e69accef5 service nova] Lock "c02e6fd7-e712-45da-b35b-2fe21675e2f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:02:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-76d6724b-01d6-42fb-a02a-11e03a104342 req-c46e985f-e18c-4662-9c29-d73e69accef5 service nova] Lock "c02e6fd7-e712-45da-b35b-2fe21675e2f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:02:29 user nova-compute[72766]: DEBUG nova.compute.manager [req-76d6724b-01d6-42fb-a02a-11e03a104342 req-c46e985f-e18c-4662-9c29-d73e69accef5 service nova] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] No waiting events found dispatching network-vif-plugged-3b9abe2a-2056-403c-bc2e-97bff0d04648 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:02:29 user nova-compute[72766]: WARNING nova.compute.manager [req-76d6724b-01d6-42fb-a02a-11e03a104342 req-c46e985f-e18c-4662-9c29-d73e69accef5 service nova] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Received unexpected event network-vif-plugged-3b9abe2a-2056-403c-bc2e-97bff0d04648 for instance with vm_state deleted and task_state None.
Aug 14 23:02:30 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:30 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:30 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:30 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:30 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:30 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:30 user nova-compute[72766]: DEBUG nova.compute.manager [req-0795e7a4-94f3-4299-9938-791fe34bca05 req-66fbce0b-24e9-47d8-acf5-2a74ce65dcbf service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-vif-plugged-458b086a-58f5-451f-936d-6f64a04ad64e {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:02:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0795e7a4-94f3-4299-9938-791fe34bca05 req-66fbce0b-24e9-47d8-acf5-2a74ce65dcbf service nova] Acquiring lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:02:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0795e7a4-94f3-4299-9938-791fe34bca05 req-66fbce0b-24e9-47d8-acf5-2a74ce65dcbf service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:02:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0795e7a4-94f3-4299-9938-791fe34bca05 req-66fbce0b-24e9-47d8-acf5-2a74ce65dcbf service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:02:30 user nova-compute[72766]: DEBUG nova.compute.manager [req-0795e7a4-94f3-4299-9938-791fe34bca05 req-66fbce0b-24e9-47d8-acf5-2a74ce65dcbf service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] No waiting events found dispatching network-vif-plugged-458b086a-58f5-451f-936d-6f64a04ad64e {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:02:30 user nova-compute[72766]: WARNING nova.compute.manager [req-0795e7a4-94f3-4299-9938-791fe34bca05 req-66fbce0b-24e9-47d8-acf5-2a74ce65dcbf service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received unexpected event network-vif-plugged-458b086a-58f5-451f-936d-6f64a04ad64e for instance with vm_state building and task_state spawning.
Aug 14 23:02:30 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:30 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:30 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:31 user nova-compute[72766]: DEBUG nova.compute.manager [req-73b63546-7637-44e0-bed3-790d3e6a503f req-5bdbd3df-ea72-46c2-b2e7-75404e50d593 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-vif-plugged-a084e92b-2287-4ac4-a9a5-db86f3d3249e {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:02:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-73b63546-7637-44e0-bed3-790d3e6a503f req-5bdbd3df-ea72-46c2-b2e7-75404e50d593 service nova] Acquiring lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:02:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-73b63546-7637-44e0-bed3-790d3e6a503f req-5bdbd3df-ea72-46c2-b2e7-75404e50d593 service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:02:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-73b63546-7637-44e0-bed3-790d3e6a503f req-5bdbd3df-ea72-46c2-b2e7-75404e50d593 service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:02:31 user nova-compute[72766]: DEBUG nova.compute.manager [req-73b63546-7637-44e0-bed3-790d3e6a503f req-5bdbd3df-ea72-46c2-b2e7-75404e50d593 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] No waiting events found dispatching network-vif-plugged-a084e92b-2287-4ac4-a9a5-db86f3d3249e {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:02:31 user nova-compute[72766]: WARNING nova.compute.manager [req-73b63546-7637-44e0-bed3-790d3e6a503f req-5bdbd3df-ea72-46c2-b2e7-75404e50d593 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received unexpected event network-vif-plugged-a084e92b-2287-4ac4-a9a5-db86f3d3249e for instance with vm_state building and task_state spawning.
Aug 14 23:02:31 user nova-compute[72766]: DEBUG nova.compute.manager [req-73b63546-7637-44e0-bed3-790d3e6a503f req-5bdbd3df-ea72-46c2-b2e7-75404e50d593 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-vif-plugged-a084e92b-2287-4ac4-a9a5-db86f3d3249e {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:02:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-73b63546-7637-44e0-bed3-790d3e6a503f req-5bdbd3df-ea72-46c2-b2e7-75404e50d593 service nova] Acquiring lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:02:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-73b63546-7637-44e0-bed3-790d3e6a503f req-5bdbd3df-ea72-46c2-b2e7-75404e50d593 service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:02:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-73b63546-7637-44e0-bed3-790d3e6a503f req-5bdbd3df-ea72-46c2-b2e7-75404e50d593 service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:02:31 user nova-compute[72766]: DEBUG nova.compute.manager [req-73b63546-7637-44e0-bed3-790d3e6a503f req-5bdbd3df-ea72-46c2-b2e7-75404e50d593 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] No waiting events found dispatching network-vif-plugged-a084e92b-2287-4ac4-a9a5-db86f3d3249e {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:02:31 user nova-compute[72766]: WARNING nova.compute.manager [req-73b63546-7637-44e0-bed3-790d3e6a503f req-5bdbd3df-ea72-46c2-b2e7-75404e50d593 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received unexpected event network-vif-plugged-a084e92b-2287-4ac4-a9a5-db86f3d3249e for instance with vm_state building and task_state spawning.
Aug 14 23:02:31 user nova-compute[72766]: DEBUG nova.compute.manager [req-73b63546-7637-44e0-bed3-790d3e6a503f req-5bdbd3df-ea72-46c2-b2e7-75404e50d593 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-vif-plugged-437cdad2-00fb-4ac6-9fce-a67767cd4bda {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:02:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-73b63546-7637-44e0-bed3-790d3e6a503f req-5bdbd3df-ea72-46c2-b2e7-75404e50d593 service nova] Acquiring lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:02:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-73b63546-7637-44e0-bed3-790d3e6a503f req-5bdbd3df-ea72-46c2-b2e7-75404e50d593 service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:02:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-73b63546-7637-44e0-bed3-790d3e6a503f req-5bdbd3df-ea72-46c2-b2e7-75404e50d593 service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:02:31 user nova-compute[72766]: DEBUG nova.compute.manager [req-73b63546-7637-44e0-bed3-790d3e6a503f req-5bdbd3df-ea72-46c2-b2e7-75404e50d593 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] No waiting events found dispatching network-vif-plugged-437cdad2-00fb-4ac6-9fce-a67767cd4bda {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:02:31 user nova-compute[72766]: WARNING nova.compute.manager [req-73b63546-7637-44e0-bed3-790d3e6a503f req-5bdbd3df-ea72-46c2-b2e7-75404e50d593 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received unexpected event network-vif-plugged-437cdad2-00fb-4ac6-9fce-a67767cd4bda for instance with vm_state building and task_state spawning.
Aug 14 23:02:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:31 user nova-compute[72766]: DEBUG nova.compute.manager [req-90aa4432-a1eb-47c5-88b9-53ae3fa30435 req-e97975ae-e8ae-44d6-b8b1-4b3891f553b1 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-vif-plugged-c48d46cf-70b1-408c-aee6-8965fb8356b0 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:02:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-90aa4432-a1eb-47c5-88b9-53ae3fa30435 req-e97975ae-e8ae-44d6-b8b1-4b3891f553b1 service nova] Acquiring lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:02:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-90aa4432-a1eb-47c5-88b9-53ae3fa30435 req-e97975ae-e8ae-44d6-b8b1-4b3891f553b1 service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:02:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-90aa4432-a1eb-47c5-88b9-53ae3fa30435 req-e97975ae-e8ae-44d6-b8b1-4b3891f553b1 service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:02:31 user nova-compute[72766]: DEBUG nova.compute.manager [req-90aa4432-a1eb-47c5-88b9-53ae3fa30435 req-e97975ae-e8ae-44d6-b8b1-4b3891f553b1 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] No waiting events found dispatching network-vif-plugged-c48d46cf-70b1-408c-aee6-8965fb8356b0 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:02:31 user nova-compute[72766]: WARNING nova.compute.manager [req-90aa4432-a1eb-47c5-88b9-53ae3fa30435 req-e97975ae-e8ae-44d6-b8b1-4b3891f553b1 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received unexpected event network-vif-plugged-c48d46cf-70b1-408c-aee6-8965fb8356b0 for instance with vm_state building and task_state spawning.
Aug 14 23:02:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:32 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:32 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:32 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:32 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:32 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:32 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:32 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:32 user nova-compute[72766]: DEBUG nova.compute.manager [req-8f4f56c5-b23b-4e45-9953-33e701ab3667 req-24b4ea71-50c8-4a6e-9a76-9152bcf72d03 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-vif-plugged-458b086a-58f5-451f-936d-6f64a04ad64e {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:02:32 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8f4f56c5-b23b-4e45-9953-33e701ab3667 req-24b4ea71-50c8-4a6e-9a76-9152bcf72d03 service nova] Acquiring lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:02:32 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8f4f56c5-b23b-4e45-9953-33e701ab3667 req-24b4ea71-50c8-4a6e-9a76-9152bcf72d03 service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:02:32 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8f4f56c5-b23b-4e45-9953-33e701ab3667 req-24b4ea71-50c8-4a6e-9a76-9152bcf72d03 service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:02:32 user nova-compute[72766]: DEBUG nova.compute.manager [req-8f4f56c5-b23b-4e45-9953-33e701ab3667 req-24b4ea71-50c8-4a6e-9a76-9152bcf72d03 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] No waiting events found dispatching network-vif-plugged-458b086a-58f5-451f-936d-6f64a04ad64e {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:02:32 user nova-compute[72766]: WARNING nova.compute.manager [req-8f4f56c5-b23b-4e45-9953-33e701ab3667 req-24b4ea71-50c8-4a6e-9a76-9152bcf72d03 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received unexpected event network-vif-plugged-458b086a-58f5-451f-936d-6f64a04ad64e for instance with vm_state building and task_state spawning.
Aug 14 23:02:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:02:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:02:33 user nova-compute[72766]: DEBUG nova.objects.instance [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Lazy-loading 'pci_requests' on Instance uuid 4d919875-5f24-4bed-bf26-cf437e0de3e2 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:02:33 user nova-compute[72766]: DEBUG nova.objects.instance [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Lazy-loading 'numa_topology' on Instance uuid 4d919875-5f24-4bed-bf26-cf437e0de3e2 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:02:33 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 23:02:33 user nova-compute[72766]: INFO nova.compute.claims [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Claim successful on node user
Aug 14 23:02:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-7562a495-9ee9-4ee0-b6bc-061cc3d8b6ac req-2fd86db3-fd82-4655-917e-c6088d6a5f1a service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-vif-plugged-437cdad2-00fb-4ac6-9fce-a67767cd4bda {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:02:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7562a495-9ee9-4ee0-b6bc-061cc3d8b6ac req-2fd86db3-fd82-4655-917e-c6088d6a5f1a service nova] Acquiring lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:02:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7562a495-9ee9-4ee0-b6bc-061cc3d8b6ac req-2fd86db3-fd82-4655-917e-c6088d6a5f1a service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:02:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7562a495-9ee9-4ee0-b6bc-061cc3d8b6ac req-2fd86db3-fd82-4655-917e-c6088d6a5f1a service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:02:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-7562a495-9ee9-4ee0-b6bc-061cc3d8b6ac req-2fd86db3-fd82-4655-917e-c6088d6a5f1a service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] No waiting events found dispatching network-vif-plugged-437cdad2-00fb-4ac6-9fce-a67767cd4bda {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:02:33 user nova-compute[72766]: WARNING nova.compute.manager [req-7562a495-9ee9-4ee0-b6bc-061cc3d8b6ac req-2fd86db3-fd82-4655-917e-c6088d6a5f1a service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received unexpected event network-vif-plugged-437cdad2-00fb-4ac6-9fce-a67767cd4bda for instance with vm_state building and task_state spawning.
Aug 14 23:02:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-7562a495-9ee9-4ee0-b6bc-061cc3d8b6ac req-2fd86db3-fd82-4655-917e-c6088d6a5f1a service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-vif-plugged-10cc8607-5dd0-4310-b2eb-ff4f5196573c {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:02:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7562a495-9ee9-4ee0-b6bc-061cc3d8b6ac req-2fd86db3-fd82-4655-917e-c6088d6a5f1a service nova] Acquiring lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:02:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7562a495-9ee9-4ee0-b6bc-061cc3d8b6ac req-2fd86db3-fd82-4655-917e-c6088d6a5f1a service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:02:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7562a495-9ee9-4ee0-b6bc-061cc3d8b6ac req-2fd86db3-fd82-4655-917e-c6088d6a5f1a service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:02:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-7562a495-9ee9-4ee0-b6bc-061cc3d8b6ac req-2fd86db3-fd82-4655-917e-c6088d6a5f1a service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] No waiting events found dispatching network-vif-plugged-10cc8607-5dd0-4310-b2eb-ff4f5196573c {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:02:33 user nova-compute[72766]: WARNING nova.compute.manager [req-7562a495-9ee9-4ee0-b6bc-061cc3d8b6ac req-2fd86db3-fd82-4655-917e-c6088d6a5f1a service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received unexpected event network-vif-plugged-10cc8607-5dd0-4310-b2eb-ff4f5196573c for instance with vm_state building and task_state spawning.
Aug 14 23:02:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-7562a495-9ee9-4ee0-b6bc-061cc3d8b6ac req-2fd86db3-fd82-4655-917e-c6088d6a5f1a service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-vif-plugged-10cc8607-5dd0-4310-b2eb-ff4f5196573c {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:02:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7562a495-9ee9-4ee0-b6bc-061cc3d8b6ac req-2fd86db3-fd82-4655-917e-c6088d6a5f1a service nova] Acquiring lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:02:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7562a495-9ee9-4ee0-b6bc-061cc3d8b6ac req-2fd86db3-fd82-4655-917e-c6088d6a5f1a service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:02:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7562a495-9ee9-4ee0-b6bc-061cc3d8b6ac req-2fd86db3-fd82-4655-917e-c6088d6a5f1a service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:02:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-7562a495-9ee9-4ee0-b6bc-061cc3d8b6ac req-2fd86db3-fd82-4655-917e-c6088d6a5f1a service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] No waiting events found dispatching network-vif-plugged-10cc8607-5dd0-4310-b2eb-ff4f5196573c {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:02:33 user nova-compute[72766]: WARNING nova.compute.manager [req-7562a495-9ee9-4ee0-b6bc-061cc3d8b6ac req-2fd86db3-fd82-4655-917e-c6088d6a5f1a service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received unexpected event network-vif-plugged-10cc8607-5dd0-4310-b2eb-ff4f5196573c for instance with vm_state building and task_state spawning.
Aug 14 23:02:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-7562a495-9ee9-4ee0-b6bc-061cc3d8b6ac req-2fd86db3-fd82-4655-917e-c6088d6a5f1a service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-vif-plugged-f59675e3-d424-46f3-b3ef-ea1133f0aafd {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:02:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7562a495-9ee9-4ee0-b6bc-061cc3d8b6ac req-2fd86db3-fd82-4655-917e-c6088d6a5f1a service nova] Acquiring lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:02:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7562a495-9ee9-4ee0-b6bc-061cc3d8b6ac req-2fd86db3-fd82-4655-917e-c6088d6a5f1a service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:02:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7562a495-9ee9-4ee0-b6bc-061cc3d8b6ac req-2fd86db3-fd82-4655-917e-c6088d6a5f1a service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:02:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-7562a495-9ee9-4ee0-b6bc-061cc3d8b6ac req-2fd86db3-fd82-4655-917e-c6088d6a5f1a service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] No waiting events found dispatching network-vif-plugged-f59675e3-d424-46f3-b3ef-ea1133f0aafd {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:02:33 user nova-compute[72766]: WARNING nova.compute.manager [req-7562a495-9ee9-4ee0-b6bc-061cc3d8b6ac req-2fd86db3-fd82-4655-917e-c6088d6a5f1a service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received unexpected event network-vif-plugged-f59675e3-d424-46f3-b3ef-ea1133f0aafd for instance with vm_state building and task_state spawning.
Aug 14 23:02:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-7562a495-9ee9-4ee0-b6bc-061cc3d8b6ac req-2fd86db3-fd82-4655-917e-c6088d6a5f1a service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-vif-plugged-f59675e3-d424-46f3-b3ef-ea1133f0aafd {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:02:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7562a495-9ee9-4ee0-b6bc-061cc3d8b6ac req-2fd86db3-fd82-4655-917e-c6088d6a5f1a service nova] Acquiring lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:02:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7562a495-9ee9-4ee0-b6bc-061cc3d8b6ac req-2fd86db3-fd82-4655-917e-c6088d6a5f1a service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:02:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7562a495-9ee9-4ee0-b6bc-061cc3d8b6ac req-2fd86db3-fd82-4655-917e-c6088d6a5f1a service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:02:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-7562a495-9ee9-4ee0-b6bc-061cc3d8b6ac req-2fd86db3-fd82-4655-917e-c6088d6a5f1a service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] No waiting events found dispatching network-vif-plugged-f59675e3-d424-46f3-b3ef-ea1133f0aafd {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:02:33 user nova-compute[72766]: WARNING nova.compute.manager [req-7562a495-9ee9-4ee0-b6bc-061cc3d8b6ac req-2fd86db3-fd82-4655-917e-c6088d6a5f1a service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received unexpected event network-vif-plugged-f59675e3-d424-46f3-b3ef-ea1133f0aafd for instance with vm_state building and task_state spawning.
Aug 14 23:02:33 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:02:33 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:02:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.511s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:02:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-0fffa4e7-7a5a-44ed-9753-80812014e75c req-10be84c9-12b1-4e32-ba0b-779d4b80ca94 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-vif-plugged-c48d46cf-70b1-408c-aee6-8965fb8356b0 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:02:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0fffa4e7-7a5a-44ed-9753-80812014e75c req-10be84c9-12b1-4e32-ba0b-779d4b80ca94 service nova] Acquiring lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:02:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0fffa4e7-7a5a-44ed-9753-80812014e75c req-10be84c9-12b1-4e32-ba0b-779d4b80ca94 service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:02:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0fffa4e7-7a5a-44ed-9753-80812014e75c req-10be84c9-12b1-4e32-ba0b-779d4b80ca94 service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:02:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-0fffa4e7-7a5a-44ed-9753-80812014e75c req-10be84c9-12b1-4e32-ba0b-779d4b80ca94 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] No waiting events found dispatching network-vif-plugged-c48d46cf-70b1-408c-aee6-8965fb8356b0 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:02:33 user nova-compute[72766]: WARNING nova.compute.manager [req-0fffa4e7-7a5a-44ed-9753-80812014e75c req-10be84c9-12b1-4e32-ba0b-779d4b80ca94 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received unexpected event network-vif-plugged-c48d46cf-70b1-408c-aee6-8965fb8356b0 for instance with vm_state building and task_state spawning.
Aug 14 23:02:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-0fffa4e7-7a5a-44ed-9753-80812014e75c req-10be84c9-12b1-4e32-ba0b-779d4b80ca94 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-vif-plugged-e418f46c-a8f2-4cbe-b422-b8aad6f84236 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:02:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0fffa4e7-7a5a-44ed-9753-80812014e75c req-10be84c9-12b1-4e32-ba0b-779d4b80ca94 service nova] Acquiring lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:02:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0fffa4e7-7a5a-44ed-9753-80812014e75c req-10be84c9-12b1-4e32-ba0b-779d4b80ca94 service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:02:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0fffa4e7-7a5a-44ed-9753-80812014e75c req-10be84c9-12b1-4e32-ba0b-779d4b80ca94 service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:02:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-0fffa4e7-7a5a-44ed-9753-80812014e75c req-10be84c9-12b1-4e32-ba0b-779d4b80ca94 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] No waiting events found dispatching network-vif-plugged-e418f46c-a8f2-4cbe-b422-b8aad6f84236 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:02:33 user nova-compute[72766]: WARNING nova.compute.manager [req-0fffa4e7-7a5a-44ed-9753-80812014e75c req-10be84c9-12b1-4e32-ba0b-779d4b80ca94 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received unexpected event network-vif-plugged-e418f46c-a8f2-4cbe-b422-b8aad6f84236 for instance with vm_state building and task_state spawning.
Aug 14 23:02:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-0fffa4e7-7a5a-44ed-9753-80812014e75c req-10be84c9-12b1-4e32-ba0b-779d4b80ca94 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-vif-plugged-e418f46c-a8f2-4cbe-b422-b8aad6f84236 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:02:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0fffa4e7-7a5a-44ed-9753-80812014e75c req-10be84c9-12b1-4e32-ba0b-779d4b80ca94 service nova] Acquiring lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:02:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0fffa4e7-7a5a-44ed-9753-80812014e75c req-10be84c9-12b1-4e32-ba0b-779d4b80ca94 service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:02:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0fffa4e7-7a5a-44ed-9753-80812014e75c req-10be84c9-12b1-4e32-ba0b-779d4b80ca94 service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:02:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-0fffa4e7-7a5a-44ed-9753-80812014e75c req-10be84c9-12b1-4e32-ba0b-779d4b80ca94 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] No waiting events found dispatching network-vif-plugged-e418f46c-a8f2-4cbe-b422-b8aad6f84236 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:02:33 user nova-compute[72766]: WARNING nova.compute.manager [req-0fffa4e7-7a5a-44ed-9753-80812014e75c req-10be84c9-12b1-4e32-ba0b-779d4b80ca94 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received unexpected event network-vif-plugged-e418f46c-a8f2-4cbe-b422-b8aad6f84236 for instance with vm_state building and task_state spawning.
Aug 14 23:02:33 user nova-compute[72766]: INFO nova.network.neutron [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Updating port bb47713e-54a8-4834-a78d-749c5f72f334 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 14 23:02:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Acquiring lock "refresh_cache-4d919875-5f24-4bed-bf26-cf437e0de3e2" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:02:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Acquired lock "refresh_cache-4d919875-5f24-4bed-bf26-cf437e0de3e2" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:02:34 user nova-compute[72766]: DEBUG nova.network.neutron [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:02:34 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054154.7036505, 391b2d43-3c9d-42db-bfae-09e8410bf367 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:02:34 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] VM Resumed (Lifecycle Event)
Aug 14 23:02:34 user nova-compute[72766]: DEBUG nova.compute.manager [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:02:34 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 23:02:34 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Instance spawned successfully.
Aug 14 23:02:34 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 23:02:34 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:02:34 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:02:34 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:02:34 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:02:34 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:02:34 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:02:34 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:02:34 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:02:34 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:02:34 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054154.7047253, 391b2d43-3c9d-42db-bfae-09e8410bf367 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:02:34 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] VM Started (Lifecycle Event)
Aug 14 23:02:34 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:02:34 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:02:34 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:02:34 user nova-compute[72766]: INFO nova.compute.manager [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Took 11.35 seconds to spawn the instance on the hypervisor.
Aug 14 23:02:34 user nova-compute[72766]: DEBUG nova.compute.manager [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:02:34 user nova-compute[72766]: INFO nova.compute.manager [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Took 41.26 seconds to build instance.
Aug 14 23:02:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-696f6606-a25c-407f-a9bc-59e4d1d025e0 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 41.366s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG nova.compute.manager [req-6868886a-bc4f-4d92-a90c-ef04f208f4d9 req-d58046f7-b0f6-4cda-8137-dbee6315d083 service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Received event network-changed-bb47713e-54a8-4834-a78d-749c5f72f334 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG nova.compute.manager [req-6868886a-bc4f-4d92-a90c-ef04f208f4d9 req-d58046f7-b0f6-4cda-8137-dbee6315d083 service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Refreshing instance network info cache due to event network-changed-bb47713e-54a8-4834-a78d-749c5f72f334. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-6868886a-bc4f-4d92-a90c-ef04f208f4d9 req-d58046f7-b0f6-4cda-8137-dbee6315d083 service nova] Acquiring lock "refresh_cache-4d919875-5f24-4bed-bf26-cf437e0de3e2" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG nova.network.neutron [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Updating instance_info_cache with network_info: [{"id": "bb47713e-54a8-4834-a78d-749c5f72f334", "address": "fa:16:3e:34:a4:4f", "network": {"id": "b151d906-14b7-466f-909c-18c6b9f1855d", "bridge": "br-int", "label": "tempest-TestShelveInstance-664463668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71798c25948f4c8cb02664413314a4e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb47713e-54", "ovs_interfaceid": "bb47713e-54a8-4834-a78d-749c5f72f334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Releasing lock "refresh_cache-4d919875-5f24-4bed-bf26-cf437e0de3e2" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 23:02:35 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Creating image(s)
Aug 14 23:02:35 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Did not create local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Ensure instance console log exists: /opt/stack/data/nova/instances/4d919875-5f24-4bed-bf26-cf437e0de3e2/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Start _get_guest_xml network_info=[{"id": "bb47713e-54a8-4834-a78d-749c5f72f334", "address": "fa:16:3e:34:a4:4f", "network": {"id": "b151d906-14b7-466f-909c-18c6b9f1855d", "bridge": "br-int", "label": "tempest-TestShelveInstance-664463668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71798c25948f4c8cb02664413314a4e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb47713e-54", "ovs_interfaceid": "bb47713e-54a8-4834-a78d-749c5f72f334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': '11eb2e43-1f44-4320-a58d-d0f7335e4db1', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvezkmys', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4d919875-5f24-4bed-bf26-cf437e0de3e2', 'attached_at': '', 'detached_at': '', 'volume_id': 'cc05004f-3360-4071-bd51-ce172fb18886', 'serial': 'cc05004f-3360-4071-bd51-ce172fb18886'}, 'volume_type': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-6868886a-bc4f-4d92-a90c-ef04f208f4d9 req-d58046f7-b0f6-4cda-8137-dbee6315d083 service nova] Acquired lock "refresh_cache-4d919875-5f24-4bed-bf26-cf437e0de3e2" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG nova.network.neutron [req-6868886a-bc4f-4d92-a90c-ef04f208f4d9 req-d58046f7-b0f6-4cda-8137-dbee6315d083 service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Refreshing network info cache for port bb47713e-54a8-4834-a78d-749c5f72f334 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:02:35 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:02:35 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:02:35 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG nova.objects.instance [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4d919875-5f24-4bed-bf26-cf437e0de3e2 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvezkmys', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:02:35 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:02:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:02:35 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:02:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:02:35 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 23:02:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2488f9-543b-4b43-af65-4f828ddfd42b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 23:02:35 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[604fd4b8-9050-41fc-9691-063fb44ac9c1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886] added
Aug 14 23:02:35 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[f866683d-e154-43f4-aad8-8f88ffe8c199]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b494e821-631b-4cf2-abf8-b9acb324bcc0]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cvezkmys {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cvezkmys" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c088d091-6c78-47ef-a223-1ddc43428228]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cvezkmys'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3ffaa7-284d-40cf-8fa1-b1914260c4e4]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3750090-3e02-45f7-9845-2a4008670efb]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)
Aug 14 23:02:35 user nova-compute[72766]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 (non-flash)
Aug 14 23:02:35 user nova-compute[72766]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 (non-flash)
Aug 14 23:02:35 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)
Aug 14 23:02:35 user nova-compute[72766]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 (non-flash)
Aug 14 23:02:35 user nova-compute[72766]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 (non-flash)
Aug 14 23:02:35 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cff4fbc-dc9e-48a7-b51d-a2322619c23a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886, portal: 172.16.0.220,3260]
Aug 14 23:02:35 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886, portal: 172.16.0.220,3260] successful.
Aug 14 23:02:35 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc9e40f-6b5c-4b2b-a67b-ca5d9fc56359]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd13181-e4d5-4216-a007-36d4f5f7007b]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)
Aug 14 23:02:35 user nova-compute[72766]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 (non-flash)
Aug 14 23:02:35 user nova-compute[72766]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 (non-flash)
Aug 14 23:02:35 user nova-compute[72766]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 23:02:35 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)
Aug 14 23:02:35 user nova-compute[72766]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 (non-flash)
Aug 14 23:02:35 user nova-compute[72766]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 (non-flash)
Aug 14 23:02:35 user nova-compute[72766]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 23:02:35 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.025s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8404ef-94c1-4177-a91a-274b1abdca41]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvezkmys', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG nova.network.neutron [req-6868886a-bc4f-4d92-a90c-ef04f208f4d9 req-d58046f7-b0f6-4cda-8137-dbee6315d083 service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Updated VIF entry in instance network info cache for port bb47713e-54a8-4834-a78d-749c5f72f334. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG nova.network.neutron [req-6868886a-bc4f-4d92-a90c-ef04f208f4d9 req-d58046f7-b0f6-4cda-8137-dbee6315d083 service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Updating instance_info_cache with network_info: [{"id": "bb47713e-54a8-4834-a78d-749c5f72f334", "address": "fa:16:3e:34:a4:4f", "network": {"id": "b151d906-14b7-466f-909c-18c6b9f1855d", "bridge": "br-int", "label": "tempest-TestShelveInstance-664463668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71798c25948f4c8cb02664413314a4e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb47713e-54", "ovs_interfaceid": "bb47713e-54a8-4834-a78d-749c5f72f334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:02:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-6868886a-bc4f-4d92-a90c-ef04f208f4d9 req-d58046f7-b0f6-4cda-8137-dbee6315d083 service nova] Releasing lock "refresh_cache-4d919875-5f24-4bed-bf26-cf437e0de3e2" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:02:36 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:02:36 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '23039323238376166', 'path': '/dev/sde'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:02:36 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039323238376166', 'path': '/dev/sde'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 23:02:36 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T22:58:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1732259896',display_name='tempest-TestShelveInstance-server-1732259896',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1732259896',id=12,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1877498323',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:58:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='71798c25948f4c8cb02664413314a4e1',ramdisk_id='',reservation_id='r-yvm2m86y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1305179191',owner_user_name='tempest-TestShelveInstance-1305179191-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:02:07Z,user_data=None,user_id='d46f138a683742b09a91e1f10f085c18',uuid=4d919875-5f24-4bed-bf26-cf437e0de3e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "bb47713e-54a8-4834-a78d-749c5f72f334", "address": "fa:16:3e:34:a4:4f", "network": {"id": "b151d906-14b7-466f-909c-18c6b9f1855d", "bridge": "br-int", "label": "tempest-TestShelveInstance-664463668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71798c25948f4c8cb02664413314a4e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb47713e-54", "ovs_interfaceid": "bb47713e-54a8-4834-a78d-749c5f72f334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:02:36 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Converting VIF {"id": "bb47713e-54a8-4834-a78d-749c5f72f334", "address": "fa:16:3e:34:a4:4f", "network": {"id": "b151d906-14b7-466f-909c-18c6b9f1855d", "bridge": "br-int", "label": "tempest-TestShelveInstance-664463668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71798c25948f4c8cb02664413314a4e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb47713e-54", "ovs_interfaceid": "bb47713e-54a8-4834-a78d-749c5f72f334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:02:36 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:a4:4f,bridge_name='br-int',has_traffic_filtering=True,id=bb47713e-54a8-4834-a78d-749c5f72f334,network=Network(b151d906-14b7-466f-909c-18c6b9f1855d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb47713e-54') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:02:36 user nova-compute[72766]: DEBUG nova.objects.instance [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Lazy-loading 'pci_devices' on Instance uuid 4d919875-5f24-4bed-bf26-cf437e0de3e2 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:02:36 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:02:36 user nova-compute[72766]:   <uuid>4d919875-5f24-4bed-bf26-cf437e0de3e2</uuid>
Aug 14 23:02:36 user nova-compute[72766]:   <name>instance-0000000c</name>
Aug 14 23:02:36 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:02:36 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:02:36 user nova-compute[72766]:   <metadata>
Aug 14 23:02:36 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:02:36 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:02:36 user nova-compute[72766]:       <nova:name>tempest-TestShelveInstance-server-1732259896</nova:name>
Aug 14 23:02:36 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:02:35</nova:creationTime>
Aug 14 23:02:36 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:02:36 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:02:36 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:02:36 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:02:36 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:02:36 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:02:36 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:02:36 user nova-compute[72766]:       <nova:owner>
Aug 14 23:02:36 user nova-compute[72766]:         <nova:user uuid="d46f138a683742b09a91e1f10f085c18">tempest-TestShelveInstance-1305179191-project-member</nova:user>
Aug 14 23:02:36 user nova-compute[72766]:         <nova:project uuid="71798c25948f4c8cb02664413314a4e1">tempest-TestShelveInstance-1305179191</nova:project>
Aug 14 23:02:36 user nova-compute[72766]:       </nova:owner>
Aug 14 23:02:36 user nova-compute[72766]:       <nova:ports>
Aug 14 23:02:36 user nova-compute[72766]:         <nova:port uuid="bb47713e-54a8-4834-a78d-749c5f72f334">
Aug 14 23:02:36 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 23:02:36 user nova-compute[72766]:         </nova:port>
Aug 14 23:02:36 user nova-compute[72766]:       </nova:ports>
Aug 14 23:02:36 user nova-compute[72766]:     </nova:instance>
Aug 14 23:02:36 user nova-compute[72766]:   </metadata>
Aug 14 23:02:36 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:02:36 user nova-compute[72766]:     <system>
Aug 14 23:02:36 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:02:36 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:02:36 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:02:36 user nova-compute[72766]:       <entry name="serial">4d919875-5f24-4bed-bf26-cf437e0de3e2</entry>
Aug 14 23:02:36 user nova-compute[72766]:       <entry name="uuid">4d919875-5f24-4bed-bf26-cf437e0de3e2</entry>
Aug 14 23:02:36 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:02:36 user nova-compute[72766]:     </system>
Aug 14 23:02:36 user nova-compute[72766]:   </sysinfo>
Aug 14 23:02:36 user nova-compute[72766]:   <os>
Aug 14 23:02:36 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:02:36 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:02:36 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:02:36 user nova-compute[72766]:   </os>
Aug 14 23:02:36 user nova-compute[72766]:   <features>
Aug 14 23:02:36 user nova-compute[72766]:     <acpi/>
Aug 14 23:02:36 user nova-compute[72766]:     <apic/>
Aug 14 23:02:36 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:02:36 user nova-compute[72766]:   </features>
Aug 14 23:02:36 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:02:36 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:02:36 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:02:36 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:02:36 user nova-compute[72766]:   </clock>
Aug 14 23:02:36 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:02:36 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:02:36 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:02:36 user nova-compute[72766]:   </cpu>
Aug 14 23:02:36 user nova-compute[72766]:   <devices>
Aug 14 23:02:36 user nova-compute[72766]:     <disk type="block" device="disk">
Aug 14 23:02:36 user nova-compute[72766]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:02:36 user nova-compute[72766]:       <source dev="/dev/sde"/>
Aug 14 23:02:36 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:02:36 user nova-compute[72766]:       <serial>cc05004f-3360-4071-bd51-ce172fb18886</serial>
Aug 14 23:02:36 user nova-compute[72766]:     </disk>
Aug 14 23:02:36 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:02:36 user nova-compute[72766]:       <mac address="fa:16:3e:34:a4:4f"/>
Aug 14 23:02:36 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:02:36 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:02:36 user nova-compute[72766]:       <target dev="tapbb47713e-54"/>
Aug 14 23:02:36 user nova-compute[72766]:     </interface>
Aug 14 23:02:36 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:02:36 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/4d919875-5f24-4bed-bf26-cf437e0de3e2/console.log" append="off"/>
Aug 14 23:02:36 user nova-compute[72766]:     </serial>
Aug 14 23:02:36 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:02:36 user nova-compute[72766]:     <video>
Aug 14 23:02:36 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:02:36 user nova-compute[72766]:     </video>
Aug 14 23:02:36 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:02:36 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:02:36 user nova-compute[72766]:     </rng>
Aug 14 23:02:36 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:02:36 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:02:36 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:02:36 user nova-compute[72766]:     </memballoon>
Aug 14 23:02:36 user nova-compute[72766]:   </devices>
Aug 14 23:02:36 user nova-compute[72766]: </domain>
Aug 14 23:02:36 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:02:36 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T22:58:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1732259896',display_name='tempest-TestShelveInstance-server-1732259896',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1732259896',id=12,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1877498323',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:58:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='71798c25948f4c8cb02664413314a4e1',ramdisk_id='',reservation_id='r-yvm2m86y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1305179191',owner_user_name='tempest-TestShelveInstance-1305179191-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:02:07Z,user_data=None,user_id='d46f138a683742b09a91e1f10f085c18',uuid=4d919875-5f24-4bed-bf26-cf437e0de3e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "bb47713e-54a8-4834-a78d-749c5f72f334", "address": "fa:16:3e:34:a4:4f", "network": {"id": "b151d906-14b7-466f-909c-18c6b9f1855d", "bridge": "br-int", "label": "tempest-TestShelveInstance-664463668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71798c25948f4c8cb02664413314a4e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb47713e-54", "ovs_interfaceid": "bb47713e-54a8-4834-a78d-749c5f72f334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:02:36 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Converting VIF {"id": "bb47713e-54a8-4834-a78d-749c5f72f334", "address": "fa:16:3e:34:a4:4f", "network": {"id": "b151d906-14b7-466f-909c-18c6b9f1855d", "bridge": "br-int", "label": "tempest-TestShelveInstance-664463668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71798c25948f4c8cb02664413314a4e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb47713e-54", "ovs_interfaceid": "bb47713e-54a8-4834-a78d-749c5f72f334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:02:36 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:a4:4f,bridge_name='br-int',has_traffic_filtering=True,id=bb47713e-54a8-4834-a78d-749c5f72f334,network=Network(b151d906-14b7-466f-909c-18c6b9f1855d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb47713e-54') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:02:36 user nova-compute[72766]: DEBUG os_vif [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:a4:4f,bridge_name='br-int',has_traffic_filtering=True,id=bb47713e-54a8-4834-a78d-749c5f72f334,network=Network(b151d906-14b7-466f-909c-18c6b9f1855d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb47713e-54') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:02:36 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:36 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:02:36 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:02:36 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:36 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbb47713e-54, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:02:36 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbb47713e-54, col_values=(('external_ids', {'iface-id': 'bb47713e-54a8-4834-a78d-749c5f72f334', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:a4:4f', 'vm-uuid': '4d919875-5f24-4bed-bf26-cf437e0de3e2'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:02:36 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:36 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:02:36 user nova-compute[72766]: INFO os_vif [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:a4:4f,bridge_name='br-int',has_traffic_filtering=True,id=bb47713e-54a8-4834-a78d-749c5f72f334,network=Network(b151d906-14b7-466f-909c-18c6b9f1855d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb47713e-54')
Aug 14 23:02:36 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:02:36 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] No VIF found with MAC fa:16:3e:34:a4:4f, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:02:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:38 user nova-compute[72766]: DEBUG nova.compute.manager [req-2d6d21ac-2560-4e4a-93a1-e5a3d3530af7 req-92d97925-3ffd-484a-a7d4-2cfb98abc23f service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Received event network-vif-plugged-bb47713e-54a8-4834-a78d-749c5f72f334 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:02:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2d6d21ac-2560-4e4a-93a1-e5a3d3530af7 req-92d97925-3ffd-484a-a7d4-2cfb98abc23f service nova] Acquiring lock "4d919875-5f24-4bed-bf26-cf437e0de3e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:02:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2d6d21ac-2560-4e4a-93a1-e5a3d3530af7 req-92d97925-3ffd-484a-a7d4-2cfb98abc23f service nova] Lock "4d919875-5f24-4bed-bf26-cf437e0de3e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:02:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2d6d21ac-2560-4e4a-93a1-e5a3d3530af7 req-92d97925-3ffd-484a-a7d4-2cfb98abc23f service nova] Lock "4d919875-5f24-4bed-bf26-cf437e0de3e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:02:38 user nova-compute[72766]: DEBUG nova.compute.manager [req-2d6d21ac-2560-4e4a-93a1-e5a3d3530af7 req-92d97925-3ffd-484a-a7d4-2cfb98abc23f service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] No waiting events found dispatching network-vif-plugged-bb47713e-54a8-4834-a78d-749c5f72f334 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:02:38 user nova-compute[72766]: WARNING nova.compute.manager [req-2d6d21ac-2560-4e4a-93a1-e5a3d3530af7 req-92d97925-3ffd-484a-a7d4-2cfb98abc23f service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Received unexpected event network-vif-plugged-bb47713e-54a8-4834-a78d-749c5f72f334 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 14 23:02:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:40 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054160.3394008, 4d919875-5f24-4bed-bf26-cf437e0de3e2 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:02:40 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] VM Resumed (Lifecycle Event)
Aug 14 23:02:40 user nova-compute[72766]: DEBUG nova.compute.manager [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:02:40 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 23:02:40 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Instance spawned successfully.
Aug 14 23:02:40 user nova-compute[72766]: DEBUG nova.compute.manager [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:02:40 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:02:40 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:02:40 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:02:40 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054160.3457606, 4d919875-5f24-4bed-bf26-cf437e0de3e2 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:02:40 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] VM Started (Lifecycle Event)
Aug 14 23:02:40 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:02:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cf6a1f23-8acb-4654-9c9b-349f02859833 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Lock "4d919875-5f24-4bed-bf26-cf437e0de3e2" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 33.717s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:02:40 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:02:40 user nova-compute[72766]: DEBUG nova.compute.manager [req-6d679551-6284-4519-ae7a-a2a5ed4da3c0 req-c4351a26-42a9-49af-b512-552079cf586b service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Received event network-vif-plugged-bb47713e-54a8-4834-a78d-749c5f72f334 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:02:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-6d679551-6284-4519-ae7a-a2a5ed4da3c0 req-c4351a26-42a9-49af-b512-552079cf586b service nova] Acquiring lock "4d919875-5f24-4bed-bf26-cf437e0de3e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:02:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-6d679551-6284-4519-ae7a-a2a5ed4da3c0 req-c4351a26-42a9-49af-b512-552079cf586b service nova] Lock "4d919875-5f24-4bed-bf26-cf437e0de3e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:02:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-6d679551-6284-4519-ae7a-a2a5ed4da3c0 req-c4351a26-42a9-49af-b512-552079cf586b service nova] Lock "4d919875-5f24-4bed-bf26-cf437e0de3e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:02:40 user nova-compute[72766]: DEBUG nova.compute.manager [req-6d679551-6284-4519-ae7a-a2a5ed4da3c0 req-c4351a26-42a9-49af-b512-552079cf586b service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] No waiting events found dispatching network-vif-plugged-bb47713e-54a8-4834-a78d-749c5f72f334 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:02:40 user nova-compute[72766]: WARNING nova.compute.manager [req-6d679551-6284-4519-ae7a-a2a5ed4da3c0 req-c4351a26-42a9-49af-b512-552079cf586b service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Received unexpected event network-vif-plugged-bb47713e-54a8-4834-a78d-749c5f72f334 for instance with vm_state active and task_state None.
Aug 14 23:02:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:42 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692054147.5334177, c02e6fd7-e712-45da-b35b-2fe21675e2f1 => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:02:42 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] VM Stopped (Lifecycle Event)
Aug 14 23:02:42 user nova-compute[72766]: DEBUG nova.compute.manager [None req-67cd9779-c14c-471a-a1bd-3d52e53f357c None None] [instance: c02e6fd7-e712-45da-b35b-2fe21675e2f1] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:02:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-2bc65352-611e-43c6-acad-c75ab6ae47cc tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Acquiring lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:02:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-2bc65352-611e-43c6-acad-c75ab6ae47cc tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:02:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-2bc65352-611e-43c6-acad-c75ab6ae47cc tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Acquiring lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:02:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-2bc65352-611e-43c6-acad-c75ab6ae47cc tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:02:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-2bc65352-611e-43c6-acad-c75ab6ae47cc tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:02:43 user nova-compute[72766]: INFO nova.compute.manager [None req-2bc65352-611e-43c6-acad-c75ab6ae47cc tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Terminating instance
Aug 14 23:02:43 user nova-compute[72766]: DEBUG nova.compute.manager [None req-2bc65352-611e-43c6-acad-c75ab6ae47cc tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:02:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:44 user nova-compute[72766]: DEBUG nova.compute.manager [req-da87fa1e-85bf-48e4-914f-ad79281d4c3e req-8e15cc3b-1df2-4b5a-9bd9-a29ffc152029 service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Received event network-vif-unplugged-baa7e0c2-91d4-4077-8405-abb537475df2 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:02:44 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-da87fa1e-85bf-48e4-914f-ad79281d4c3e req-8e15cc3b-1df2-4b5a-9bd9-a29ffc152029 service nova] Acquiring lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:02:44 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-da87fa1e-85bf-48e4-914f-ad79281d4c3e req-8e15cc3b-1df2-4b5a-9bd9-a29ffc152029 service nova] Lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:02:44 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-da87fa1e-85bf-48e4-914f-ad79281d4c3e req-8e15cc3b-1df2-4b5a-9bd9-a29ffc152029 service nova] Lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:02:44 user nova-compute[72766]: DEBUG nova.compute.manager [req-da87fa1e-85bf-48e4-914f-ad79281d4c3e req-8e15cc3b-1df2-4b5a-9bd9-a29ffc152029 service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] No waiting events found dispatching network-vif-unplugged-baa7e0c2-91d4-4077-8405-abb537475df2 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:02:44 user nova-compute[72766]: DEBUG nova.compute.manager [req-da87fa1e-85bf-48e4-914f-ad79281d4c3e req-8e15cc3b-1df2-4b5a-9bd9-a29ffc152029 service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Received event network-vif-unplugged-baa7e0c2-91d4-4077-8405-abb537475df2 for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:02:44 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Instance destroyed successfully.
Aug 14 23:02:44 user nova-compute[72766]: DEBUG nova.objects.instance [None req-2bc65352-611e-43c6-acad-c75ab6ae47cc tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lazy-loading 'resources' on Instance uuid 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:02:44 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-2bc65352-611e-43c6-acad-c75ab6ae47cc tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:55:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-315419637',display_name='tempest-ServerStableDeviceRescueTest-server-315419637',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-315419637',id=3,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBo4nGfM00D0QCYyQV/cI8aNR3E6ibpD8xD1rxYRn2nwO6hDolWgvqHNcTgNVefuExGkBWELmMo7h+sXUj+Cy6+nJ0NZHfxWlgzBRlgC0eaAYciav7rLbA5/A+RXO8R0rg==',key_name='tempest-keypair-255768832',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:59:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6942d31258304de68c9f7f8bb9304acb',ramdisk_id='',reservation_id='r-ry04k9s6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1332966635',owner_user_name='tempest-ServerStableDeviceRescueTest-1332966635-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:01:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76b70ec93e9c47d7a4c224fb05c52fbf',uuid=87712dfd-d67b-4e5e-a75d-ca2dd7c764b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "baa7e0c2-91d4-4077-8405-abb537475df2", "address": "fa:16:3e:88:35:14", "network": {"id": "aff4f146-97db-4102-abf1-6528e74cad55", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1894452367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6942d31258304de68c9f7f8bb9304acb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa7e0c2-91", "ovs_interfaceid": "baa7e0c2-91d4-4077-8405-abb537475df2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:02:44 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-2bc65352-611e-43c6-acad-c75ab6ae47cc tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Converting VIF {"id": "baa7e0c2-91d4-4077-8405-abb537475df2", "address": "fa:16:3e:88:35:14", "network": {"id": "aff4f146-97db-4102-abf1-6528e74cad55", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1894452367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6942d31258304de68c9f7f8bb9304acb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa7e0c2-91", "ovs_interfaceid": "baa7e0c2-91d4-4077-8405-abb537475df2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:02:44 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-2bc65352-611e-43c6-acad-c75ab6ae47cc tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:35:14,bridge_name='br-int',has_traffic_filtering=True,id=baa7e0c2-91d4-4077-8405-abb537475df2,network=Network(aff4f146-97db-4102-abf1-6528e74cad55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaa7e0c2-91') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:02:44 user nova-compute[72766]: DEBUG os_vif [None req-2bc65352-611e-43c6-acad-c75ab6ae47cc tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:35:14,bridge_name='br-int',has_traffic_filtering=True,id=baa7e0c2-91d4-4077-8405-abb537475df2,network=Network(aff4f146-97db-4102-abf1-6528e74cad55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaa7e0c2-91') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:02:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbaa7e0c2-91, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:02:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:02:44 user nova-compute[72766]: INFO os_vif [None req-2bc65352-611e-43c6-acad-c75ab6ae47cc tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:35:14,bridge_name='br-int',has_traffic_filtering=True,id=baa7e0c2-91d4-4077-8405-abb537475df2,network=Network(aff4f146-97db-4102-abf1-6528e74cad55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaa7e0c2-91')
Aug 14 23:02:44 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-2bc65352-611e-43c6-acad-c75ab6ae47cc tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Deleting instance files /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1_del
Aug 14 23:02:44 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-2bc65352-611e-43c6-acad-c75ab6ae47cc tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Deletion of /opt/stack/data/nova/instances/87712dfd-d67b-4e5e-a75d-ca2dd7c764b1_del complete
Aug 14 23:02:44 user nova-compute[72766]: INFO nova.compute.manager [None req-2bc65352-611e-43c6-acad-c75ab6ae47cc tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 14 23:02:44 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-2bc65352-611e-43c6-acad-c75ab6ae47cc tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:02:44 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:02:44 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:02:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:46 user nova-compute[72766]: DEBUG nova.compute.manager [req-692ab48a-097b-4d69-8a03-7a6a677e853a req-fd0216a2-a72e-4a91-8593-79d46e3898fd service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Received event network-vif-plugged-baa7e0c2-91d4-4077-8405-abb537475df2 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:02:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-692ab48a-097b-4d69-8a03-7a6a677e853a req-fd0216a2-a72e-4a91-8593-79d46e3898fd service nova] Acquiring lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:02:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-692ab48a-097b-4d69-8a03-7a6a677e853a req-fd0216a2-a72e-4a91-8593-79d46e3898fd service nova] Lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:02:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-692ab48a-097b-4d69-8a03-7a6a677e853a req-fd0216a2-a72e-4a91-8593-79d46e3898fd service nova] Lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:02:46 user nova-compute[72766]: DEBUG nova.compute.manager [req-692ab48a-097b-4d69-8a03-7a6a677e853a req-fd0216a2-a72e-4a91-8593-79d46e3898fd service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] No waiting events found dispatching network-vif-plugged-baa7e0c2-91d4-4077-8405-abb537475df2 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:02:46 user nova-compute[72766]: WARNING nova.compute.manager [req-692ab48a-097b-4d69-8a03-7a6a677e853a req-fd0216a2-a72e-4a91-8593-79d46e3898fd service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Received unexpected event network-vif-plugged-baa7e0c2-91d4-4077-8405-abb537475df2 for instance with vm_state active and task_state deleting.
Aug 14 23:02:46 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:02:46 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Took 2.27 seconds to deallocate network for instance.
Aug 14 23:02:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-2bc65352-611e-43c6-acad-c75ab6ae47cc tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:02:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-2bc65352-611e-43c6-acad-c75ab6ae47cc tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:02:47 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-2bc65352-611e-43c6-acad-c75ab6ae47cc tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:02:47 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-2bc65352-611e-43c6-acad-c75ab6ae47cc tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:02:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-2bc65352-611e-43c6-acad-c75ab6ae47cc tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.269s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:02:47 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-2bc65352-611e-43c6-acad-c75ab6ae47cc tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Deleted allocations for instance 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1
Aug 14 23:02:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-2bc65352-611e-43c6-acad-c75ab6ae47cc tempest-ServerStableDeviceRescueTest-1332966635 tempest-ServerStableDeviceRescueTest-1332966635-project-member] Lock "87712dfd-d67b-4e5e-a75d-ca2dd7c764b1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.668s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:02:48 user nova-compute[72766]: DEBUG nova.compute.manager [req-ca6e9a87-818f-4472-b6f7-cbe38c9e432f req-7f15eeac-294a-4f8a-863f-d2e073bb6b50 service nova] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Received event network-vif-deleted-baa7e0c2-91d4-4077-8405-abb537475df2 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:02:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Acquiring lock "c3c0a004-8d70-4253-bf17-b83088e30031" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:02:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "c3c0a004-8d70-4253-bf17-b83088e30031" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:02:57 user nova-compute[72766]: DEBUG nova.objects.instance [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lazy-loading 'flavor' on Instance uuid c3c0a004-8d70-4253-bf17-b83088e30031 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:02:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "c3c0a004-8d70-4253-bf17-b83088e30031" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:02:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Acquiring lock "c3c0a004-8d70-4253-bf17-b83088e30031" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:02:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "c3c0a004-8d70-4253-bf17-b83088e30031" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:02:58 user nova-compute[72766]: INFO nova.compute.manager [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Attaching volume fa3c071e-9bb3-43dc-b694-1691d2e5a442 to /dev/vdb
Aug 14 23:02:58 user nova-compute[72766]: DEBUG os_brick.utils [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:02:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:58 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8367a99-0398-4133-82bb-d43a79a322f9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:58 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[5527a125-d65f-479b-8aa8-306bb57a530e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:02:58 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[196b97e3-18c3-4a29-a48d-6e08d39a4c56]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:58 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a1d193-446c-4e7a-b53e-64c1d21edf1b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:02:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 23:02:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:02:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:02:58 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 23:02:58 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c834638d-8908-4adf-b63f-d927241bbd11]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:02:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 23:02:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 23:02:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 23:02:58 user nova-compute[72766]: DEBUG os_brick.utils [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:02:58 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Updating existing volume attachment record: f6173565-ed24-4ba6-8107-6d24d47c99fa {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 23:02:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:59 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692054164.4536803, 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1 => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:02:59 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] VM Stopped (Lifecycle Event)
Aug 14 23:02:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:02:59 user nova-compute[72766]: DEBUG nova.compute.manager [None req-b76c9a80-24f2-4a98-bc65-7c4ea2333dcf None None] [instance: 87712dfd-d67b-4e5e-a75d-ca2dd7c764b1] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:02:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:02 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "cbcf7851-e6f7-4f46-97cc-d773286ccddf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "cbcf7851-e6f7-4f46-97cc-d773286ccddf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:02 user nova-compute[72766]: DEBUG nova.compute.manager [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 23:03:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:03 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 23:03:03 user nova-compute[72766]: INFO nova.compute.claims [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Claim successful on node user
Aug 14 23:03:03 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:03:03 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:03:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.402s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:03 user nova-compute[72766]: DEBUG nova.compute.manager [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 23:03:03 user nova-compute[72766]: DEBUG nova.compute.manager [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 23:03:03 user nova-compute[72766]: DEBUG nova.network.neutron [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 23:03:03 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 23:03:03 user nova-compute[72766]: DEBUG nova.compute.manager [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 23:03:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:03 user nova-compute[72766]: DEBUG nova.compute.manager [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 23:03:03 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 23:03:03 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Creating image(s)
Aug 14 23:03:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "/opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "/opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "/opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:03 user nova-compute[72766]: DEBUG nova.policy [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11bf21631dd0447f8f1a3f2b012ec43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b0d4f038dbd47b1aad9829f19cb4896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 23:03:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.337s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.214s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk 1073741824 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk 1073741824" returned: 0 in 0.060s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.203s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:04 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk. size=1073741824 {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 23:03:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Acquiring lock "4f7a13a8-6ac1-4b19-8c5c-f54406790f58" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Lock "4f7a13a8-6ac1-4b19-8c5c-f54406790f58" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:04 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Cannot resize image /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk to a smaller size. {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 23:03:04 user nova-compute[72766]: DEBUG nova.objects.instance [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lazy-loading 'migration_context' on Instance uuid cbcf7851-e6f7-4f46-97cc-d773286ccddf {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:03:04 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 23:03:04 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Ensure instance console log exists: /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 23:03:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:04 user nova-compute[72766]: DEBUG nova.compute.manager [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 23:03:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:05 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 23:03:05 user nova-compute[72766]: INFO nova.compute.claims [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Claim successful on node user
Aug 14 23:03:05 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:03:05 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:03:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.499s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:05 user nova-compute[72766]: DEBUG nova.compute.manager [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 23:03:05 user nova-compute[72766]: DEBUG nova.compute.manager [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 23:03:05 user nova-compute[72766]: DEBUG nova.network.neutron [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 23:03:05 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 23:03:05 user nova-compute[72766]: DEBUG nova.compute.manager [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 23:03:05 user nova-compute[72766]: DEBUG nova.policy [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f127c1a39bb4606b5299ae048d62890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83eb682791ee4b4b9d0637f33e1ce2b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 23:03:05 user nova-compute[72766]: DEBUG nova.compute.manager [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 23:03:05 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 23:03:05 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Creating image(s)
Aug 14 23:03:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Acquiring lock "/opt/stack/data/nova/instances/4f7a13a8-6ac1-4b19-8c5c-f54406790f58/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Lock "/opt/stack/data/nova/instances/4f7a13a8-6ac1-4b19-8c5c-f54406790f58/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Lock "/opt/stack/data/nova/instances/4f7a13a8-6ac1-4b19-8c5c-f54406790f58/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.237s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Acquiring lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:06 user nova-compute[72766]: DEBUG nova.network.neutron [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Successfully created port: 8f65f8f0-60fe-4fdb-af66-424a85b12caf {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 23:03:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.261s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/4f7a13a8-6ac1-4b19-8c5c-f54406790f58/disk 1073741824 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/4f7a13a8-6ac1-4b19-8c5c-f54406790f58/disk 1073741824" returned: 0 in 0.066s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.333s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:06 user nova-compute[72766]: DEBUG nova.network.neutron [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Successfully created port: b702ab41-e9af-4548-a80f-c68f90220afb {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 23:03:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.209s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:06 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4f7a13a8-6ac1-4b19-8c5c-f54406790f58/disk. size=1073741824 {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 23:03:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f7a13a8-6ac1-4b19-8c5c-f54406790f58/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f7a13a8-6ac1-4b19-8c5c-f54406790f58/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:06 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Cannot resize image /opt/stack/data/nova/instances/4f7a13a8-6ac1-4b19-8c5c-f54406790f58/disk to a smaller size. {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 23:03:06 user nova-compute[72766]: DEBUG nova.objects.instance [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Lazy-loading 'migration_context' on Instance uuid 4f7a13a8-6ac1-4b19-8c5c-f54406790f58 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:03:06 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 23:03:06 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Ensure instance console log exists: /opt/stack/data/nova/instances/4f7a13a8-6ac1-4b19-8c5c-f54406790f58/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 23:03:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:07 user nova-compute[72766]: DEBUG nova.network.neutron [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Successfully updated port: b702ab41-e9af-4548-a80f-c68f90220afb {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 23:03:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Acquiring lock "refresh_cache-4f7a13a8-6ac1-4b19-8c5c-f54406790f58" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:03:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Acquired lock "refresh_cache-4f7a13a8-6ac1-4b19-8c5c-f54406790f58" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:03:07 user nova-compute[72766]: DEBUG nova.network.neutron [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:03:07 user nova-compute[72766]: DEBUG nova.compute.manager [req-ef547db7-d524-43a4-b8a1-7e4ddb3f8555 req-41cd505c-057c-41b3-bbe0-83d04a47a19e service nova] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Received event network-changed-b702ab41-e9af-4548-a80f-c68f90220afb {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:03:07 user nova-compute[72766]: DEBUG nova.compute.manager [req-ef547db7-d524-43a4-b8a1-7e4ddb3f8555 req-41cd505c-057c-41b3-bbe0-83d04a47a19e service nova] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Refreshing instance network info cache due to event network-changed-b702ab41-e9af-4548-a80f-c68f90220afb. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:03:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ef547db7-d524-43a4-b8a1-7e4ddb3f8555 req-41cd505c-057c-41b3-bbe0-83d04a47a19e service nova] Acquiring lock "refresh_cache-4f7a13a8-6ac1-4b19-8c5c-f54406790f58" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:03:07 user nova-compute[72766]: DEBUG nova.network.neutron [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.network.neutron [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Updating instance_info_cache with network_info: [{"id": "b702ab41-e9af-4548-a80f-c68f90220afb", "address": "fa:16:3e:31:4f:b7", "network": {"id": "ba73a346-5f7e-4749-9757-4965ccb4be6f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-537717022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83eb682791ee4b4b9d0637f33e1ce2b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb702ab41-e9", "ovs_interfaceid": "b702ab41-e9af-4548-a80f-c68f90220afb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Releasing lock "refresh_cache-4f7a13a8-6ac1-4b19-8c5c-f54406790f58" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.compute.manager [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Instance network_info: |[{"id": "b702ab41-e9af-4548-a80f-c68f90220afb", "address": "fa:16:3e:31:4f:b7", "network": {"id": "ba73a346-5f7e-4749-9757-4965ccb4be6f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-537717022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83eb682791ee4b4b9d0637f33e1ce2b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb702ab41-e9", "ovs_interfaceid": "b702ab41-e9af-4548-a80f-c68f90220afb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ef547db7-d524-43a4-b8a1-7e4ddb3f8555 req-41cd505c-057c-41b3-bbe0-83d04a47a19e service nova] Acquired lock "refresh_cache-4f7a13a8-6ac1-4b19-8c5c-f54406790f58" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.network.neutron [req-ef547db7-d524-43a4-b8a1-7e4ddb3f8555 req-41cd505c-057c-41b3-bbe0-83d04a47a19e service nova] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Refreshing network info cache for port b702ab41-e9af-4548-a80f-c68f90220afb {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Start _get_guest_xml network_info=[{"id": "b702ab41-e9af-4548-a80f-c68f90220afb", "address": "fa:16:3e:31:4f:b7", "network": {"id": "ba73a346-5f7e-4749-9757-4965ccb4be6f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-537717022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83eb682791ee4b4b9d0637f33e1ce2b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb702ab41-e9", "ovs_interfaceid": "b702ab41-e9af-4548-a80f-c68f90220afb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd2900d30-2c4c-4d57-9135-d45564c0c596'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:03:08 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:03:08 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:03:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1371071889',display_name='tempest-VolumesActionsTest-instance-1371071889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1371071889',id=20,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83eb682791ee4b4b9d0637f33e1ce2b3',ramdisk_id='',reservation_id='r-wi3efbrp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-562398048',owner_user_name='tempest-VolumesActionsTest-562398048-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:03:06Z,user_data=None,user_id='0f127c1a39bb4606b5299ae048d62890',uuid=4f7a13a8-6ac1-4b19-8c5c-f54406790f58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b702ab41-e9af-4548-a80f-c68f90220afb", "address": "fa:16:3e:31:4f:b7", "network": {"id": "ba73a346-5f7e-4749-9757-4965ccb4be6f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-537717022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83eb682791ee4b4b9d0637f33e1ce2b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb702ab41-e9", "ovs_interfaceid": "b702ab41-e9af-4548-a80f-c68f90220afb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Converting VIF {"id": "b702ab41-e9af-4548-a80f-c68f90220afb", "address": "fa:16:3e:31:4f:b7", "network": {"id": "ba73a346-5f7e-4749-9757-4965ccb4be6f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-537717022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83eb682791ee4b4b9d0637f33e1ce2b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb702ab41-e9", "ovs_interfaceid": "b702ab41-e9af-4548-a80f-c68f90220afb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:4f:b7,bridge_name='br-int',has_traffic_filtering=True,id=b702ab41-e9af-4548-a80f-c68f90220afb,network=Network(ba73a346-5f7e-4749-9757-4965ccb4be6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb702ab41-e9') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.objects.instance [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f7a13a8-6ac1-4b19-8c5c-f54406790f58 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:03:08 user nova-compute[72766]:   <uuid>4f7a13a8-6ac1-4b19-8c5c-f54406790f58</uuid>
Aug 14 23:03:08 user nova-compute[72766]:   <name>instance-00000014</name>
Aug 14 23:03:08 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:03:08 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:03:08 user nova-compute[72766]:   <metadata>
Aug 14 23:03:08 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:03:08 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:03:08 user nova-compute[72766]:       <nova:name>tempest-VolumesActionsTest-instance-1371071889</nova:name>
Aug 14 23:03:08 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:03:08</nova:creationTime>
Aug 14 23:03:08 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:03:08 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:03:08 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:03:08 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:03:08 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:03:08 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:03:08 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:03:08 user nova-compute[72766]:       <nova:owner>
Aug 14 23:03:08 user nova-compute[72766]:         <nova:user uuid="0f127c1a39bb4606b5299ae048d62890">tempest-VolumesActionsTest-562398048-project-member</nova:user>
Aug 14 23:03:08 user nova-compute[72766]:         <nova:project uuid="83eb682791ee4b4b9d0637f33e1ce2b3">tempest-VolumesActionsTest-562398048</nova:project>
Aug 14 23:03:08 user nova-compute[72766]:       </nova:owner>
Aug 14 23:03:08 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 23:03:08 user nova-compute[72766]:       <nova:ports>
Aug 14 23:03:08 user nova-compute[72766]:         <nova:port uuid="b702ab41-e9af-4548-a80f-c68f90220afb">
Aug 14 23:03:08 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 23:03:08 user nova-compute[72766]:         </nova:port>
Aug 14 23:03:08 user nova-compute[72766]:       </nova:ports>
Aug 14 23:03:08 user nova-compute[72766]:     </nova:instance>
Aug 14 23:03:08 user nova-compute[72766]:   </metadata>
Aug 14 23:03:08 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:03:08 user nova-compute[72766]:     <system>
Aug 14 23:03:08 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:03:08 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:03:08 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:03:08 user nova-compute[72766]:       <entry name="serial">4f7a13a8-6ac1-4b19-8c5c-f54406790f58</entry>
Aug 14 23:03:08 user nova-compute[72766]:       <entry name="uuid">4f7a13a8-6ac1-4b19-8c5c-f54406790f58</entry>
Aug 14 23:03:08 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:03:08 user nova-compute[72766]:     </system>
Aug 14 23:03:08 user nova-compute[72766]:   </sysinfo>
Aug 14 23:03:08 user nova-compute[72766]:   <os>
Aug 14 23:03:08 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:03:08 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:03:08 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:03:08 user nova-compute[72766]:   </os>
Aug 14 23:03:08 user nova-compute[72766]:   <features>
Aug 14 23:03:08 user nova-compute[72766]:     <acpi/>
Aug 14 23:03:08 user nova-compute[72766]:     <apic/>
Aug 14 23:03:08 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:03:08 user nova-compute[72766]:   </features>
Aug 14 23:03:08 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:03:08 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:03:08 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:03:08 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:03:08 user nova-compute[72766]:   </clock>
Aug 14 23:03:08 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:03:08 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:03:08 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:03:08 user nova-compute[72766]:   </cpu>
Aug 14 23:03:08 user nova-compute[72766]:   <devices>
Aug 14 23:03:08 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 23:03:08 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 23:03:08 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/4f7a13a8-6ac1-4b19-8c5c-f54406790f58/disk"/>
Aug 14 23:03:08 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:03:08 user nova-compute[72766]:     </disk>
Aug 14 23:03:08 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:03:08 user nova-compute[72766]:       <mac address="fa:16:3e:31:4f:b7"/>
Aug 14 23:03:08 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:03:08 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:03:08 user nova-compute[72766]:       <target dev="tapb702ab41-e9"/>
Aug 14 23:03:08 user nova-compute[72766]:     </interface>
Aug 14 23:03:08 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:03:08 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/4f7a13a8-6ac1-4b19-8c5c-f54406790f58/console.log" append="off"/>
Aug 14 23:03:08 user nova-compute[72766]:     </serial>
Aug 14 23:03:08 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:03:08 user nova-compute[72766]:     <video>
Aug 14 23:03:08 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:03:08 user nova-compute[72766]:     </video>
Aug 14 23:03:08 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:03:08 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:03:08 user nova-compute[72766]:     </rng>
Aug 14 23:03:08 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:03:08 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:03:08 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:03:08 user nova-compute[72766]:     </memballoon>
Aug 14 23:03:08 user nova-compute[72766]:   </devices>
Aug 14 23:03:08 user nova-compute[72766]: </domain>
Aug 14 23:03:08 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:03:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1371071889',display_name='tempest-VolumesActionsTest-instance-1371071889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1371071889',id=20,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83eb682791ee4b4b9d0637f33e1ce2b3',ramdisk_id='',reservation_id='r-wi3efbrp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-562398048',owner_user_name='tempest-VolumesActionsTest-562398048-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:03:06Z,user_data=None,user_id='0f127c1a39bb4606b5299ae048d62890',uuid=4f7a13a8-6ac1-4b19-8c5c-f54406790f58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b702ab41-e9af-4548-a80f-c68f90220afb", "address": "fa:16:3e:31:4f:b7", "network": {"id": "ba73a346-5f7e-4749-9757-4965ccb4be6f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-537717022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83eb682791ee4b4b9d0637f33e1ce2b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb702ab41-e9", "ovs_interfaceid": "b702ab41-e9af-4548-a80f-c68f90220afb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Converting VIF {"id": "b702ab41-e9af-4548-a80f-c68f90220afb", "address": "fa:16:3e:31:4f:b7", "network": {"id": "ba73a346-5f7e-4749-9757-4965ccb4be6f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-537717022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83eb682791ee4b4b9d0637f33e1ce2b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb702ab41-e9", "ovs_interfaceid": "b702ab41-e9af-4548-a80f-c68f90220afb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:4f:b7,bridge_name='br-int',has_traffic_filtering=True,id=b702ab41-e9af-4548-a80f-c68f90220afb,network=Network(ba73a346-5f7e-4749-9757-4965ccb4be6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb702ab41-e9') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG os_vif [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:4f:b7,bridge_name='br-int',has_traffic_filtering=True,id=b702ab41-e9af-4548-a80f-c68f90220afb,network=Network(ba73a346-5f7e-4749-9757-4965ccb4be6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb702ab41-e9') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb702ab41-e9, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb702ab41-e9, col_values=(('external_ids', {'iface-id': 'b702ab41-e9af-4548-a80f-c68f90220afb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:4f:b7', 'vm-uuid': '4f7a13a8-6ac1-4b19-8c5c-f54406790f58'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:08 user nova-compute[72766]: INFO os_vif [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:4f:b7,bridge_name='br-int',has_traffic_filtering=True,id=b702ab41-e9af-4548-a80f-c68f90220afb,network=Network(ba73a346-5f7e-4749-9757-4965ccb4be6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb702ab41-e9')
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.network.neutron [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Successfully updated port: 8f65f8f0-60fe-4fdb-af66-424a85b12caf {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "refresh_cache-cbcf7851-e6f7-4f46-97cc-d773286ccddf" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquired lock "refresh_cache-cbcf7851-e6f7-4f46-97cc-d773286ccddf" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.network.neutron [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.compute.manager [req-061ad3d2-caa2-4fb4-8dbd-395d1f723a82 req-109e0738-7018-46b2-b8a1-59f8f4f397a3 service nova] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Received event network-changed-8f65f8f0-60fe-4fdb-af66-424a85b12caf {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.compute.manager [req-061ad3d2-caa2-4fb4-8dbd-395d1f723a82 req-109e0738-7018-46b2-b8a1-59f8f4f397a3 service nova] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Refreshing instance network info cache due to event network-changed-8f65f8f0-60fe-4fdb-af66-424a85b12caf. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-061ad3d2-caa2-4fb4-8dbd-395d1f723a82 req-109e0738-7018-46b2-b8a1-59f8f4f397a3 service nova] Acquiring lock "refresh_cache-cbcf7851-e6f7-4f46-97cc-d773286ccddf" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] No VIF found with MAC fa:16:3e:31:4f:b7, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.network.neutron [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.network.neutron [req-ef547db7-d524-43a4-b8a1-7e4ddb3f8555 req-41cd505c-057c-41b3-bbe0-83d04a47a19e service nova] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Updated VIF entry in instance network info cache for port b702ab41-e9af-4548-a80f-c68f90220afb. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.network.neutron [req-ef547db7-d524-43a4-b8a1-7e4ddb3f8555 req-41cd505c-057c-41b3-bbe0-83d04a47a19e service nova] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Updating instance_info_cache with network_info: [{"id": "b702ab41-e9af-4548-a80f-c68f90220afb", "address": "fa:16:3e:31:4f:b7", "network": {"id": "ba73a346-5f7e-4749-9757-4965ccb4be6f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-537717022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83eb682791ee4b4b9d0637f33e1ce2b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb702ab41-e9", "ovs_interfaceid": "b702ab41-e9af-4548-a80f-c68f90220afb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.network.neutron [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Updating instance_info_cache with network_info: [{"id": "8f65f8f0-60fe-4fdb-af66-424a85b12caf", "address": "fa:16:3e:70:30:66", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f65f8f0-60", "ovs_interfaceid": "8f65f8f0-60fe-4fdb-af66-424a85b12caf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ef547db7-d524-43a4-b8a1-7e4ddb3f8555 req-41cd505c-057c-41b3-bbe0-83d04a47a19e service nova] Releasing lock "refresh_cache-4f7a13a8-6ac1-4b19-8c5c-f54406790f58" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Releasing lock "refresh_cache-cbcf7851-e6f7-4f46-97cc-d773286ccddf" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.compute.manager [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Instance network_info: |[{"id": "8f65f8f0-60fe-4fdb-af66-424a85b12caf", "address": "fa:16:3e:70:30:66", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f65f8f0-60", "ovs_interfaceid": "8f65f8f0-60fe-4fdb-af66-424a85b12caf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-061ad3d2-caa2-4fb4-8dbd-395d1f723a82 req-109e0738-7018-46b2-b8a1-59f8f4f397a3 service nova] Acquired lock "refresh_cache-cbcf7851-e6f7-4f46-97cc-d773286ccddf" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.network.neutron [req-061ad3d2-caa2-4fb4-8dbd-395d1f723a82 req-109e0738-7018-46b2-b8a1-59f8f4f397a3 service nova] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Refreshing network info cache for port 8f65f8f0-60fe-4fdb-af66-424a85b12caf {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Start _get_guest_xml network_info=[{"id": "8f65f8f0-60fe-4fdb-af66-424a85b12caf", "address": "fa:16:3e:70:30:66", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f65f8f0-60", "ovs_interfaceid": "8f65f8f0-60fe-4fdb-af66-424a85b12caf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd2900d30-2c4c-4d57-9135-d45564c0c596'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:03:08 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:03:08 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:03:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-412394783',display_name='tempest-ServerActionsTestOtherA-server-412394783',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-412394783',id=19,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDoXZolQqtFAUPpymn6Ku7JgXGw46vxp59imOajNHAEz0LQOA2HZ029jKc7yJ8uxT7IHJ390d7ScJ6pqdFfhcnBy/F6i10LDXWERfUkUg5mrEOI4hiQbJjkhq6PVnEbSQ==',key_name='tempest-keypair-1635999225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b0d4f038dbd47b1aad9829f19cb4896',ramdisk_id='',reservation_id='r-htpz13qh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-242565278',owner_user_name='tempest-ServerActionsTestOtherA-242565278-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:03:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11bf21631dd0447f8f1a3f2b012ec43a',uuid=cbcf7851-e6f7-4f46-97cc-d773286ccddf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f65f8f0-60fe-4fdb-af66-424a85b12caf", "address": "fa:16:3e:70:30:66", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f65f8f0-60", "ovs_interfaceid": "8f65f8f0-60fe-4fdb-af66-424a85b12caf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Converting VIF {"id": "8f65f8f0-60fe-4fdb-af66-424a85b12caf", "address": "fa:16:3e:70:30:66", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f65f8f0-60", "ovs_interfaceid": "8f65f8f0-60fe-4fdb-af66-424a85b12caf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:30:66,bridge_name='br-int',has_traffic_filtering=True,id=8f65f8f0-60fe-4fdb-af66-424a85b12caf,network=Network(e0bbc182-f700-4a82-84ae-7cbcb2e517c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f65f8f0-60') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.objects.instance [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lazy-loading 'pci_devices' on Instance uuid cbcf7851-e6f7-4f46-97cc-d773286ccddf {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:03:08 user nova-compute[72766]:   <uuid>cbcf7851-e6f7-4f46-97cc-d773286ccddf</uuid>
Aug 14 23:03:08 user nova-compute[72766]:   <name>instance-00000013</name>
Aug 14 23:03:08 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:03:08 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:03:08 user nova-compute[72766]:   <metadata>
Aug 14 23:03:08 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:03:08 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:03:08 user nova-compute[72766]:       <nova:name>tempest-ServerActionsTestOtherA-server-412394783</nova:name>
Aug 14 23:03:08 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:03:08</nova:creationTime>
Aug 14 23:03:08 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:03:08 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:03:08 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:03:08 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:03:08 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:03:08 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:03:08 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:03:08 user nova-compute[72766]:       <nova:owner>
Aug 14 23:03:08 user nova-compute[72766]:         <nova:user uuid="11bf21631dd0447f8f1a3f2b012ec43a">tempest-ServerActionsTestOtherA-242565278-project-member</nova:user>
Aug 14 23:03:08 user nova-compute[72766]:         <nova:project uuid="7b0d4f038dbd47b1aad9829f19cb4896">tempest-ServerActionsTestOtherA-242565278</nova:project>
Aug 14 23:03:08 user nova-compute[72766]:       </nova:owner>
Aug 14 23:03:08 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 23:03:08 user nova-compute[72766]:       <nova:ports>
Aug 14 23:03:08 user nova-compute[72766]:         <nova:port uuid="8f65f8f0-60fe-4fdb-af66-424a85b12caf">
Aug 14 23:03:08 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 23:03:08 user nova-compute[72766]:         </nova:port>
Aug 14 23:03:08 user nova-compute[72766]:       </nova:ports>
Aug 14 23:03:08 user nova-compute[72766]:     </nova:instance>
Aug 14 23:03:08 user nova-compute[72766]:   </metadata>
Aug 14 23:03:08 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:03:08 user nova-compute[72766]:     <system>
Aug 14 23:03:08 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:03:08 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:03:08 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:03:08 user nova-compute[72766]:       <entry name="serial">cbcf7851-e6f7-4f46-97cc-d773286ccddf</entry>
Aug 14 23:03:08 user nova-compute[72766]:       <entry name="uuid">cbcf7851-e6f7-4f46-97cc-d773286ccddf</entry>
Aug 14 23:03:08 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:03:08 user nova-compute[72766]:     </system>
Aug 14 23:03:08 user nova-compute[72766]:   </sysinfo>
Aug 14 23:03:08 user nova-compute[72766]:   <os>
Aug 14 23:03:08 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:03:08 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:03:08 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:03:08 user nova-compute[72766]:   </os>
Aug 14 23:03:08 user nova-compute[72766]:   <features>
Aug 14 23:03:08 user nova-compute[72766]:     <acpi/>
Aug 14 23:03:08 user nova-compute[72766]:     <apic/>
Aug 14 23:03:08 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:03:08 user nova-compute[72766]:   </features>
Aug 14 23:03:08 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:03:08 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:03:08 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:03:08 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:03:08 user nova-compute[72766]:   </clock>
Aug 14 23:03:08 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:03:08 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:03:08 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:03:08 user nova-compute[72766]:   </cpu>
Aug 14 23:03:08 user nova-compute[72766]:   <devices>
Aug 14 23:03:08 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 23:03:08 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 23:03:08 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk"/>
Aug 14 23:03:08 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:03:08 user nova-compute[72766]:     </disk>
Aug 14 23:03:08 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:03:08 user nova-compute[72766]:       <mac address="fa:16:3e:70:30:66"/>
Aug 14 23:03:08 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:03:08 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:03:08 user nova-compute[72766]:       <target dev="tap8f65f8f0-60"/>
Aug 14 23:03:08 user nova-compute[72766]:     </interface>
Aug 14 23:03:08 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:03:08 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/console.log" append="off"/>
Aug 14 23:03:08 user nova-compute[72766]:     </serial>
Aug 14 23:03:08 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:03:08 user nova-compute[72766]:     <video>
Aug 14 23:03:08 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:03:08 user nova-compute[72766]:     </video>
Aug 14 23:03:08 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:03:08 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:03:08 user nova-compute[72766]:     </rng>
Aug 14 23:03:08 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:03:08 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:03:08 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:03:08 user nova-compute[72766]:     </memballoon>
Aug 14 23:03:08 user nova-compute[72766]:   </devices>
Aug 14 23:03:08 user nova-compute[72766]: </domain>
Aug 14 23:03:08 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:03:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-412394783',display_name='tempest-ServerActionsTestOtherA-server-412394783',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-412394783',id=19,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDoXZolQqtFAUPpymn6Ku7JgXGw46vxp59imOajNHAEz0LQOA2HZ029jKc7yJ8uxT7IHJ390d7ScJ6pqdFfhcnBy/F6i10LDXWERfUkUg5mrEOI4hiQbJjkhq6PVnEbSQ==',key_name='tempest-keypair-1635999225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b0d4f038dbd47b1aad9829f19cb4896',ramdisk_id='',reservation_id='r-htpz13qh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-242565278',owner_user_name='tempest-ServerActionsTestOtherA-242565278-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:03:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11bf21631dd0447f8f1a3f2b012ec43a',uuid=cbcf7851-e6f7-4f46-97cc-d773286ccddf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f65f8f0-60fe-4fdb-af66-424a85b12caf", "address": "fa:16:3e:70:30:66", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f65f8f0-60", "ovs_interfaceid": "8f65f8f0-60fe-4fdb-af66-424a85b12caf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Converting VIF {"id": "8f65f8f0-60fe-4fdb-af66-424a85b12caf", "address": "fa:16:3e:70:30:66", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f65f8f0-60", "ovs_interfaceid": "8f65f8f0-60fe-4fdb-af66-424a85b12caf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:30:66,bridge_name='br-int',has_traffic_filtering=True,id=8f65f8f0-60fe-4fdb-af66-424a85b12caf,network=Network(e0bbc182-f700-4a82-84ae-7cbcb2e517c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f65f8f0-60') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG os_vif [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:30:66,bridge_name='br-int',has_traffic_filtering=True,id=8f65f8f0-60fe-4fdb-af66-424a85b12caf,network=Network(e0bbc182-f700-4a82-84ae-7cbcb2e517c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f65f8f0-60') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f65f8f0-60, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8f65f8f0-60, col_values=(('external_ids', {'iface-id': '8f65f8f0-60fe-4fdb-af66-424a85b12caf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:30:66', 'vm-uuid': 'cbcf7851-e6f7-4f46-97cc-d773286ccddf'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:08 user nova-compute[72766]: INFO os_vif [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:30:66,bridge_name='br-int',has_traffic_filtering=True,id=8f65f8f0-60fe-4fdb-af66-424a85b12caf,network=Network(e0bbc182-f700-4a82-84ae-7cbcb2e517c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f65f8f0-60')
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:03:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] No VIF found with MAC fa:16:3e:70:30:66, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG nova.network.neutron [req-061ad3d2-caa2-4fb4-8dbd-395d1f723a82 req-109e0738-7018-46b2-b8a1-59f8f4f397a3 service nova] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Updated VIF entry in instance network info cache for port 8f65f8f0-60fe-4fdb-af66-424a85b12caf. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG nova.network.neutron [req-061ad3d2-caa2-4fb4-8dbd-395d1f723a82 req-109e0738-7018-46b2-b8a1-59f8f4f397a3 service nova] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Updating instance_info_cache with network_info: [{"id": "8f65f8f0-60fe-4fdb-af66-424a85b12caf", "address": "fa:16:3e:70:30:66", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f65f8f0-60", "ovs_interfaceid": "8f65f8f0-60fe-4fdb-af66-424a85b12caf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-061ad3d2-caa2-4fb4-8dbd-395d1f723a82 req-109e0738-7018-46b2-b8a1-59f8f4f397a3 service nova] Releasing lock "refresh_cache-cbcf7851-e6f7-4f46-97cc-d773286ccddf" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LNToxRfs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:03:09 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:03:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:03:09 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:03:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:03:09 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 23:03:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442 -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd81980-14d8-4fb3-9eaa-0fd510b65f65]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 23:03:09 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442 -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[54121693-aacb-49c5-8c66-56e3afb666af]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442] added
Aug 14 23:03:09 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fe3185-597e-44e4-9a9a-7ef9c65f66e6]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[652b4d72-1171-478c-a83b-add4f465a90a]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LNToxRfs {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LNToxRfs" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d847d94-bcc7-4e1b-9de7-b2917517b9ed]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LNToxRfs'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[0659e445-16d1-4f6b-a920-8d61f374b468]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c82f5e-0dfa-4725-8a99-06f3c6420fc5]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)
Aug 14 23:03:09 user nova-compute[72766]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 (non-flash)
Aug 14 23:03:09 user nova-compute[72766]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 (non-flash)
Aug 14 23:03:09 user nova-compute[72766]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 23:03:09 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)
Aug 14 23:03:09 user nova-compute[72766]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 (non-flash)
Aug 14 23:03:09 user nova-compute[72766]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 (non-flash)
Aug 14 23:03:09 user nova-compute[72766]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 23:03:09 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442 -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ab52f1-deb5-4701-bb65-76227d3b2746]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442, portal: 172.16.0.220,3260]
Aug 14 23:03:09 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442, portal: 172.16.0.220,3260] successful.
Aug 14 23:03:09 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8354affb-66fd-495e-aaa3-cc60d6a7596c]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[6098849b-9638-42b6-9325-082a8ba39cbd]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)
Aug 14 23:03:09 user nova-compute[72766]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 (non-flash)
Aug 14 23:03:09 user nova-compute[72766]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 (non-flash)
Aug 14 23:03:09 user nova-compute[72766]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 23:03:09 user nova-compute[72766]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442 (non-flash)
Aug 14 23:03:09 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)
Aug 14 23:03:09 user nova-compute[72766]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 (non-flash)
Aug 14 23:03:09 user nova-compute[72766]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 (non-flash)
Aug 14 23:03:09 user nova-compute[72766]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 23:03:09 user nova-compute[72766]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442 (non-flash)
Aug 14 23:03:09 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] HCTL ('37', '-', '-', 0) found on session 26 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e336b4-971a-4d58-b677-3339c720966f]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Searching for a device in session 26 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:03:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LNToxRfs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 23:03:10 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:03:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '26664633138336630', 'path': '/dev/sdf'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:03:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664633138336630', 'path': '/dev/sdf'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 23:03:10 user nova-compute[72766]: DEBUG nova.objects.instance [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lazy-loading 'flavor' on Instance uuid c3c0a004-8d70-4253-bf17-b83088e30031 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:03:10 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 23:03:10 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:03:10 user nova-compute[72766]:   <source dev="/dev/sdf"/>
Aug 14 23:03:10 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:03:10 user nova-compute[72766]:   <serial>fa3c071e-9bb3-43dc-b694-1691d2e5a442</serial>
Aug 14 23:03:10 user nova-compute[72766]: </disk>
Aug 14 23:03:10 user nova-compute[72766]:  {{(pid=72766) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 23:03:10 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:10 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:10 user nova-compute[72766]: DEBUG nova.compute.manager [req-a0fac35a-b726-4874-8986-f50a2dad7767 req-7ee8a050-6cf5-4865-a3f3-719068ad4cd3 service nova] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Received event network-vif-plugged-b702ab41-e9af-4548-a80f-c68f90220afb {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:03:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a0fac35a-b726-4874-8986-f50a2dad7767 req-7ee8a050-6cf5-4865-a3f3-719068ad4cd3 service nova] Acquiring lock "4f7a13a8-6ac1-4b19-8c5c-f54406790f58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a0fac35a-b726-4874-8986-f50a2dad7767 req-7ee8a050-6cf5-4865-a3f3-719068ad4cd3 service nova] Lock "4f7a13a8-6ac1-4b19-8c5c-f54406790f58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a0fac35a-b726-4874-8986-f50a2dad7767 req-7ee8a050-6cf5-4865-a3f3-719068ad4cd3 service nova] Lock "4f7a13a8-6ac1-4b19-8c5c-f54406790f58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:10 user nova-compute[72766]: DEBUG nova.compute.manager [req-a0fac35a-b726-4874-8986-f50a2dad7767 req-7ee8a050-6cf5-4865-a3f3-719068ad4cd3 service nova] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] No waiting events found dispatching network-vif-plugged-b702ab41-e9af-4548-a80f-c68f90220afb {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:03:10 user nova-compute[72766]: WARNING nova.compute.manager [req-a0fac35a-b726-4874-8986-f50a2dad7767 req-7ee8a050-6cf5-4865-a3f3-719068ad4cd3 service nova] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Received unexpected event network-vif-plugged-b702ab41-e9af-4548-a80f-c68f90220afb for instance with vm_state building and task_state spawning.
Aug 14 23:03:10 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquiring lock "66578337-cbff-4613-87a1-85ddabaebb2d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "66578337-cbff-4613-87a1-85ddabaebb2d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:11 user nova-compute[72766]: DEBUG nova.compute.manager [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 23:03:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:11 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 23:03:11 user nova-compute[72766]: INFO nova.compute.claims [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Claim successful on node user
Aug 14 23:03:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:11 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:03:11 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:03:11 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:03:11 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:03:11 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] No VIF found with MAC fa:16:3e:96:85:b3, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:03:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:11 user nova-compute[72766]: DEBUG nova.compute.manager [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 23:03:11 user nova-compute[72766]: DEBUG nova.compute.manager [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 23:03:11 user nova-compute[72766]: DEBUG nova.network.neutron [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 23:03:11 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 23:03:11 user nova-compute[72766]: DEBUG nova.compute.manager [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 23:03:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-83440df4-c9a2-4f0f-bacd-7fd91ed286f0 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "c3c0a004-8d70-4253-bf17-b83088e30031" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.724s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:11 user nova-compute[72766]: DEBUG nova.policy [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7a41813929144571a3306300dbf6f485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1dd09415664f1aa0b0dbdeeb4b8d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 23:03:11 user nova-compute[72766]: DEBUG nova.compute.manager [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 23:03:11 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 23:03:11 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Creating image(s)
Aug 14 23:03:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquiring lock "/opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "/opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "/opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.196s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquiring lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.168s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk 1073741824 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk 1073741824" returned: 0 in 0.147s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.324s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.183s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:12 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Checking if we can resize image /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk. size=1073741824 {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 23:03:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:12 user nova-compute[72766]: DEBUG nova.network.neutron [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Successfully created port: ffc1761b-5d95-4c58-9b92-b6b43b4823a6 {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 23:03:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:12 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Cannot resize image /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk to a smaller size. {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 23:03:12 user nova-compute[72766]: DEBUG nova.objects.instance [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lazy-loading 'migration_context' on Instance uuid 66578337-cbff-4613-87a1-85ddabaebb2d {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:03:12 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 23:03:12 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Ensure instance console log exists: /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 23:03:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:12 user nova-compute[72766]: DEBUG nova.compute.manager [req-5b12f0b9-c071-4bde-88c9-5e33c491796a req-0f61af3e-edea-4f4d-a7e6-9ed08bb1003c service nova] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Received event network-vif-plugged-b702ab41-e9af-4548-a80f-c68f90220afb {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:03:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-5b12f0b9-c071-4bde-88c9-5e33c491796a req-0f61af3e-edea-4f4d-a7e6-9ed08bb1003c service nova] Acquiring lock "4f7a13a8-6ac1-4b19-8c5c-f54406790f58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-5b12f0b9-c071-4bde-88c9-5e33c491796a req-0f61af3e-edea-4f4d-a7e6-9ed08bb1003c service nova] Lock "4f7a13a8-6ac1-4b19-8c5c-f54406790f58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-5b12f0b9-c071-4bde-88c9-5e33c491796a req-0f61af3e-edea-4f4d-a7e6-9ed08bb1003c service nova] Lock "4f7a13a8-6ac1-4b19-8c5c-f54406790f58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:12 user nova-compute[72766]: DEBUG nova.compute.manager [req-5b12f0b9-c071-4bde-88c9-5e33c491796a req-0f61af3e-edea-4f4d-a7e6-9ed08bb1003c service nova] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] No waiting events found dispatching network-vif-plugged-b702ab41-e9af-4548-a80f-c68f90220afb {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:03:12 user nova-compute[72766]: WARNING nova.compute.manager [req-5b12f0b9-c071-4bde-88c9-5e33c491796a req-0f61af3e-edea-4f4d-a7e6-9ed08bb1003c service nova] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Received unexpected event network-vif-plugged-b702ab41-e9af-4548-a80f-c68f90220afb for instance with vm_state building and task_state spawning.
Aug 14 23:03:13 user nova-compute[72766]: DEBUG nova.compute.manager [req-bad1c3d1-616b-48c0-b474-ba937ceea851 req-fb84ac1a-4eef-4fa8-b8b4-fc03a34bdb0a service nova] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Received event network-vif-plugged-8f65f8f0-60fe-4fdb-af66-424a85b12caf {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:03:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-bad1c3d1-616b-48c0-b474-ba937ceea851 req-fb84ac1a-4eef-4fa8-b8b4-fc03a34bdb0a service nova] Acquiring lock "cbcf7851-e6f7-4f46-97cc-d773286ccddf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-bad1c3d1-616b-48c0-b474-ba937ceea851 req-fb84ac1a-4eef-4fa8-b8b4-fc03a34bdb0a service nova] Lock "cbcf7851-e6f7-4f46-97cc-d773286ccddf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-bad1c3d1-616b-48c0-b474-ba937ceea851 req-fb84ac1a-4eef-4fa8-b8b4-fc03a34bdb0a service nova] Lock "cbcf7851-e6f7-4f46-97cc-d773286ccddf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:13 user nova-compute[72766]: DEBUG nova.compute.manager [req-bad1c3d1-616b-48c0-b474-ba937ceea851 req-fb84ac1a-4eef-4fa8-b8b4-fc03a34bdb0a service nova] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] No waiting events found dispatching network-vif-plugged-8f65f8f0-60fe-4fdb-af66-424a85b12caf {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:03:13 user nova-compute[72766]: WARNING nova.compute.manager [req-bad1c3d1-616b-48c0-b474-ba937ceea851 req-fb84ac1a-4eef-4fa8-b8b4-fc03a34bdb0a service nova] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Received unexpected event network-vif-plugged-8f65f8f0-60fe-4fdb-af66-424a85b12caf for instance with vm_state building and task_state spawning.
Aug 14 23:03:13 user nova-compute[72766]: DEBUG nova.network.neutron [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Successfully updated port: ffc1761b-5d95-4c58-9b92-b6b43b4823a6 {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 23:03:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquiring lock "refresh_cache-66578337-cbff-4613-87a1-85ddabaebb2d" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:03:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquired lock "refresh_cache-66578337-cbff-4613-87a1-85ddabaebb2d" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:03:13 user nova-compute[72766]: DEBUG nova.network.neutron [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:03:13 user nova-compute[72766]: DEBUG nova.compute.manager [req-11cfee43-e34a-488d-b53a-7e2b0057d12a req-ab0d27f9-3772-402a-bda2-25f48a271204 service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Received event network-changed-ffc1761b-5d95-4c58-9b92-b6b43b4823a6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:03:13 user nova-compute[72766]: DEBUG nova.compute.manager [req-11cfee43-e34a-488d-b53a-7e2b0057d12a req-ab0d27f9-3772-402a-bda2-25f48a271204 service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Refreshing instance network info cache due to event network-changed-ffc1761b-5d95-4c58-9b92-b6b43b4823a6. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:03:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-11cfee43-e34a-488d-b53a-7e2b0057d12a req-ab0d27f9-3772-402a-bda2-25f48a271204 service nova] Acquiring lock "refresh_cache-66578337-cbff-4613-87a1-85ddabaebb2d" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:03:13 user nova-compute[72766]: DEBUG nova.network.neutron [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 23:03:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ceb92910-aa2b-4805-b1f8-3d50335b1af6 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Acquiring lock "c3c0a004-8d70-4253-bf17-b83088e30031" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ceb92910-aa2b-4805-b1f8-3d50335b1af6 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "c3c0a004-8d70-4253-bf17-b83088e30031" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:13 user nova-compute[72766]: INFO nova.compute.manager [None req-ceb92910-aa2b-4805-b1f8-3d50335b1af6 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Detaching volume fa3c071e-9bb3-43dc-b694-1691d2e5a442
Aug 14 23:03:13 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054193.9177048, cbcf7851-e6f7-4f46-97cc-d773286ccddf => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:03:13 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] VM Resumed (Lifecycle Event)
Aug 14 23:03:13 user nova-compute[72766]: DEBUG nova.compute.manager [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:03:13 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 23:03:13 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Instance spawned successfully.
Aug 14 23:03:13 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 23:03:13 user nova-compute[72766]: DEBUG nova.network.neutron [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Updating instance_info_cache with network_info: [{"id": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "address": "fa:16:3e:e2:97:1e", "network": {"id": "b375da9b-b613-4a88-a262-962f959597b9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-462508113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1dd09415664f1aa0b0dbdeeb4b8d32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffc1761b-5d", "ovs_interfaceid": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:03:13 user nova-compute[72766]: INFO nova.virt.block_device [None req-ceb92910-aa2b-4805-b1f8-3d50335b1af6 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Attempting to driver detach volume fa3c071e-9bb3-43dc-b694-1691d2e5a442 from mountpoint /dev/vdb
Aug 14 23:03:13 user nova-compute[72766]: DEBUG nova.compute.manager [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:03:13 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 23:03:13 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:03:13 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Instance spawned successfully.
Aug 14 23:03:13 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 23:03:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Releasing lock "refresh_cache-66578337-cbff-4613-87a1-85ddabaebb2d" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:03:13 user nova-compute[72766]: DEBUG nova.compute.manager [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Instance network_info: |[{"id": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "address": "fa:16:3e:e2:97:1e", "network": {"id": "b375da9b-b613-4a88-a262-962f959597b9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-462508113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1dd09415664f1aa0b0dbdeeb4b8d32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffc1761b-5d", "ovs_interfaceid": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 23:03:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-11cfee43-e34a-488d-b53a-7e2b0057d12a req-ab0d27f9-3772-402a-bda2-25f48a271204 service nova] Acquired lock "refresh_cache-66578337-cbff-4613-87a1-85ddabaebb2d" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:03:13 user nova-compute[72766]: DEBUG nova.network.neutron [req-11cfee43-e34a-488d-b53a-7e2b0057d12a req-ab0d27f9-3772-402a-bda2-25f48a271204 service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Refreshing network info cache for port ffc1761b-5d95-4c58-9b92-b6b43b4823a6 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:03:13 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Start _get_guest_xml network_info=[{"id": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "address": "fa:16:3e:e2:97:1e", "network": {"id": "b375da9b-b613-4a88-a262-962f959597b9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-462508113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1dd09415664f1aa0b0dbdeeb4b8d32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffc1761b-5d", "ovs_interfaceid": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd2900d30-2c4c-4d57-9135-d45564c0c596'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:03:13 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:03:13 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:03:13 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:03:13 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:03:13 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:03:13 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:03:13 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:03:14 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054193.9182816, cbcf7851-e6f7-4f46-97cc-d773286ccddf => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:03:14 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] VM Started (Lifecycle Event)
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ceb92910-aa2b-4805-b1f8-3d50335b1af6 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Attempting to detach device vdb from instance c3c0a004-8d70-4253-bf17-b83088e30031 from the persistent domain config. {{(pid=72766) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-ceb92910-aa2b-4805-b1f8-3d50335b1af6 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 23:03:14 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:03:14 user nova-compute[72766]:   <source dev="/dev/sdf"/>
Aug 14 23:03:14 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:03:14 user nova-compute[72766]:   <serial>fa3c071e-9bb3-43dc-b694-1691d2e5a442</serial>
Aug 14 23:03:14 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 23:03:14 user nova-compute[72766]: </disk>
Aug 14 23:03:14 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 23:03:14 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:03:14 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:03:14 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-ceb92910-aa2b-4805-b1f8-3d50335b1af6 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Successfully detached device vdb from instance c3c0a004-8d70-4253-bf17-b83088e30031 from the persistent domain config.
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ceb92910-aa2b-4805-b1f8-3d50335b1af6 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c3c0a004-8d70-4253-bf17-b83088e30031 from the live domain config. {{(pid=72766) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-ceb92910-aa2b-4805-b1f8-3d50335b1af6 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 23:03:14 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:03:14 user nova-compute[72766]:   <source dev="/dev/sdf"/>
Aug 14 23:03:14 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:03:14 user nova-compute[72766]:   <serial>fa3c071e-9bb3-43dc-b694-1691d2e5a442</serial>
Aug 14 23:03:14 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 23:03:14 user nova-compute[72766]: </disk>
Aug 14 23:03:14 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:03:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-217587435',display_name='tempest-AttachVolumeTestJSON-server-217587435',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-217587435',id=21,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBINZx5RlQmHKeHXxfdC+NXwuqcWxgRblOsB0YY2uiI6sAZZohfv46zguEF36eLiA7VkgzN1UzneQgr1/yAGU0LFY6JMqRhzyWlR9BBcwz/CmcDywCLsqGwbsFhgR7C+vTQ==',key_name='tempest-keypair-1163729093',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b1dd09415664f1aa0b0dbdeeb4b8d32',ramdisk_id='',reservation_id='r-p88w362t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-716158533',owner_user_name='tempest-AttachVolumeTestJSON-716158533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:03:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a41813929144571a3306300dbf6f485',uuid=66578337-cbff-4613-87a1-85ddabaebb2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "address": "fa:16:3e:e2:97:1e", "network": {"id": "b375da9b-b613-4a88-a262-962f959597b9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-462508113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1dd09415664f1aa0b0dbdeeb4b8d32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffc1761b-5d", "ovs_interfaceid": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Converting VIF {"id": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "address": "fa:16:3e:e2:97:1e", "network": {"id": "b375da9b-b613-4a88-a262-962f959597b9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-462508113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1dd09415664f1aa0b0dbdeeb4b8d32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffc1761b-5d", "ovs_interfaceid": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:97:1e,bridge_name='br-int',has_traffic_filtering=True,id=ffc1761b-5d95-4c58-9b92-b6b43b4823a6,network=Network(b375da9b-b613-4a88-a262-962f959597b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffc1761b-5d') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.objects.instance [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lazy-loading 'pci_devices' on Instance uuid 66578337-cbff-4613-87a1-85ddabaebb2d {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:03:14 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054193.9464395, 4f7a13a8-6ac1-4b19-8c5c-f54406790f58 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:03:14 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] VM Resumed (Lifecycle Event)
Aug 14 23:03:14 user nova-compute[72766]: INFO nova.compute.manager [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Took 10.26 seconds to spawn the instance on the hypervisor.
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.compute.manager [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:03:14 user nova-compute[72766]: INFO nova.compute.manager [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Took 8.30 seconds to spawn the instance on the hypervisor.
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.compute.manager [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:03:14 user nova-compute[72766]:   <uuid>66578337-cbff-4613-87a1-85ddabaebb2d</uuid>
Aug 14 23:03:14 user nova-compute[72766]:   <name>instance-00000015</name>
Aug 14 23:03:14 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:03:14 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:03:14 user nova-compute[72766]:   <metadata>
Aug 14 23:03:14 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:03:14 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:03:14 user nova-compute[72766]:       <nova:name>tempest-AttachVolumeTestJSON-server-217587435</nova:name>
Aug 14 23:03:14 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:03:14</nova:creationTime>
Aug 14 23:03:14 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:03:14 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:03:14 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:03:14 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:03:14 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:03:14 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:03:14 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:03:14 user nova-compute[72766]:       <nova:owner>
Aug 14 23:03:14 user nova-compute[72766]:         <nova:user uuid="7a41813929144571a3306300dbf6f485">tempest-AttachVolumeTestJSON-716158533-project-member</nova:user>
Aug 14 23:03:14 user nova-compute[72766]:         <nova:project uuid="3b1dd09415664f1aa0b0dbdeeb4b8d32">tempest-AttachVolumeTestJSON-716158533</nova:project>
Aug 14 23:03:14 user nova-compute[72766]:       </nova:owner>
Aug 14 23:03:14 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 23:03:14 user nova-compute[72766]:       <nova:ports>
Aug 14 23:03:14 user nova-compute[72766]:         <nova:port uuid="ffc1761b-5d95-4c58-9b92-b6b43b4823a6">
Aug 14 23:03:14 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 23:03:14 user nova-compute[72766]:         </nova:port>
Aug 14 23:03:14 user nova-compute[72766]:       </nova:ports>
Aug 14 23:03:14 user nova-compute[72766]:     </nova:instance>
Aug 14 23:03:14 user nova-compute[72766]:   </metadata>
Aug 14 23:03:14 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:03:14 user nova-compute[72766]:     <system>
Aug 14 23:03:14 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:03:14 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:03:14 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:03:14 user nova-compute[72766]:       <entry name="serial">66578337-cbff-4613-87a1-85ddabaebb2d</entry>
Aug 14 23:03:14 user nova-compute[72766]:       <entry name="uuid">66578337-cbff-4613-87a1-85ddabaebb2d</entry>
Aug 14 23:03:14 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:03:14 user nova-compute[72766]:     </system>
Aug 14 23:03:14 user nova-compute[72766]:   </sysinfo>
Aug 14 23:03:14 user nova-compute[72766]:   <os>
Aug 14 23:03:14 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:03:14 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:03:14 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:03:14 user nova-compute[72766]:   </os>
Aug 14 23:03:14 user nova-compute[72766]:   <features>
Aug 14 23:03:14 user nova-compute[72766]:     <acpi/>
Aug 14 23:03:14 user nova-compute[72766]:     <apic/>
Aug 14 23:03:14 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:03:14 user nova-compute[72766]:   </features>
Aug 14 23:03:14 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:03:14 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:03:14 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:03:14 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:03:14 user nova-compute[72766]:   </clock>
Aug 14 23:03:14 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:03:14 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:03:14 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:03:14 user nova-compute[72766]:   </cpu>
Aug 14 23:03:14 user nova-compute[72766]:   <devices>
Aug 14 23:03:14 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 23:03:14 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 23:03:14 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk"/>
Aug 14 23:03:14 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:03:14 user nova-compute[72766]:     </disk>
Aug 14 23:03:14 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:03:14 user nova-compute[72766]:       <mac address="fa:16:3e:e2:97:1e"/>
Aug 14 23:03:14 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:03:14 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:03:14 user nova-compute[72766]:       <target dev="tapffc1761b-5d"/>
Aug 14 23:03:14 user nova-compute[72766]:     </interface>
Aug 14 23:03:14 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:03:14 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/console.log" append="off"/>
Aug 14 23:03:14 user nova-compute[72766]:     </serial>
Aug 14 23:03:14 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:03:14 user nova-compute[72766]:     <video>
Aug 14 23:03:14 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:03:14 user nova-compute[72766]:     </video>
Aug 14 23:03:14 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:03:14 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:03:14 user nova-compute[72766]:     </rng>
Aug 14 23:03:14 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:03:14 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:03:14 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:03:14 user nova-compute[72766]:     </memballoon>
Aug 14 23:03:14 user nova-compute[72766]:   </devices>
Aug 14 23:03:14 user nova-compute[72766]: </domain>
Aug 14 23:03:14 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:03:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-217587435',display_name='tempest-AttachVolumeTestJSON-server-217587435',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-217587435',id=21,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBINZx5RlQmHKeHXxfdC+NXwuqcWxgRblOsB0YY2uiI6sAZZohfv46zguEF36eLiA7VkgzN1UzneQgr1/yAGU0LFY6JMqRhzyWlR9BBcwz/CmcDywCLsqGwbsFhgR7C+vTQ==',key_name='tempest-keypair-1163729093',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b1dd09415664f1aa0b0dbdeeb4b8d32',ramdisk_id='',reservation_id='r-p88w362t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-716158533',owner_user_name='tempest-AttachVolumeTestJSON-716158533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:03:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a41813929144571a3306300dbf6f485',uuid=66578337-cbff-4613-87a1-85ddabaebb2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "address": "fa:16:3e:e2:97:1e", "network": {"id": "b375da9b-b613-4a88-a262-962f959597b9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-462508113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1dd09415664f1aa0b0dbdeeb4b8d32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffc1761b-5d", "ovs_interfaceid": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Converting VIF {"id": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "address": "fa:16:3e:e2:97:1e", "network": {"id": "b375da9b-b613-4a88-a262-962f959597b9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-462508113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1dd09415664f1aa0b0dbdeeb4b8d32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffc1761b-5d", "ovs_interfaceid": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:97:1e,bridge_name='br-int',has_traffic_filtering=True,id=ffc1761b-5d95-4c58-9b92-b6b43b4823a6,network=Network(b375da9b-b613-4a88-a262-962f959597b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffc1761b-5d') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG os_vif [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:97:1e,bridge_name='br-int',has_traffic_filtering=True,id=ffc1761b-5d95-4c58-9b92-b6b43b4823a6,network=Network(b375da9b-b613-4a88-a262-962f959597b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffc1761b-5d') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapffc1761b-5d, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapffc1761b-5d, col_values=(('external_ids', {'iface-id': 'ffc1761b-5d95-4c58-9b92-b6b43b4823a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:97:1e', 'vm-uuid': '66578337-cbff-4613-87a1-85ddabaebb2d'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:14 user nova-compute[72766]: INFO os_vif [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:97:1e,bridge_name='br-int',has_traffic_filtering=True,id=ffc1761b-5d95-4c58-9b92-b6b43b4823a6,network=Network(b375da9b-b613-4a88-a262-962f959597b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffc1761b-5d')
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:03:14 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054193.9468334, 4f7a13a8-6ac1-4b19-8c5c-f54406790f58 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:03:14 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] VM Started (Lifecycle Event)
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:03:14 user nova-compute[72766]: INFO nova.compute.manager [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Took 11.14 seconds to build instance.
Aug 14 23:03:14 user nova-compute[72766]: INFO nova.compute.manager [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Took 9.24 seconds to build instance.
Aug 14 23:03:14 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] No VIF found with MAC fa:16:3e:e2:97:1e, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-094cd64d-3c70-4184-98c6-dd815a62b83c tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "cbcf7851-e6f7-4f46-97cc-d773286ccddf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.246s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a147ed83-2f0f-4505-a754-2defafebb91c tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Lock "4f7a13a8-6ac1-4b19-8c5c-f54406790f58" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.346s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Received event <DeviceRemovedEvent: 1692054194.491487, c3c0a004-8d70-4253-bf17-b83088e30031 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72766) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ceb92910-aa2b-4805-b1f8-3d50335b1af6 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c3c0a004-8d70-4253-bf17-b83088e30031 {{(pid=72766) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.network.neutron [req-11cfee43-e34a-488d-b53a-7e2b0057d12a req-ab0d27f9-3772-402a-bda2-25f48a271204 service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Updated VIF entry in instance network info cache for port ffc1761b-5d95-4c58-9b92-b6b43b4823a6. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.network.neutron [req-11cfee43-e34a-488d-b53a-7e2b0057d12a req-ab0d27f9-3772-402a-bda2-25f48a271204 service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Updating instance_info_cache with network_info: [{"id": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "address": "fa:16:3e:e2:97:1e", "network": {"id": "b375da9b-b613-4a88-a262-962f959597b9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-462508113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1dd09415664f1aa0b0dbdeeb4b8d32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffc1761b-5d", "ovs_interfaceid": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:03:14 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-ceb92910-aa2b-4805-b1f8-3d50335b1af6 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Successfully detached device vdb from instance c3c0a004-8d70-4253-bf17-b83088e30031 from the live domain config.
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ceb92910-aa2b-4805-b1f8-3d50335b1af6 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb92910-aa2b-4805-b1f8-3d50335b1af6 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LNToxRfs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:03:14 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-ceb92910-aa2b-4805-b1f8-3d50335b1af6 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:03:14 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-ceb92910-aa2b-4805-b1f8-3d50335b1af6 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-ceb92910-aa2b-4805-b1f8-3d50335b1af6 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb92910-aa2b-4805-b1f8-3d50335b1af6 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-11cfee43-e34a-488d-b53a-7e2b0057d12a req-ab0d27f9-3772-402a-bda2-25f48a271204 service nova] Releasing lock "refresh_cache-66578337-cbff-4613-87a1-85ddabaebb2d" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[07051132-f7df-4ac8-8acf-b309bd79111f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa56339-c02a-48ce-9216-8fb2b020d0a3]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb92910-aa2b-4805-b1f8-3d50335b1af6 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)
Aug 14 23:03:14 user nova-compute[72766]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 (non-flash)
Aug 14 23:03:14 user nova-compute[72766]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 (non-flash)
Aug 14 23:03:14 user nova-compute[72766]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 23:03:14 user nova-compute[72766]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442 (non-flash)
Aug 14 23:03:14 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb92910-aa2b-4805-b1f8-3d50335b1af6 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)
Aug 14 23:03:14 user nova-compute[72766]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 (non-flash)
Aug 14 23:03:14 user nova-compute[72766]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 (non-flash)
Aug 14 23:03:14 user nova-compute[72766]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 23:03:14 user nova-compute[72766]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442 (non-flash)
Aug 14 23:03:14 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb92910-aa2b-4805-b1f8-3d50335b1af6 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff16c3643a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442'): ({'sdf'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-ceb92910-aa2b-4805-b1f8-3d50335b1af6 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Removing single pathed devices sdf {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[354c019c-4020-4327-bc10-c0c249d97d36]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[954b1798-b359-468c-a11a-9c13881f2306]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-ceb92910-aa2b-4805-b1f8-3d50335b1af6 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Flushing IO for device /dev/sdf {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15d6ef0-03b8-4933-8f9e-57e529f90488]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-ceb92910-aa2b-4805-b1f8-3d50335b1af6 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.037s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d332c4e4-dd8f-411d-85a7-834f6eca8003]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-ceb92910-aa2b-4805-b1f8-3d50335b1af6 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-ceb92910-aa2b-4805-b1f8-3d50335b1af6 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] SCSI volumes sdf have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb92910-aa2b-4805-b1f8-3d50335b1af6 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2206306a-79fd-49a6-96e3-3ff7c2bcb8e5]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb92910-aa2b-4805-b1f8-3d50335b1af6 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442 -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[864da7d4-5425-42e6-8106-08b3e068fb21]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb92910-aa2b-4805-b1f8-3d50335b1af6 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442, portal: 172.16.0.220,3260]
Aug 14 23:03:14 user nova-compute[72766]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442, portal: 172.16.0.220,3260] successful.
Aug 14 23:03:14 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442 -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa3c071e-9bb3-43dc-b694-1691d2e5a442 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.076s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[876d492e-1189-47b3-84c1-3f0b2b7da2e8]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb92910-aa2b-4805-b1f8-3d50335b1af6 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-ceb92910-aa2b-4805-b1f8-3d50335b1af6 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb92910-aa2b-4805-b1f8-3d50335b1af6 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] <== disconnect_volume: return (396ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:03:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ceb92910-aa2b-4805-b1f8-3d50335b1af6 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:03:15 user nova-compute[72766]: DEBUG nova.compute.manager [req-cffc6d3e-fd1e-4812-ba2e-8628831ac98d req-ade85305-3d89-4dce-bffd-33ee55bb5701 service nova] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Received event network-vif-plugged-8f65f8f0-60fe-4fdb-af66-424a85b12caf {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:03:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-cffc6d3e-fd1e-4812-ba2e-8628831ac98d req-ade85305-3d89-4dce-bffd-33ee55bb5701 service nova] Acquiring lock "cbcf7851-e6f7-4f46-97cc-d773286ccddf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-cffc6d3e-fd1e-4812-ba2e-8628831ac98d req-ade85305-3d89-4dce-bffd-33ee55bb5701 service nova] Lock "cbcf7851-e6f7-4f46-97cc-d773286ccddf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-cffc6d3e-fd1e-4812-ba2e-8628831ac98d req-ade85305-3d89-4dce-bffd-33ee55bb5701 service nova] Lock "cbcf7851-e6f7-4f46-97cc-d773286ccddf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:15 user nova-compute[72766]: DEBUG nova.compute.manager [req-cffc6d3e-fd1e-4812-ba2e-8628831ac98d req-ade85305-3d89-4dce-bffd-33ee55bb5701 service nova] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] No waiting events found dispatching network-vif-plugged-8f65f8f0-60fe-4fdb-af66-424a85b12caf {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:03:15 user nova-compute[72766]: WARNING nova.compute.manager [req-cffc6d3e-fd1e-4812-ba2e-8628831ac98d req-ade85305-3d89-4dce-bffd-33ee55bb5701 service nova] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Received unexpected event network-vif-plugged-8f65f8f0-60fe-4fdb-af66-424a85b12caf for instance with vm_state active and task_state None.
Aug 14 23:03:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "83084ccc-8e55-43dc-9a37-ffcb35a10922" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "83084ccc-8e55-43dc-9a37-ffcb35a10922" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:15 user nova-compute[72766]: DEBUG nova.compute.manager [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 23:03:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:15 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 23:03:15 user nova-compute[72766]: INFO nova.compute.claims [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Claim successful on node user
Aug 14 23:03:15 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:03:15 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:03:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.455s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:15 user nova-compute[72766]: DEBUG nova.compute.manager [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 23:03:15 user nova-compute[72766]: DEBUG nova.compute.manager [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 23:03:15 user nova-compute[72766]: DEBUG nova.network.neutron [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 23:03:15 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 23:03:15 user nova-compute[72766]: DEBUG nova.compute.manager [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 23:03:15 user nova-compute[72766]: INFO nova.virt.block_device [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Booting with blank volume at /dev/vda
Aug 14 23:03:15 user nova-compute[72766]: DEBUG nova.objects.instance [None req-ceb92910-aa2b-4805-b1f8-3d50335b1af6 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lazy-loading 'flavor' on Instance uuid c3c0a004-8d70-4253-bf17-b83088e30031 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:03:15 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:15 user nova-compute[72766]: DEBUG nova.policy [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '32e61321c50d4af28adeab72811a3f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3725c4b1cd78403f9628c8af9f8e5cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 23:03:15 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ceb92910-aa2b-4805-b1f8-3d50335b1af6 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "c3c0a004-8d70-4253-bf17-b83088e30031" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.124s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:15 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:16 user nova-compute[72766]: DEBUG nova.network.neutron [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Successfully created port: cbbf0086-17e4-41a5-8893-cf8657faf6e5 {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 23:03:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:17 user nova-compute[72766]: DEBUG nova.compute.manager [req-e9588b24-ffae-4a98-ac99-07298f586951 req-a9a5eeff-b5e2-4dfc-be5a-91cf70472044 service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Received event network-vif-plugged-ffc1761b-5d95-4c58-9b92-b6b43b4823a6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:03:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e9588b24-ffae-4a98-ac99-07298f586951 req-a9a5eeff-b5e2-4dfc-be5a-91cf70472044 service nova] Acquiring lock "66578337-cbff-4613-87a1-85ddabaebb2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e9588b24-ffae-4a98-ac99-07298f586951 req-a9a5eeff-b5e2-4dfc-be5a-91cf70472044 service nova] Lock "66578337-cbff-4613-87a1-85ddabaebb2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e9588b24-ffae-4a98-ac99-07298f586951 req-a9a5eeff-b5e2-4dfc-be5a-91cf70472044 service nova] Lock "66578337-cbff-4613-87a1-85ddabaebb2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:17 user nova-compute[72766]: DEBUG nova.compute.manager [req-e9588b24-ffae-4a98-ac99-07298f586951 req-a9a5eeff-b5e2-4dfc-be5a-91cf70472044 service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] No waiting events found dispatching network-vif-plugged-ffc1761b-5d95-4c58-9b92-b6b43b4823a6 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:03:17 user nova-compute[72766]: WARNING nova.compute.manager [req-e9588b24-ffae-4a98-ac99-07298f586951 req-a9a5eeff-b5e2-4dfc-be5a-91cf70472044 service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Received unexpected event network-vif-plugged-ffc1761b-5d95-4c58-9b92-b6b43b4823a6 for instance with vm_state building and task_state spawning.
Aug 14 23:03:17 user nova-compute[72766]: DEBUG nova.compute.manager [req-e9588b24-ffae-4a98-ac99-07298f586951 req-a9a5eeff-b5e2-4dfc-be5a-91cf70472044 service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Received event network-vif-plugged-ffc1761b-5d95-4c58-9b92-b6b43b4823a6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:03:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e9588b24-ffae-4a98-ac99-07298f586951 req-a9a5eeff-b5e2-4dfc-be5a-91cf70472044 service nova] Acquiring lock "66578337-cbff-4613-87a1-85ddabaebb2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e9588b24-ffae-4a98-ac99-07298f586951 req-a9a5eeff-b5e2-4dfc-be5a-91cf70472044 service nova] Lock "66578337-cbff-4613-87a1-85ddabaebb2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e9588b24-ffae-4a98-ac99-07298f586951 req-a9a5eeff-b5e2-4dfc-be5a-91cf70472044 service nova] Lock "66578337-cbff-4613-87a1-85ddabaebb2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:17 user nova-compute[72766]: DEBUG nova.compute.manager [req-e9588b24-ffae-4a98-ac99-07298f586951 req-a9a5eeff-b5e2-4dfc-be5a-91cf70472044 service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] No waiting events found dispatching network-vif-plugged-ffc1761b-5d95-4c58-9b92-b6b43b4823a6 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:03:17 user nova-compute[72766]: WARNING nova.compute.manager [req-e9588b24-ffae-4a98-ac99-07298f586951 req-a9a5eeff-b5e2-4dfc-be5a-91cf70472044 service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Received unexpected event network-vif-plugged-ffc1761b-5d95-4c58-9b92-b6b43b4823a6 for instance with vm_state building and task_state spawning.
Aug 14 23:03:17 user nova-compute[72766]: DEBUG nova.network.neutron [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Successfully updated port: cbbf0086-17e4-41a5-8893-cf8657faf6e5 {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 23:03:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "refresh_cache-83084ccc-8e55-43dc-9a37-ffcb35a10922" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:03:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquired lock "refresh_cache-83084ccc-8e55-43dc-9a37-ffcb35a10922" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:03:17 user nova-compute[72766]: DEBUG nova.network.neutron [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:03:17 user nova-compute[72766]: DEBUG nova.compute.manager [req-ca8a1c21-5d39-4145-af91-f8e960b0a108 req-71c1d641-90f9-4913-8b13-b1a0560f210c service nova] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Received event network-changed-cbbf0086-17e4-41a5-8893-cf8657faf6e5 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:03:17 user nova-compute[72766]: DEBUG nova.compute.manager [req-ca8a1c21-5d39-4145-af91-f8e960b0a108 req-71c1d641-90f9-4913-8b13-b1a0560f210c service nova] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Refreshing instance network info cache due to event network-changed-cbbf0086-17e4-41a5-8893-cf8657faf6e5. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:03:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ca8a1c21-5d39-4145-af91-f8e960b0a108 req-71c1d641-90f9-4913-8b13-b1a0560f210c service nova] Acquiring lock "refresh_cache-83084ccc-8e55-43dc-9a37-ffcb35a10922" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:03:17 user nova-compute[72766]: DEBUG nova.network.neutron [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 23:03:18 user nova-compute[72766]: DEBUG nova.network.neutron [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Updating instance_info_cache with network_info: [{"id": "cbbf0086-17e4-41a5-8893-cf8657faf6e5", "address": "fa:16:3e:22:4b:22", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbbf0086-17", "ovs_interfaceid": "cbbf0086-17e4-41a5-8893-cf8657faf6e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:03:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Releasing lock "refresh_cache-83084ccc-8e55-43dc-9a37-ffcb35a10922" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:03:18 user nova-compute[72766]: DEBUG nova.compute.manager [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Instance network_info: |[{"id": "cbbf0086-17e4-41a5-8893-cf8657faf6e5", "address": "fa:16:3e:22:4b:22", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbbf0086-17", "ovs_interfaceid": "cbbf0086-17e4-41a5-8893-cf8657faf6e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 23:03:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ca8a1c21-5d39-4145-af91-f8e960b0a108 req-71c1d641-90f9-4913-8b13-b1a0560f210c service nova] Acquired lock "refresh_cache-83084ccc-8e55-43dc-9a37-ffcb35a10922" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:03:18 user nova-compute[72766]: DEBUG nova.network.neutron [req-ca8a1c21-5d39-4145-af91-f8e960b0a108 req-71c1d641-90f9-4913-8b13-b1a0560f210c service nova] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Refreshing network info cache for port cbbf0086-17e4-41a5-8893-cf8657faf6e5 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:03:18 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054198.4489126, 66578337-cbff-4613-87a1-85ddabaebb2d => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:03:18 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] VM Resumed (Lifecycle Event)
Aug 14 23:03:18 user nova-compute[72766]: DEBUG nova.compute.manager [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:03:18 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 23:03:18 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Instance spawned successfully.
Aug 14 23:03:18 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 23:03:18 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:03:18 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:03:18 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:03:18 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:03:18 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:03:18 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:03:18 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:03:18 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:03:18 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:03:18 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054198.4598024, 66578337-cbff-4613-87a1-85ddabaebb2d => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:03:18 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] VM Started (Lifecycle Event)
Aug 14 23:03:18 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:03:18 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:03:18 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:03:18 user nova-compute[72766]: INFO nova.compute.manager [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Took 6.72 seconds to spawn the instance on the hypervisor.
Aug 14 23:03:18 user nova-compute[72766]: DEBUG nova.compute.manager [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:03:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:18 user nova-compute[72766]: INFO nova.compute.manager [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Took 7.47 seconds to build instance.
Aug 14 23:03:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cd8c9396-0dc1-4630-b151-c00dca386f38 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "66578337-cbff-4613-87a1-85ddabaebb2d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.564s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:19 user nova-compute[72766]: DEBUG nova.network.neutron [req-ca8a1c21-5d39-4145-af91-f8e960b0a108 req-71c1d641-90f9-4913-8b13-b1a0560f210c service nova] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Updated VIF entry in instance network info cache for port cbbf0086-17e4-41a5-8893-cf8657faf6e5. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:03:19 user nova-compute[72766]: DEBUG nova.network.neutron [req-ca8a1c21-5d39-4145-af91-f8e960b0a108 req-71c1d641-90f9-4913-8b13-b1a0560f210c service nova] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Updating instance_info_cache with network_info: [{"id": "cbbf0086-17e4-41a5-8893-cf8657faf6e5", "address": "fa:16:3e:22:4b:22", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbbf0086-17", "ovs_interfaceid": "cbbf0086-17e4-41a5-8893-cf8657faf6e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:03:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ca8a1c21-5d39-4145-af91-f8e960b0a108 req-71c1d641-90f9-4913-8b13-b1a0560f210c service nova] Releasing lock "refresh_cache-83084ccc-8e55-43dc-9a37-ffcb35a10922" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:03:19 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:03:19 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:03:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-c3c0a004-8d70-4253-bf17-b83088e30031" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:03:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-c3c0a004-8d70-4253-bf17-b83088e30031" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:03:19 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:03:20 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Updating instance_info_cache with network_info: [{"id": "26e28590-b9de-41c5-809d-06e3458eca3f", "address": "fa:16:3e:96:85:b3", "network": {"id": "b74740ac-2ac1-45f5-8997-0e22050362e8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1094074502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2811d70e7d640739c6f7bf792ec33a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e28590-b9", "ovs_interfaceid": "26e28590-b9de-41c5-809d-06e3458eca3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:03:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-c3c0a004-8d70-4253-bf17-b83088e30031" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:03:20 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:03:20 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:03:20 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:03:20 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:03:20 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:03:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:21 user nova-compute[72766]: DEBUG os_brick.utils [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:03:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:21 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[05040d56-7831-48eb-8d1c-2d618fcfcda7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:21 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce3ff61-4373-4b98-b323-ff3939412ca9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:21 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40de828-15bb-410d-b104-27c33bf8623a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:21 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[1588b918-8029-42d4-91b4-eddef614bc27]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:03:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 23:03:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:21 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:03:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:03:21 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 23:03:21 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29c8205-6979-4d62-ad7a-ffe5f4ff1a45]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 23:03:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 23:03:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 23:03:21 user nova-compute[72766]: DEBUG os_brick.utils [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:03:21 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Updating existing volume attachment record: 3f19e8cd-7e1c-4f24-9819-ca5835ea2e67 {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 23:03:22 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:03:22 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:03:22 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:03:22 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:03:22 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:03:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:22 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:03:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk --force-share --output=json" returned: 0 in 0.323s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:23 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:03:23 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:03:23 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:03:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json" returned: 0 in 0.333s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f7a13a8-6ac1-4b19-8c5c-f54406790f58/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f7a13a8-6ac1-4b19-8c5c-f54406790f58/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f7a13a8-6ac1-4b19-8c5c-f54406790f58/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:25 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f7a13a8-6ac1-4b19-8c5c-f54406790f58/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:25 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:03:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:26 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:03:26 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:03:26 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=7471MB free_disk=25.688243865966797GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:03:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:27 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance b563c62d-d117-4bb5-9157-7387c51ed641 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:03:27 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance c3c0a004-8d70-4253-bf17-b83088e30031 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:03:27 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 78f02883-99a1-493d-b6be-e43500bfba37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:03:27 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 3ff300ff-34fd-4e94-9d2d-681fb133ba32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:03:27 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 391b2d43-3c9d-42db-bfae-09e8410bf367 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:03:27 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 4d919875-5f24-4bed-bf26-cf437e0de3e2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:03:27 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance cbcf7851-e6f7-4f46-97cc-d773286ccddf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:03:27 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 4f7a13a8-6ac1-4b19-8c5c-f54406790f58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:03:27 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 66578337-cbff-4613-87a1-85ddabaebb2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:03:27 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 83084ccc-8e55-43dc-9a37-ffcb35a10922 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:03:27 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:03:27 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:03:27 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:03:27 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:03:27 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:03:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.607s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Acquiring lock "78f02883-99a1-493d-b6be-e43500bfba37" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "78f02883-99a1-493d-b6be-e43500bfba37" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:30 user nova-compute[72766]: DEBUG nova.objects.instance [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lazy-loading 'flavor' on Instance uuid 78f02883-99a1-493d-b6be-e43500bfba37 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:03:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "78f02883-99a1-493d-b6be-e43500bfba37" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Acquiring lock "78f02883-99a1-493d-b6be-e43500bfba37" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "78f02883-99a1-493d-b6be-e43500bfba37" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:30 user nova-compute[72766]: INFO nova.compute.manager [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Attaching volume 6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f to /dev/vdb
Aug 14 23:03:30 user nova-compute[72766]: DEBUG os_brick.utils [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:03:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:30 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[09057658-629c-4028-90ea-44636d38331d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:30 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e755d06-03ac-4fad-b236-e8eedada6f92]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:30 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9867a4-9c6c-4fbd-a777-41f54f7566cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:30 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a65bff-1585-4058-84db-f7eed2c22ad1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:03:30 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 23:03:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:03:30 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 23:03:30 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b73665-d007-4f7e-80dd-f99686431026]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:30 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 23:03:30 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 23:03:30 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 23:03:30 user nova-compute[72766]: DEBUG os_brick.utils [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:03:30 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Updating existing volume attachment record: 2cbbc07a-1cce-438c-b17f-565ece47f657 {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 23:03:31 user nova-compute[72766]: DEBUG nova.compute.manager [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 23:03:31 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 23:03:31 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Creating image(s)
Aug 14 23:03:31 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Did not create local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 23:03:31 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Ensure instance console log exists: /opt/stack/data/nova/instances/83084ccc-8e55-43dc-9a37-ffcb35a10922/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 23:03:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:31 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Start _get_guest_xml network_info=[{"id": "cbbf0086-17e4-41a5-8893-cf8657faf6e5", "address": "fa:16:3e:22:4b:22", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbbf0086-17", "ovs_interfaceid": "cbbf0086-17e4-41a5-8893-cf8657faf6e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '3f19e8cd-7e1c-4f24-9819-ca5835ea2e67', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JEHjDmsq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '83084ccc-8e55-43dc-9a37-ffcb35a10922', 'attached_at': '', 'detached_at': '', 'volume_id': 'c69b0c70-6633-43aa-bc9e-d46f033b8966', 'serial': 'c69b0c70-6633-43aa-bc9e-d46f033b8966'}, 'volume_type': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:03:31 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:03:31 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:03:31 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:03:31 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:03:31 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:03:31 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:03:31 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:03:31 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:03:31 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:03:31 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:03:31 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:03:31 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:03:31 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:03:31 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:03:31 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:03:31 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:03:31 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:03:31 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:03:31 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 23:03:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JEHjDmsq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:03:32 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:03:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:03:32 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:03:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:03:32 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 23:03:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee68b14-2746-44b6-97a3-1f62e244b5e2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 23:03:32 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91bda78-a409-46e2-b250-9674650ada28]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966] added
Aug 14 23:03:32 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd72ff3-1371-4d94-9ede-2ff3e507420e]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d10253-4ed7-4eff-9e79-86f3d4706693]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JEHjDmsq {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JEHjDmsq" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0fc213-28c7-49ad-8032-9b539f152a84]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JEHjDmsq'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62b2a87-31c2-4228-84a2-c43bdc97b8aa]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed562af5-471e-4b4d-9838-59bf635a301b]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)
Aug 14 23:03:32 user nova-compute[72766]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 (non-flash)
Aug 14 23:03:32 user nova-compute[72766]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 (non-flash)
Aug 14 23:03:32 user nova-compute[72766]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 23:03:32 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)
Aug 14 23:03:32 user nova-compute[72766]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 (non-flash)
Aug 14 23:03:32 user nova-compute[72766]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 (non-flash)
Aug 14 23:03:32 user nova-compute[72766]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 23:03:32 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e82718-8f83-48f6-abba-5f8be88d3d8d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966, portal: 172.16.0.220,3260]
Aug 14 23:03:32 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966, portal: 172.16.0.220,3260] successful.
Aug 14 23:03:32 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[01899916-8108-48e1-bdef-6e7d48addc78]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[81733ff5-314b-4c61-9672-d2db1eff9bb7]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)
Aug 14 23:03:32 user nova-compute[72766]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 (non-flash)
Aug 14 23:03:32 user nova-compute[72766]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 (non-flash)
Aug 14 23:03:32 user nova-compute[72766]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 23:03:32 user nova-compute[72766]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:03:32 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)
Aug 14 23:03:32 user nova-compute[72766]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 (non-flash)
Aug 14 23:03:32 user nova-compute[72766]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 (non-flash)
Aug 14 23:03:32 user nova-compute[72766]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 23:03:32 user nova-compute[72766]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:03:32 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] HCTL ('37', '-', '-', 0) found on session 27 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0a5197-7dcb-48e2-b468-6267ba3b6a1f]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Searching for a device in session 27 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:03:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JEHjDmsq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 23:03:33 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:03:33 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26430376662623437', 'path': '/dev/sdf'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:03:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430376662623437', 'path': '/dev/sdf'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 23:03:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:03:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1775402070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1775402070',id=22,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3725c4b1cd78403f9628c8af9f8e5cc5',ramdisk_id='',reservation_id='r-0ruzrjdf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-86235447',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:03:16Z,user_data=None,user_id='32e61321c50d4af28adeab72811a3f86',uuid=83084ccc-8e55-43dc-9a37-ffcb35a10922,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbbf0086-17e4-41a5-8893-cf8657faf6e5", "address": "fa:16:3e:22:4b:22", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbbf0086-17", "ovs_interfaceid": "cbbf0086-17e4-41a5-8893-cf8657faf6e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:03:33 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Converting VIF {"id": "cbbf0086-17e4-41a5-8893-cf8657faf6e5", "address": "fa:16:3e:22:4b:22", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbbf0086-17", "ovs_interfaceid": "cbbf0086-17e4-41a5-8893-cf8657faf6e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:03:33 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:4b:22,bridge_name='br-int',has_traffic_filtering=True,id=cbbf0086-17e4-41a5-8893-cf8657faf6e5,network=Network(f4efdeee-d89b-45e5-b0d9-b45573564e9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbbf0086-17') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:03:33 user nova-compute[72766]: DEBUG nova.objects.instance [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lazy-loading 'pci_devices' on Instance uuid 83084ccc-8e55-43dc-9a37-ffcb35a10922 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:03:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:03:33 user nova-compute[72766]:   <uuid>83084ccc-8e55-43dc-9a37-ffcb35a10922</uuid>
Aug 14 23:03:33 user nova-compute[72766]:   <name>instance-00000016</name>
Aug 14 23:03:33 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:03:33 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:03:33 user nova-compute[72766]:   <metadata>
Aug 14 23:03:33 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:03:33 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:03:33 user nova-compute[72766]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1775402070</nova:name>
Aug 14 23:03:33 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:03:31</nova:creationTime>
Aug 14 23:03:33 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:03:33 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:03:33 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:03:33 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:03:33 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:03:33 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:03:33 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:03:33 user nova-compute[72766]:       <nova:owner>
Aug 14 23:03:33 user nova-compute[72766]:         <nova:user uuid="32e61321c50d4af28adeab72811a3f86">tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member</nova:user>
Aug 14 23:03:33 user nova-compute[72766]:         <nova:project uuid="3725c4b1cd78403f9628c8af9f8e5cc5">tempest-ServerBootFromVolumeStableRescueTest-86235447</nova:project>
Aug 14 23:03:33 user nova-compute[72766]:       </nova:owner>
Aug 14 23:03:33 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 23:03:33 user nova-compute[72766]:       <nova:ports>
Aug 14 23:03:33 user nova-compute[72766]:         <nova:port uuid="cbbf0086-17e4-41a5-8893-cf8657faf6e5">
Aug 14 23:03:33 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 23:03:33 user nova-compute[72766]:         </nova:port>
Aug 14 23:03:33 user nova-compute[72766]:       </nova:ports>
Aug 14 23:03:33 user nova-compute[72766]:     </nova:instance>
Aug 14 23:03:33 user nova-compute[72766]:   </metadata>
Aug 14 23:03:33 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:03:33 user nova-compute[72766]:     <system>
Aug 14 23:03:33 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:03:33 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:03:33 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:03:33 user nova-compute[72766]:       <entry name="serial">83084ccc-8e55-43dc-9a37-ffcb35a10922</entry>
Aug 14 23:03:33 user nova-compute[72766]:       <entry name="uuid">83084ccc-8e55-43dc-9a37-ffcb35a10922</entry>
Aug 14 23:03:33 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:03:33 user nova-compute[72766]:     </system>
Aug 14 23:03:33 user nova-compute[72766]:   </sysinfo>
Aug 14 23:03:33 user nova-compute[72766]:   <os>
Aug 14 23:03:33 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:03:33 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:03:33 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:03:33 user nova-compute[72766]:   </os>
Aug 14 23:03:33 user nova-compute[72766]:   <features>
Aug 14 23:03:33 user nova-compute[72766]:     <acpi/>
Aug 14 23:03:33 user nova-compute[72766]:     <apic/>
Aug 14 23:03:33 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:03:33 user nova-compute[72766]:   </features>
Aug 14 23:03:33 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:03:33 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:03:33 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:03:33 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:03:33 user nova-compute[72766]:   </clock>
Aug 14 23:03:33 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:03:33 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:03:33 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:03:33 user nova-compute[72766]:   </cpu>
Aug 14 23:03:33 user nova-compute[72766]:   <devices>
Aug 14 23:03:33 user nova-compute[72766]:     <disk type="block" device="disk">
Aug 14 23:03:33 user nova-compute[72766]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:03:33 user nova-compute[72766]:       <source dev="/dev/sdf"/>
Aug 14 23:03:33 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:03:33 user nova-compute[72766]:       <serial>c69b0c70-6633-43aa-bc9e-d46f033b8966</serial>
Aug 14 23:03:33 user nova-compute[72766]:     </disk>
Aug 14 23:03:33 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:03:33 user nova-compute[72766]:       <mac address="fa:16:3e:22:4b:22"/>
Aug 14 23:03:33 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:03:33 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:03:33 user nova-compute[72766]:       <target dev="tapcbbf0086-17"/>
Aug 14 23:03:33 user nova-compute[72766]:     </interface>
Aug 14 23:03:33 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:03:33 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/83084ccc-8e55-43dc-9a37-ffcb35a10922/console.log" append="off"/>
Aug 14 23:03:33 user nova-compute[72766]:     </serial>
Aug 14 23:03:33 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:03:33 user nova-compute[72766]:     <video>
Aug 14 23:03:33 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:03:33 user nova-compute[72766]:     </video>
Aug 14 23:03:33 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:03:33 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:03:33 user nova-compute[72766]:     </rng>
Aug 14 23:03:33 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:03:33 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:03:33 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:03:33 user nova-compute[72766]:     </memballoon>
Aug 14 23:03:33 user nova-compute[72766]:   </devices>
Aug 14 23:03:33 user nova-compute[72766]: </domain>
Aug 14 23:03:33 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:03:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:03:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1775402070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1775402070',id=22,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3725c4b1cd78403f9628c8af9f8e5cc5',ramdisk_id='',reservation_id='r-0ruzrjdf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-86235447',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:03:16Z,user_data=None,user_id='32e61321c50d4af28adeab72811a3f86',uuid=83084ccc-8e55-43dc-9a37-ffcb35a10922,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbbf0086-17e4-41a5-8893-cf8657faf6e5", "address": "fa:16:3e:22:4b:22", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbbf0086-17", "ovs_interfaceid": "cbbf0086-17e4-41a5-8893-cf8657faf6e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:03:33 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Converting VIF {"id": "cbbf0086-17e4-41a5-8893-cf8657faf6e5", "address": "fa:16:3e:22:4b:22", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbbf0086-17", "ovs_interfaceid": "cbbf0086-17e4-41a5-8893-cf8657faf6e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:03:33 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:4b:22,bridge_name='br-int',has_traffic_filtering=True,id=cbbf0086-17e4-41a5-8893-cf8657faf6e5,network=Network(f4efdeee-d89b-45e5-b0d9-b45573564e9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbbf0086-17') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:03:33 user nova-compute[72766]: DEBUG os_vif [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:4b:22,bridge_name='br-int',has_traffic_filtering=True,id=cbbf0086-17e4-41a5-8893-cf8657faf6e5,network=Network(f4efdeee-d89b-45e5-b0d9-b45573564e9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbbf0086-17') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:03:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:03:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:03:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcbbf0086-17, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:03:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcbbf0086-17, col_values=(('external_ids', {'iface-id': 'cbbf0086-17e4-41a5-8893-cf8657faf6e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:4b:22', 'vm-uuid': '83084ccc-8e55-43dc-9a37-ffcb35a10922'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:03:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:03:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:33 user nova-compute[72766]: INFO os_vif [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:4b:22,bridge_name='br-int',has_traffic_filtering=True,id=cbbf0086-17e4-41a5-8893-cf8657faf6e5,network=Network(f4efdeee-d89b-45e5-b0d9-b45573564e9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbbf0086-17')
Aug 14 23:03:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:03:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] No VIF found with MAC fa:16:3e:22:4b:22, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:03:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:34 user nova-compute[72766]: DEBUG nova.compute.manager [req-a1b3bd41-77f4-416d-a259-4b5b9de09f78 req-082817c9-0891-41f7-ad2a-e1981273e291 service nova] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Received event network-vif-plugged-cbbf0086-17e4-41a5-8893-cf8657faf6e5 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:03:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a1b3bd41-77f4-416d-a259-4b5b9de09f78 req-082817c9-0891-41f7-ad2a-e1981273e291 service nova] Acquiring lock "83084ccc-8e55-43dc-9a37-ffcb35a10922-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a1b3bd41-77f4-416d-a259-4b5b9de09f78 req-082817c9-0891-41f7-ad2a-e1981273e291 service nova] Lock "83084ccc-8e55-43dc-9a37-ffcb35a10922-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a1b3bd41-77f4-416d-a259-4b5b9de09f78 req-082817c9-0891-41f7-ad2a-e1981273e291 service nova] Lock "83084ccc-8e55-43dc-9a37-ffcb35a10922-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:34 user nova-compute[72766]: DEBUG nova.compute.manager [req-a1b3bd41-77f4-416d-a259-4b5b9de09f78 req-082817c9-0891-41f7-ad2a-e1981273e291 service nova] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] No waiting events found dispatching network-vif-plugged-cbbf0086-17e4-41a5-8893-cf8657faf6e5 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:03:34 user nova-compute[72766]: WARNING nova.compute.manager [req-a1b3bd41-77f4-416d-a259-4b5b9de09f78 req-082817c9-0891-41f7-ad2a-e1981273e291 service nova] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Received unexpected event network-vif-plugged-cbbf0086-17e4-41a5-8893-cf8657faf6e5 for instance with vm_state building and task_state spawning.
Aug 14 23:03:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:36 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054216.8993845, 83084ccc-8e55-43dc-9a37-ffcb35a10922 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:03:36 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] VM Resumed (Lifecycle Event)
Aug 14 23:03:36 user nova-compute[72766]: DEBUG nova.compute.manager [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:03:36 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 23:03:36 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Instance spawned successfully.
Aug 14 23:03:36 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 23:03:36 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:03:36 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:03:36 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:03:36 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:03:36 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:03:36 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:03:36 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:03:36 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:03:36 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:03:36 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054216.9034693, 83084ccc-8e55-43dc-9a37-ffcb35a10922 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:03:36 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] VM Started (Lifecycle Event)
Aug 14 23:03:36 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:03:36 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:03:37 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:03:37 user nova-compute[72766]: DEBUG nova.compute.manager [req-6c7fc947-b2d0-43b7-b5c4-5e77d87d0412 req-cf3ef762-0d7f-41f1-ba5f-2703962f7102 service nova] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Received event network-vif-plugged-cbbf0086-17e4-41a5-8893-cf8657faf6e5 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:03:37 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-6c7fc947-b2d0-43b7-b5c4-5e77d87d0412 req-cf3ef762-0d7f-41f1-ba5f-2703962f7102 service nova] Acquiring lock "83084ccc-8e55-43dc-9a37-ffcb35a10922-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:37 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-6c7fc947-b2d0-43b7-b5c4-5e77d87d0412 req-cf3ef762-0d7f-41f1-ba5f-2703962f7102 service nova] Lock "83084ccc-8e55-43dc-9a37-ffcb35a10922-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:37 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-6c7fc947-b2d0-43b7-b5c4-5e77d87d0412 req-cf3ef762-0d7f-41f1-ba5f-2703962f7102 service nova] Lock "83084ccc-8e55-43dc-9a37-ffcb35a10922-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:37 user nova-compute[72766]: DEBUG nova.compute.manager [req-6c7fc947-b2d0-43b7-b5c4-5e77d87d0412 req-cf3ef762-0d7f-41f1-ba5f-2703962f7102 service nova] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] No waiting events found dispatching network-vif-plugged-cbbf0086-17e4-41a5-8893-cf8657faf6e5 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:03:37 user nova-compute[72766]: WARNING nova.compute.manager [req-6c7fc947-b2d0-43b7-b5c4-5e77d87d0412 req-cf3ef762-0d7f-41f1-ba5f-2703962f7102 service nova] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Received unexpected event network-vif-plugged-cbbf0086-17e4-41a5-8893-cf8657faf6e5 for instance with vm_state building and task_state spawning.
Aug 14 23:03:37 user nova-compute[72766]: INFO nova.compute.manager [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Took 5.10 seconds to spawn the instance on the hypervisor.
Aug 14 23:03:37 user nova-compute[72766]: DEBUG nova.compute.manager [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:03:37 user nova-compute[72766]: INFO nova.compute.manager [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Took 21.95 seconds to build instance.
Aug 14 23:03:37 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-4c10baa6-4d77-4b71-9189-abc414159d04 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "83084ccc-8e55-43dc-9a37-ffcb35a10922" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.043s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eRHNEWri', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:03:40 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:03:40 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:03:40 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:03:40 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:03:40 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 23:03:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[777df318-fac8-465e-be67-379bb81e2700]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 23:03:40 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[141bb8eb-16b9-40f6-8ec3-58c3514a37e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f] added
Aug 14 23:03:40 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ac2118-7431-468a-992f-b9792347f61f]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[09675725-9c35-42fa-8435-2885d1fea532]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eRHNEWri {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eRHNEWri" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[9955b138-92eb-43ca-91ad-5b25541f9cee]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eRHNEWri'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7feaae-44f6-4438-bcd8-1f9414c130d8]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb60e99-75af-4dca-8227-4613880ee0fd]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)
Aug 14 23:03:40 user nova-compute[72766]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 (non-flash)
Aug 14 23:03:40 user nova-compute[72766]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 (non-flash)
Aug 14 23:03:40 user nova-compute[72766]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 23:03:40 user nova-compute[72766]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:03:40 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)
Aug 14 23:03:40 user nova-compute[72766]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 (non-flash)
Aug 14 23:03:40 user nova-compute[72766]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 (non-flash)
Aug 14 23:03:40 user nova-compute[72766]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 23:03:40 user nova-compute[72766]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:03:40 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d2aeb3-c839-4e59-b9df-77f29a286864]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f, portal: 172.16.0.220,3260]
Aug 14 23:03:40 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f, portal: 172.16.0.220,3260] successful.
Aug 14 23:03:40 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa9bf8d-8303-4cb0-b687-af8b5702a33c]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[690394c9-3fa3-42bc-a0b4-6a37531d567f]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)
Aug 14 23:03:40 user nova-compute[72766]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 (non-flash)
Aug 14 23:03:40 user nova-compute[72766]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 (non-flash)
Aug 14 23:03:40 user nova-compute[72766]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 23:03:40 user nova-compute[72766]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:03:40 user nova-compute[72766]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f (non-flash)
Aug 14 23:03:40 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)
Aug 14 23:03:40 user nova-compute[72766]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 (non-flash)
Aug 14 23:03:40 user nova-compute[72766]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 (non-flash)
Aug 14 23:03:40 user nova-compute[72766]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 23:03:40 user nova-compute[72766]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:03:40 user nova-compute[72766]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f (non-flash)
Aug 14 23:03:40 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] HCTL ('38', '-', '-', 0) found on session 28 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[34299038-835e-437e-a563-4b57d2af4c98]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:40 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Searching for a device in session 28 and hctl ['38', '*', '*', 0] yield: None {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:03:41 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Searching for a device in session 28 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:03:41 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eRHNEWri', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 23:03:41 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:03:41 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23263633963333836', 'path': '/dev/sdg'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:03:41 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263633963333836', 'path': '/dev/sdg'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 23:03:41 user nova-compute[72766]: DEBUG nova.objects.instance [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lazy-loading 'flavor' on Instance uuid 78f02883-99a1-493d-b6be-e43500bfba37 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:03:41 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 23:03:41 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:03:41 user nova-compute[72766]:   <source dev="/dev/sdg"/>
Aug 14 23:03:41 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:03:41 user nova-compute[72766]:   <serial>6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f</serial>
Aug 14 23:03:41 user nova-compute[72766]: </disk>
Aug 14 23:03:41 user nova-compute[72766]:  {{(pid=72766) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 23:03:41 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:03:41 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:03:41 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] No VIF found with MAC fa:16:3e:7e:31:c1, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:03:41 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-3e338dba-203d-47ee-bf5a-2103e99333fc tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "78f02883-99a1-493d-b6be-e43500bfba37" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.731s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:43 user nova-compute[72766]: DEBUG nova.compute.manager [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Stashing vm_state: active {{(pid=72766) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 14 23:03:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:43 user nova-compute[72766]: DEBUG nova.objects.instance [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lazy-loading 'pci_requests' on Instance uuid 78f02883-99a1-493d-b6be-e43500bfba37 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:03:43 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 23:03:43 user nova-compute[72766]: INFO nova.compute.claims [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Claim successful on node user
Aug 14 23:03:43 user nova-compute[72766]: DEBUG nova.objects.instance [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lazy-loading 'resources' on Instance uuid 78f02883-99a1-493d-b6be-e43500bfba37 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:03:43 user nova-compute[72766]: DEBUG nova.objects.instance [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lazy-loading 'pci_devices' on Instance uuid 78f02883-99a1-493d-b6be-e43500bfba37 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:03:43 user nova-compute[72766]: INFO nova.compute.resource_tracker [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Updating resource usage from migration ec50a025-a46c-4108-a1b8-c141a1114543
Aug 14 23:03:44 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:03:44 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:03:44 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.542s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:44 user nova-compute[72766]: INFO nova.compute.manager [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Migrating
Aug 14 23:03:44 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:03:44 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Acquired lock "compute-rpcapi-router" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:03:44 user nova-compute[72766]: INFO nova.compute.rpcapi [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 14 23:03:44 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Releasing lock "compute-rpcapi-router" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:03:44 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Acquiring lock "refresh_cache-78f02883-99a1-493d-b6be-e43500bfba37" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:03:44 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Acquired lock "refresh_cache-78f02883-99a1-493d-b6be-e43500bfba37" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:03:44 user nova-compute[72766]: DEBUG nova.network.neutron [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:03:44 user nova-compute[72766]: DEBUG nova.network.neutron [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Updating instance_info_cache with network_info: [{"id": "8e7e311b-453d-4e17-9652-45723c7a2944", "address": "fa:16:3e:7e:31:c1", "network": {"id": "c07935db-7a05-49df-a504-682549f30d55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-765423768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ff897ef00ec45258b22d76ca60447fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e7e311b-45", "ovs_interfaceid": "8e7e311b-453d-4e17-9652-45723c7a2944", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:03:44 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Releasing lock "refresh_cache-78f02883-99a1-493d-b6be-e43500bfba37" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:03:45 user nova-compute[72766]: DEBUG nova.compute.manager [req-6289a311-85e3-4bb8-9170-26a7ef8d9509 req-bfa615e0-5025-4907-89df-c0aedeef86f0 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-changed-a084e92b-2287-4ac4-a9a5-db86f3d3249e {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:03:45 user nova-compute[72766]: DEBUG nova.compute.manager [req-6289a311-85e3-4bb8-9170-26a7ef8d9509 req-bfa615e0-5025-4907-89df-c0aedeef86f0 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Refreshing instance network info cache due to event network-changed-a084e92b-2287-4ac4-a9a5-db86f3d3249e. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:03:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-6289a311-85e3-4bb8-9170-26a7ef8d9509 req-bfa615e0-5025-4907-89df-c0aedeef86f0 service nova] Acquiring lock "refresh_cache-391b2d43-3c9d-42db-bfae-09e8410bf367" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:03:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-6289a311-85e3-4bb8-9170-26a7ef8d9509 req-bfa615e0-5025-4907-89df-c0aedeef86f0 service nova] Acquired lock "refresh_cache-391b2d43-3c9d-42db-bfae-09e8410bf367" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:03:45 user nova-compute[72766]: DEBUG nova.network.neutron [req-6289a311-85e3-4bb8-9170-26a7ef8d9509 req-bfa615e0-5025-4907-89df-c0aedeef86f0 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Refreshing network info cache for port a084e92b-2287-4ac4-a9a5-db86f3d3249e {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:03:45 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Starting migrate_disk_and_power_off {{(pid=72766) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 14 23:03:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:45 user nova-compute[72766]: DEBUG nova.compute.manager [req-a7b26f2c-028e-4df8-b5fe-d5c5b0ee6a82 req-bd6960c1-a0c7-4b99-8135-7efec9c69fcc service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Received event network-vif-unplugged-8e7e311b-453d-4e17-9652-45723c7a2944 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:03:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a7b26f2c-028e-4df8-b5fe-d5c5b0ee6a82 req-bd6960c1-a0c7-4b99-8135-7efec9c69fcc service nova] Acquiring lock "78f02883-99a1-493d-b6be-e43500bfba37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a7b26f2c-028e-4df8-b5fe-d5c5b0ee6a82 req-bd6960c1-a0c7-4b99-8135-7efec9c69fcc service nova] Lock "78f02883-99a1-493d-b6be-e43500bfba37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a7b26f2c-028e-4df8-b5fe-d5c5b0ee6a82 req-bd6960c1-a0c7-4b99-8135-7efec9c69fcc service nova] Lock "78f02883-99a1-493d-b6be-e43500bfba37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:45 user nova-compute[72766]: DEBUG nova.compute.manager [req-a7b26f2c-028e-4df8-b5fe-d5c5b0ee6a82 req-bd6960c1-a0c7-4b99-8135-7efec9c69fcc service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] No waiting events found dispatching network-vif-unplugged-8e7e311b-453d-4e17-9652-45723c7a2944 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:03:45 user nova-compute[72766]: WARNING nova.compute.manager [req-a7b26f2c-028e-4df8-b5fe-d5c5b0ee6a82 req-bd6960c1-a0c7-4b99-8135-7efec9c69fcc service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Received unexpected event network-vif-unplugged-8e7e311b-453d-4e17-9652-45723c7a2944 for instance with vm_state active and task_state resize_migrating.
Aug 14 23:03:45 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Instance destroyed successfully.
Aug 14 23:03:45 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:59:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1272916435',display_name='tempest-ServerActionsTestOtherB-server-1272916435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1272916435',id=16,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsHL/Ov683ewfS5a6Ilb918RzZcGPjg2jcHmAa4FSbUUXkwfiZz6KofKWkKrLkhgLEqXzZXHVc5OIPNVj5SeE4gBrIjsJUy7rj9111gEojmIZrrW+x2JI01+TKIPNtdRQ==',key_name='tempest-keypair-2053681781',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:59:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9ff897ef00ec45258b22d76ca60447fe',ramdisk_id='',reservation_id='r-vhmch78j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-930559363',owner_user_name='tempest-ServerActionsTestOtherB-930559363-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:03:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7bcae26ae5d406196128c0ce83d3413',uuid=78f02883-99a1-493d-b6be-e43500bfba37,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e7e311b-453d-4e17-9652-45723c7a2944", "address": "fa:16:3e:7e:31:c1", "network": {"id": "c07935db-7a05-49df-a504-682549f30d55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-765423768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-765423768-network", "vif_mac": "fa:16:3e:7e:31:c1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ff897ef00ec45258b22d76ca60447fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e7e311b-45", "ovs_interfaceid": "8e7e311b-453d-4e17-9652-45723c7a2944", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:03:45 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Converting VIF {"id": "8e7e311b-453d-4e17-9652-45723c7a2944", "address": "fa:16:3e:7e:31:c1", "network": {"id": "c07935db-7a05-49df-a504-682549f30d55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-765423768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-765423768-network", "vif_mac": "fa:16:3e:7e:31:c1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ff897ef00ec45258b22d76ca60447fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e7e311b-45", "ovs_interfaceid": "8e7e311b-453d-4e17-9652-45723c7a2944", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:03:45 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:31:c1,bridge_name='br-int',has_traffic_filtering=True,id=8e7e311b-453d-4e17-9652-45723c7a2944,network=Network(c07935db-7a05-49df-a504-682549f30d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e7e311b-45') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:03:45 user nova-compute[72766]: DEBUG os_vif [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:31:c1,bridge_name='br-int',has_traffic_filtering=True,id=8e7e311b-453d-4e17-9652-45723c7a2944,network=Network(c07935db-7a05-49df-a504-682549f30d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e7e311b-45') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:03:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e7e311b-45, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:03:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:03:45 user nova-compute[72766]: INFO os_vif [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:31:c1,bridge_name='br-int',has_traffic_filtering=True,id=8e7e311b-453d-4e17-9652-45723c7a2944,network=Network(c07935db-7a05-49df-a504-682549f30d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e7e311b-45')
Aug 14 23:03:45 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:03:45 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eRHNEWri', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:03:45 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:03:45 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:03:45 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:03:45 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:03:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:45 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[30bb786e-353b-4591-84af-30da0cfa1d97]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7cbc1b5-47cd-4cf3-9a76-853dccef7753]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)
Aug 14 23:03:46 user nova-compute[72766]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 (non-flash)
Aug 14 23:03:46 user nova-compute[72766]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 (non-flash)
Aug 14 23:03:46 user nova-compute[72766]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 23:03:46 user nova-compute[72766]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:03:46 user nova-compute[72766]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f (non-flash)
Aug 14 23:03:46 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)
Aug 14 23:03:46 user nova-compute[72766]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 (non-flash)
Aug 14 23:03:46 user nova-compute[72766]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 (non-flash)
Aug 14 23:03:46 user nova-compute[72766]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 23:03:46 user nova-compute[72766]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:03:46 user nova-compute[72766]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f (non-flash)
Aug 14 23:03:46 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff1545e1000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f'): ({'sdg'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Removing single pathed devices sdg {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e20a30-d6c7-4da2-8d4f-6cd6bfe9f5a9]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67e10b2-9245-4fde-a197-55e08b0b8fa6]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Flushing IO for device /dev/sdg {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bea3f0-5e37-40fa-86b8-edd8dc3794ba]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.063s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1eb53b-76cd-45f0-899c-0dcf8e904306]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] SCSI volumes sdg have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[6021b553-34f1-418f-95f1-add545bfed96]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b255245c-2be0-4d44-8641-2a3368499941]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f, portal: 172.16.0.220,3260]
Aug 14 23:03:46 user nova-compute[72766]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f, portal: 172.16.0.220,3260] successful.
Aug 14 23:03:46 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfaf90cc-e028-447d-9bfc-573a2c4791db]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] <== disconnect_volume: return (338ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG nova.network.neutron [req-6289a311-85e3-4bb8-9170-26a7ef8d9509 req-bfa615e0-5025-4907-89df-c0aedeef86f0 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Updated VIF entry in instance network info cache for port a084e92b-2287-4ac4-a9a5-db86f3d3249e. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG nova.network.neutron [req-6289a311-85e3-4bb8-9170-26a7ef8d9509 req-bfa615e0-5025-4907-89df-c0aedeef86f0 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Updating instance_info_cache with network_info: [{"id": "a084e92b-2287-4ac4-a9a5-db86f3d3249e", "address": "fa:16:3e:c1:4c:ad", "network": {"id": "480be190-a4a8-46bd-b68f-c9f2241cfd5f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-734889840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa084e92b-22", "ovs_interfaceid": "a084e92b-2287-4ac4-a9a5-db86f3d3249e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "458b086a-58f5-451f-936d-6f64a04ad64e", "address": "fa:16:3e:23:3a:7d", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap458b086a-58", "ovs_interfaceid": "458b086a-58f5-451f-936d-6f64a04ad64e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "437cdad2-00fb-4ac6-9fce-a67767cd4bda", "address": "fa:16:3e:29:78:c5", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap437cdad2-00", "ovs_interfaceid": "437cdad2-00fb-4ac6-9fce-a67767cd4bda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c48d46cf-70b1-408c-aee6-8965fb8356b0", "address": "fa:16:3e:23:98:99", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48d46cf-70", "ovs_interfaceid": "c48d46cf-70b1-408c-aee6-8965fb8356b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e418f46c-a8f2-4cbe-b422-b8aad6f84236", "address": "fa:16:3e:5b:c8:16", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape418f46c-a8", "ovs_interfaceid": "e418f46c-a8f2-4cbe-b422-b8aad6f84236", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10cc8607-5dd0-4310-b2eb-ff4f5196573c", "address": "fa:16:3e:53:23:da", "network": {"id": "48e40549-72ed-45cc-ba38-e2155151f40c", "bridge": "br-int", "label": "tempest-device-tagging-net2-669256899", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10cc8607-5d", "ovs_interfaceid": "10cc8607-5dd0-4310-b2eb-ff4f5196573c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f59675e3-d424-46f3-b3ef-ea1133f0aafd", "address": "fa:16:3e:b3:a0:b6", "network": {"id": "48e40549-72ed-45cc-ba38-e2155151f40c", "bridge": "br-int", "label": "tempest-device-tagging-net2-669256899", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59675e3-d4", "ovs_interfaceid": "f59675e3-d424-46f3-b3ef-ea1133f0aafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37_resize/disk /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-6289a311-85e3-4bb8-9170-26a7ef8d9509 req-bfa615e0-5025-4907-89df-c0aedeef86f0 service nova] Releasing lock "refresh_cache-391b2d43-3c9d-42db-bfae-09e8410bf367" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:03:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] CMD "cp -r /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37_resize/disk /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk" returned: 0 in 0.477s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37_resize/disk.info /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk.info {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] CMD "cp -r /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37_resize/disk.info /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk.info" returned: 0 in 0.033s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:47 user nova-compute[72766]: DEBUG nova.compute.manager [req-3d24e4cf-ec58-4807-b793-d224857abc83 req-10cb8ab1-f760-4961-bf2a-df2d0e19d085 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Received event network-vif-plugged-8e7e311b-453d-4e17-9652-45723c7a2944 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:03:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-3d24e4cf-ec58-4807-b793-d224857abc83 req-10cb8ab1-f760-4961-bf2a-df2d0e19d085 service nova] Acquiring lock "78f02883-99a1-493d-b6be-e43500bfba37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-3d24e4cf-ec58-4807-b793-d224857abc83 req-10cb8ab1-f760-4961-bf2a-df2d0e19d085 service nova] Lock "78f02883-99a1-493d-b6be-e43500bfba37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-3d24e4cf-ec58-4807-b793-d224857abc83 req-10cb8ab1-f760-4961-bf2a-df2d0e19d085 service nova] Lock "78f02883-99a1-493d-b6be-e43500bfba37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:47 user nova-compute[72766]: DEBUG nova.compute.manager [req-3d24e4cf-ec58-4807-b793-d224857abc83 req-10cb8ab1-f760-4961-bf2a-df2d0e19d085 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] No waiting events found dispatching network-vif-plugged-8e7e311b-453d-4e17-9652-45723c7a2944 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:03:47 user nova-compute[72766]: WARNING nova.compute.manager [req-3d24e4cf-ec58-4807-b793-d224857abc83 req-10cb8ab1-f760-4961-bf2a-df2d0e19d085 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Received unexpected event network-vif-plugged-8e7e311b-453d-4e17-9652-45723c7a2944 for instance with vm_state active and task_state resize_migrating.
Aug 14 23:03:48 user nova-compute[72766]: DEBUG nova.network.neutron [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Port 8e7e311b-453d-4e17-9652-45723c7a2944 binding to destination host user is already ACTIVE {{(pid=72766) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 14 23:03:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Acquiring lock "78f02883-99a1-493d-b6be-e43500bfba37-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "78f02883-99a1-493d-b6be-e43500bfba37-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "78f02883-99a1-493d-b6be-e43500bfba37-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Acquiring lock "refresh_cache-78f02883-99a1-493d-b6be-e43500bfba37" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:03:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Acquired lock "refresh_cache-78f02883-99a1-493d-b6be-e43500bfba37" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:03:48 user nova-compute[72766]: DEBUG nova.network.neutron [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:03:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Acquiring lock "391b2d43-3c9d-42db-bfae-09e8410bf367" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Acquiring lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:48 user nova-compute[72766]: INFO nova.compute.manager [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Terminating instance
Aug 14 23:03:48 user nova-compute[72766]: DEBUG nova.compute.manager [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:03:48 user nova-compute[72766]: DEBUG nova.network.neutron [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Updating instance_info_cache with network_info: [{"id": "8e7e311b-453d-4e17-9652-45723c7a2944", "address": "fa:16:3e:7e:31:c1", "network": {"id": "c07935db-7a05-49df-a504-682549f30d55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-765423768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ff897ef00ec45258b22d76ca60447fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e7e311b-45", "ovs_interfaceid": "8e7e311b-453d-4e17-9652-45723c7a2944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:03:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Releasing lock "refresh_cache-78f02883-99a1-493d-b6be-e43500bfba37" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:03:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG os_brick.utils [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[138eb914-c2fd-4c14-9042-a249400f17a5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14b45d3-5a99-4bd3-bffd-fc0a7a8e4643]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b135265-1d74-415e-bdbb-ccf868313091]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2368b9a7-8e2e-4e56-bf77-fdb1cb521b87]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG nova.compute.manager [req-a5881b66-5bc6-44d9-a4ef-07690b90aa34 req-a9d19ae6-8767-4a96-a512-4215645f10f4 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-vif-unplugged-a084e92b-2287-4ac4-a9a5-db86f3d3249e {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a5881b66-5bc6-44d9-a4ef-07690b90aa34 req-a9d19ae6-8767-4a96-a512-4215645f10f4 service nova] Acquiring lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a5881b66-5bc6-44d9-a4ef-07690b90aa34 req-a9d19ae6-8767-4a96-a512-4215645f10f4 service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a5881b66-5bc6-44d9-a4ef-07690b90aa34 req-a9d19ae6-8767-4a96-a512-4215645f10f4 service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG nova.compute.manager [req-a5881b66-5bc6-44d9-a4ef-07690b90aa34 req-a9d19ae6-8767-4a96-a512-4215645f10f4 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] No waiting events found dispatching network-vif-unplugged-a084e92b-2287-4ac4-a9a5-db86f3d3249e {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG nova.compute.manager [req-a5881b66-5bc6-44d9-a4ef-07690b90aa34 req-a9d19ae6-8767-4a96-a512-4215645f10f4 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-vif-unplugged-a084e92b-2287-4ac4-a9a5-db86f3d3249e for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:03:49 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 23:03:49 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[9606300f-c89f-4d4a-a69e-c798e8bf37d5]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG os_brick.utils [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG nova.compute.manager [req-11a620e8-fe1e-4847-81dc-4e268a55e312 req-bd31e364-ccd8-4a14-8b01-4e6605ef06b6 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-vif-unplugged-c48d46cf-70b1-408c-aee6-8965fb8356b0 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-11a620e8-fe1e-4847-81dc-4e268a55e312 req-bd31e364-ccd8-4a14-8b01-4e6605ef06b6 service nova] Acquiring lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-11a620e8-fe1e-4847-81dc-4e268a55e312 req-bd31e364-ccd8-4a14-8b01-4e6605ef06b6 service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-11a620e8-fe1e-4847-81dc-4e268a55e312 req-bd31e364-ccd8-4a14-8b01-4e6605ef06b6 service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG nova.compute.manager [req-11a620e8-fe1e-4847-81dc-4e268a55e312 req-bd31e364-ccd8-4a14-8b01-4e6605ef06b6 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] No waiting events found dispatching network-vif-unplugged-c48d46cf-70b1-408c-aee6-8965fb8356b0 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG nova.compute.manager [req-11a620e8-fe1e-4847-81dc-4e268a55e312 req-bd31e364-ccd8-4a14-8b01-4e6605ef06b6 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-vif-unplugged-c48d46cf-70b1-408c-aee6-8965fb8356b0 for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG nova.compute.manager [req-7c944b97-ba08-472a-899a-6858e13c6fda req-a2042bfd-4c61-4e5d-b930-96b19d83d9f9 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-vif-unplugged-458b086a-58f5-451f-936d-6f64a04ad64e {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7c944b97-ba08-472a-899a-6858e13c6fda req-a2042bfd-4c61-4e5d-b930-96b19d83d9f9 service nova] Acquiring lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7c944b97-ba08-472a-899a-6858e13c6fda req-a2042bfd-4c61-4e5d-b930-96b19d83d9f9 service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7c944b97-ba08-472a-899a-6858e13c6fda req-a2042bfd-4c61-4e5d-b930-96b19d83d9f9 service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG nova.compute.manager [req-7c944b97-ba08-472a-899a-6858e13c6fda req-a2042bfd-4c61-4e5d-b930-96b19d83d9f9 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] No waiting events found dispatching network-vif-unplugged-458b086a-58f5-451f-936d-6f64a04ad64e {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG nova.compute.manager [req-7c944b97-ba08-472a-899a-6858e13c6fda req-a2042bfd-4c61-4e5d-b930-96b19d83d9f9 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-vif-unplugged-458b086a-58f5-451f-936d-6f64a04ad64e for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG nova.compute.manager [req-7c944b97-ba08-472a-899a-6858e13c6fda req-a2042bfd-4c61-4e5d-b930-96b19d83d9f9 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-vif-plugged-458b086a-58f5-451f-936d-6f64a04ad64e {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7c944b97-ba08-472a-899a-6858e13c6fda req-a2042bfd-4c61-4e5d-b930-96b19d83d9f9 service nova] Acquiring lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7c944b97-ba08-472a-899a-6858e13c6fda req-a2042bfd-4c61-4e5d-b930-96b19d83d9f9 service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7c944b97-ba08-472a-899a-6858e13c6fda req-a2042bfd-4c61-4e5d-b930-96b19d83d9f9 service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG nova.compute.manager [req-7c944b97-ba08-472a-899a-6858e13c6fda req-a2042bfd-4c61-4e5d-b930-96b19d83d9f9 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] No waiting events found dispatching network-vif-plugged-458b086a-58f5-451f-936d-6f64a04ad64e {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:03:49 user nova-compute[72766]: WARNING nova.compute.manager [req-7c944b97-ba08-472a-899a-6858e13c6fda req-a2042bfd-4c61-4e5d-b930-96b19d83d9f9 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received unexpected event network-vif-plugged-458b086a-58f5-451f-936d-6f64a04ad64e for instance with vm_state active and task_state deleting.
Aug 14 23:03:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:50 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Instance destroyed successfully.
Aug 14 23:03:50 user nova-compute[72766]: DEBUG nova.objects.instance [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Lazy-loading 'resources' on Instance uuid 391b2d43-3c9d-42db-bfae-09e8410bf367 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:03:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T23:01:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2078583547',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2078583547',id=18,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIeZZqtRVtgPVn1pVBb8bZPh3xgGlgKuQl6LUe4EpbdgvvZq2gTC/Dde6ksrfSoAZ8dqUguj9bwBGfQBJwt8dG1Fz3CREGps5wEjWKM5cHptDNZeQ/tI1EzuLyzihw2M2Q==',key_name='tempest-keypair-643381431',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:02:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac6b2b6ac4b246ff90b646e9d1ffc9c8',ramdisk_id='',reservation_id='r-781x6k7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-627581418',owner_user_name='tempest-TaggedBootDevicesTest_v242-627581418-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:02:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d27477e14d64946a9ba1aa553b28ca3',uuid=391b2d43-3c9d-42db-bfae-09e8410bf367,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a084e92b-2287-4ac4-a9a5-db86f3d3249e", "address": "fa:16:3e:c1:4c:ad", "network": {"id": "480be190-a4a8-46bd-b68f-c9f2241cfd5f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-734889840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa084e92b-22", "ovs_interfaceid": "a084e92b-2287-4ac4-a9a5-db86f3d3249e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:03:50 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Converting VIF {"id": "a084e92b-2287-4ac4-a9a5-db86f3d3249e", "address": "fa:16:3e:c1:4c:ad", "network": {"id": "480be190-a4a8-46bd-b68f-c9f2241cfd5f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-734889840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa084e92b-22", "ovs_interfaceid": "a084e92b-2287-4ac4-a9a5-db86f3d3249e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:03:50 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:4c:ad,bridge_name='br-int',has_traffic_filtering=True,id=a084e92b-2287-4ac4-a9a5-db86f3d3249e,network=Network(480be190-a4a8-46bd-b68f-c9f2241cfd5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa084e92b-22') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:03:50 user nova-compute[72766]: DEBUG os_vif [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:4c:ad,bridge_name='br-int',has_traffic_filtering=True,id=a084e92b-2287-4ac4-a9a5-db86f3d3249e,network=Network(480be190-a4a8-46bd-b68f-c9f2241cfd5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa084e92b-22') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:03:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa084e92b-22, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:03:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:03:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:50 user nova-compute[72766]: INFO os_vif [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:4c:ad,bridge_name='br-int',has_traffic_filtering=True,id=a084e92b-2287-4ac4-a9a5-db86f3d3249e,network=Network(480be190-a4a8-46bd-b68f-c9f2241cfd5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa084e92b-22')
Aug 14 23:03:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T23:01:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2078583547',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2078583547',id=18,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIeZZqtRVtgPVn1pVBb8bZPh3xgGlgKuQl6LUe4EpbdgvvZq2gTC/Dde6ksrfSoAZ8dqUguj9bwBGfQBJwt8dG1Fz3CREGps5wEjWKM5cHptDNZeQ/tI1EzuLyzihw2M2Q==',key_name='tempest-keypair-643381431',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:02:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac6b2b6ac4b246ff90b646e9d1ffc9c8',ramdisk_id='',reservation_id='r-781x6k7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-627581418',owner_user_name='tempest-TaggedBootDevicesTest_v242-627581418-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:02:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d27477e14d64946a9ba1aa553b28ca3',uuid=391b2d43-3c9d-42db-bfae-09e8410bf367,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "458b086a-58f5-451f-936d-6f64a04ad64e", "address": "fa:16:3e:23:3a:7d", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap458b086a-58", "ovs_interfaceid": "458b086a-58f5-451f-936d-6f64a04ad64e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:03:50 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Converting VIF {"id": "458b086a-58f5-451f-936d-6f64a04ad64e", "address": "fa:16:3e:23:3a:7d", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap458b086a-58", "ovs_interfaceid": "458b086a-58f5-451f-936d-6f64a04ad64e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:03:50 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:3a:7d,bridge_name='br-int',has_traffic_filtering=True,id=458b086a-58f5-451f-936d-6f64a04ad64e,network=Network(0a345d47-5b12-4bbc-9e78-c6899871e7a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap458b086a-58') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:03:50 user nova-compute[72766]: DEBUG os_vif [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:3a:7d,bridge_name='br-int',has_traffic_filtering=True,id=458b086a-58f5-451f-936d-6f64a04ad64e,network=Network(0a345d47-5b12-4bbc-9e78-c6899871e7a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap458b086a-58') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:03:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap458b086a-58, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:03:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:03:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:50 user nova-compute[72766]: INFO os_vif [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:3a:7d,bridge_name='br-int',has_traffic_filtering=True,id=458b086a-58f5-451f-936d-6f64a04ad64e,network=Network(0a345d47-5b12-4bbc-9e78-c6899871e7a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap458b086a-58')
Aug 14 23:03:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T23:01:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2078583547',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2078583547',id=18,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIeZZqtRVtgPVn1pVBb8bZPh3xgGlgKuQl6LUe4EpbdgvvZq2gTC/Dde6ksrfSoAZ8dqUguj9bwBGfQBJwt8dG1Fz3CREGps5wEjWKM5cHptDNZeQ/tI1EzuLyzihw2M2Q==',key_name='tempest-keypair-643381431',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:02:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac6b2b6ac4b246ff90b646e9d1ffc9c8',ramdisk_id='',reservation_id='r-781x6k7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-627581418',owner_user_name='tempest-TaggedBootDevicesTest_v242-627581418-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:02:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d27477e14d64946a9ba1aa553b28ca3',uuid=391b2d43-3c9d-42db-bfae-09e8410bf367,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "437cdad2-00fb-4ac6-9fce-a67767cd4bda", "address": "fa:16:3e:29:78:c5", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap437cdad2-00", "ovs_interfaceid": "437cdad2-00fb-4ac6-9fce-a67767cd4bda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:03:50 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Converting VIF {"id": "437cdad2-00fb-4ac6-9fce-a67767cd4bda", "address": "fa:16:3e:29:78:c5", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap437cdad2-00", "ovs_interfaceid": "437cdad2-00fb-4ac6-9fce-a67767cd4bda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:03:50 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:78:c5,bridge_name='br-int',has_traffic_filtering=True,id=437cdad2-00fb-4ac6-9fce-a67767cd4bda,network=Network(0a345d47-5b12-4bbc-9e78-c6899871e7a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap437cdad2-00') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:03:50 user nova-compute[72766]: DEBUG os_vif [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:78:c5,bridge_name='br-int',has_traffic_filtering=True,id=437cdad2-00fb-4ac6-9fce-a67767cd4bda,network=Network(0a345d47-5b12-4bbc-9e78-c6899871e7a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap437cdad2-00') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:03:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap437cdad2-00, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:03:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:51 user nova-compute[72766]: INFO os_vif [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:78:c5,bridge_name='br-int',has_traffic_filtering=True,id=437cdad2-00fb-4ac6-9fce-a67767cd4bda,network=Network(0a345d47-5b12-4bbc-9e78-c6899871e7a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap437cdad2-00')
Aug 14 23:03:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T23:01:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2078583547',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2078583547',id=18,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIeZZqtRVtgPVn1pVBb8bZPh3xgGlgKuQl6LUe4EpbdgvvZq2gTC/Dde6ksrfSoAZ8dqUguj9bwBGfQBJwt8dG1Fz3CREGps5wEjWKM5cHptDNZeQ/tI1EzuLyzihw2M2Q==',key_name='tempest-keypair-643381431',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:02:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac6b2b6ac4b246ff90b646e9d1ffc9c8',ramdisk_id='',reservation_id='r-781x6k7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-627581418',owner_user_name='tempest-TaggedBootDevicesTest_v242-627581418-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:02:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d27477e14d64946a9ba1aa553b28ca3',uuid=391b2d43-3c9d-42db-bfae-09e8410bf367,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c48d46cf-70b1-408c-aee6-8965fb8356b0", "address": "fa:16:3e:23:98:99", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48d46cf-70", "ovs_interfaceid": "c48d46cf-70b1-408c-aee6-8965fb8356b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Converting VIF {"id": "c48d46cf-70b1-408c-aee6-8965fb8356b0", "address": "fa:16:3e:23:98:99", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48d46cf-70", "ovs_interfaceid": "c48d46cf-70b1-408c-aee6-8965fb8356b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:98:99,bridge_name='br-int',has_traffic_filtering=True,id=c48d46cf-70b1-408c-aee6-8965fb8356b0,network=Network(0a345d47-5b12-4bbc-9e78-c6899871e7a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc48d46cf-70') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_vif [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:98:99,bridge_name='br-int',has_traffic_filtering=True,id=c48d46cf-70b1-408c-aee6-8965fb8356b0,network=Network(0a345d47-5b12-4bbc-9e78-c6899871e7a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc48d46cf-70') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc48d46cf-70, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:51 user nova-compute[72766]: INFO os_vif [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:98:99,bridge_name='br-int',has_traffic_filtering=True,id=c48d46cf-70b1-408c-aee6-8965fb8356b0,network=Network(0a345d47-5b12-4bbc-9e78-c6899871e7a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc48d46cf-70')
Aug 14 23:03:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T23:01:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2078583547',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2078583547',id=18,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIeZZqtRVtgPVn1pVBb8bZPh3xgGlgKuQl6LUe4EpbdgvvZq2gTC/Dde6ksrfSoAZ8dqUguj9bwBGfQBJwt8dG1Fz3CREGps5wEjWKM5cHptDNZeQ/tI1EzuLyzihw2M2Q==',key_name='tempest-keypair-643381431',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:02:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac6b2b6ac4b246ff90b646e9d1ffc9c8',ramdisk_id='',reservation_id='r-781x6k7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-627581418',owner_user_name='tempest-TaggedBootDevicesTest_v242-627581418-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:02:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d27477e14d64946a9ba1aa553b28ca3',uuid=391b2d43-3c9d-42db-bfae-09e8410bf367,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e418f46c-a8f2-4cbe-b422-b8aad6f84236", "address": "fa:16:3e:5b:c8:16", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape418f46c-a8", "ovs_interfaceid": "e418f46c-a8f2-4cbe-b422-b8aad6f84236", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Converting VIF {"id": "e418f46c-a8f2-4cbe-b422-b8aad6f84236", "address": "fa:16:3e:5b:c8:16", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape418f46c-a8", "ovs_interfaceid": "e418f46c-a8f2-4cbe-b422-b8aad6f84236", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:c8:16,bridge_name='br-int',has_traffic_filtering=True,id=e418f46c-a8f2-4cbe-b422-b8aad6f84236,network=Network(0a345d47-5b12-4bbc-9e78-c6899871e7a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape418f46c-a8') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_vif [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:c8:16,bridge_name='br-int',has_traffic_filtering=True,id=e418f46c-a8f2-4cbe-b422-b8aad6f84236,network=Network(0a345d47-5b12-4bbc-9e78-c6899871e7a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape418f46c-a8') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape418f46c-a8, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:51 user nova-compute[72766]: INFO os_vif [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:c8:16,bridge_name='br-int',has_traffic_filtering=True,id=e418f46c-a8f2-4cbe-b422-b8aad6f84236,network=Network(0a345d47-5b12-4bbc-9e78-c6899871e7a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape418f46c-a8')
Aug 14 23:03:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T23:01:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2078583547',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2078583547',id=18,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIeZZqtRVtgPVn1pVBb8bZPh3xgGlgKuQl6LUe4EpbdgvvZq2gTC/Dde6ksrfSoAZ8dqUguj9bwBGfQBJwt8dG1Fz3CREGps5wEjWKM5cHptDNZeQ/tI1EzuLyzihw2M2Q==',key_name='tempest-keypair-643381431',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:02:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac6b2b6ac4b246ff90b646e9d1ffc9c8',ramdisk_id='',reservation_id='r-781x6k7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-627581418',owner_user_name='tempest-TaggedBootDevicesTest_v242-627581418-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:02:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d27477e14d64946a9ba1aa553b28ca3',uuid=391b2d43-3c9d-42db-bfae-09e8410bf367,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10cc8607-5dd0-4310-b2eb-ff4f5196573c", "address": "fa:16:3e:53:23:da", "network": {"id": "48e40549-72ed-45cc-ba38-e2155151f40c", "bridge": "br-int", "label": "tempest-device-tagging-net2-669256899", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10cc8607-5d", "ovs_interfaceid": "10cc8607-5dd0-4310-b2eb-ff4f5196573c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Converting VIF {"id": "10cc8607-5dd0-4310-b2eb-ff4f5196573c", "address": "fa:16:3e:53:23:da", "network": {"id": "48e40549-72ed-45cc-ba38-e2155151f40c", "bridge": "br-int", "label": "tempest-device-tagging-net2-669256899", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10cc8607-5d", "ovs_interfaceid": "10cc8607-5dd0-4310-b2eb-ff4f5196573c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:23:da,bridge_name='br-int',has_traffic_filtering=True,id=10cc8607-5dd0-4310-b2eb-ff4f5196573c,network=Network(48e40549-72ed-45cc-ba38-e2155151f40c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10cc8607-5d') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_vif [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:23:da,bridge_name='br-int',has_traffic_filtering=True,id=10cc8607-5dd0-4310-b2eb-ff4f5196573c,network=Network(48e40549-72ed-45cc-ba38-e2155151f40c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10cc8607-5d') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap10cc8607-5d, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:51 user nova-compute[72766]: INFO os_vif [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:23:da,bridge_name='br-int',has_traffic_filtering=True,id=10cc8607-5dd0-4310-b2eb-ff4f5196573c,network=Network(48e40549-72ed-45cc-ba38-e2155151f40c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10cc8607-5d')
Aug 14 23:03:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T23:01:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2078583547',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2078583547',id=18,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIeZZqtRVtgPVn1pVBb8bZPh3xgGlgKuQl6LUe4EpbdgvvZq2gTC/Dde6ksrfSoAZ8dqUguj9bwBGfQBJwt8dG1Fz3CREGps5wEjWKM5cHptDNZeQ/tI1EzuLyzihw2M2Q==',key_name='tempest-keypair-643381431',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:02:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac6b2b6ac4b246ff90b646e9d1ffc9c8',ramdisk_id='',reservation_id='r-781x6k7y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-627581418',owner_user_name='tempest-TaggedBootDevicesTest_v242-627581418-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:02:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d27477e14d64946a9ba1aa553b28ca3',uuid=391b2d43-3c9d-42db-bfae-09e8410bf367,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f59675e3-d424-46f3-b3ef-ea1133f0aafd", "address": "fa:16:3e:b3:a0:b6", "network": {"id": "48e40549-72ed-45cc-ba38-e2155151f40c", "bridge": "br-int", "label": "tempest-device-tagging-net2-669256899", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59675e3-d4", "ovs_interfaceid": "f59675e3-d424-46f3-b3ef-ea1133f0aafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Converting VIF {"id": "f59675e3-d424-46f3-b3ef-ea1133f0aafd", "address": "fa:16:3e:b3:a0:b6", "network": {"id": "48e40549-72ed-45cc-ba38-e2155151f40c", "bridge": "br-int", "label": "tempest-device-tagging-net2-669256899", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59675e3-d4", "ovs_interfaceid": "f59675e3-d424-46f3-b3ef-ea1133f0aafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:a0:b6,bridge_name='br-int',has_traffic_filtering=True,id=f59675e3-d424-46f3-b3ef-ea1133f0aafd,network=Network(48e40549-72ed-45cc-ba38-e2155151f40c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf59675e3-d4') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_vif [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:a0:b6,bridge_name='br-int',has_traffic_filtering=True,id=f59675e3-d424-46f3-b3ef-ea1133f0aafd,network=Network(48e40549-72ed-45cc-ba38-e2155151f40c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf59675e3-d4') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf59675e3-d4, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:03:51 user nova-compute[72766]: INFO os_vif [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:a0:b6,bridge_name='br-int',has_traffic_filtering=True,id=f59675e3-d424-46f3-b3ef-ea1133f0aafd,network=Network(48e40549-72ed-45cc-ba38-e2155151f40c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf59675e3-d4')
Aug 14 23:03:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BEbUFzqo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:03:51 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8883c586-543a-4d10-b7c1-2aa02f8c6df4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d6a491-c268-440a-9539-6129e9bb900f]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)
Aug 14 23:03:51 user nova-compute[72766]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 (non-flash)
Aug 14 23:03:51 user nova-compute[72766]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 (non-flash)
Aug 14 23:03:51 user nova-compute[72766]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 23:03:51 user nova-compute[72766]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:03:51 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)
Aug 14 23:03:51 user nova-compute[72766]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 (non-flash)
Aug 14 23:03:51 user nova-compute[72766]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 (non-flash)
Aug 14 23:03:51 user nova-compute[72766]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 23:03:51 user nova-compute[72766]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:03:51 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff16c0eeb00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2'): ({'sdc'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Removing single pathed devices sdc {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c44d216-0b68-4e7c-8b7f-51603be9182a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG nova.compute.manager [req-a3bb49b7-7468-4905-8ec7-aefb17a184ec req-e24f75f9-98f2-4a0e-8fb9-3c1cfa13873c service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-vif-plugged-a084e92b-2287-4ac4-a9a5-db86f3d3249e {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a3bb49b7-7468-4905-8ec7-aefb17a184ec req-e24f75f9-98f2-4a0e-8fb9-3c1cfa13873c service nova] Acquiring lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a3bb49b7-7468-4905-8ec7-aefb17a184ec req-e24f75f9-98f2-4a0e-8fb9-3c1cfa13873c service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a3bb49b7-7468-4905-8ec7-aefb17a184ec req-e24f75f9-98f2-4a0e-8fb9-3c1cfa13873c service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG nova.compute.manager [req-a3bb49b7-7468-4905-8ec7-aefb17a184ec req-e24f75f9-98f2-4a0e-8fb9-3c1cfa13873c service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] No waiting events found dispatching network-vif-plugged-a084e92b-2287-4ac4-a9a5-db86f3d3249e {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:03:51 user nova-compute[72766]: WARNING nova.compute.manager [req-a3bb49b7-7468-4905-8ec7-aefb17a184ec req-e24f75f9-98f2-4a0e-8fb9-3c1cfa13873c service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received unexpected event network-vif-plugged-a084e92b-2287-4ac4-a9a5-db86f3d3249e for instance with vm_state active and task_state deleting.
Aug 14 23:03:51 user nova-compute[72766]: DEBUG nova.compute.manager [req-a3bb49b7-7468-4905-8ec7-aefb17a184ec req-e24f75f9-98f2-4a0e-8fb9-3c1cfa13873c service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-vif-unplugged-437cdad2-00fb-4ac6-9fce-a67767cd4bda {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a3bb49b7-7468-4905-8ec7-aefb17a184ec req-e24f75f9-98f2-4a0e-8fb9-3c1cfa13873c service nova] Acquiring lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a3bb49b7-7468-4905-8ec7-aefb17a184ec req-e24f75f9-98f2-4a0e-8fb9-3c1cfa13873c service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a3bb49b7-7468-4905-8ec7-aefb17a184ec req-e24f75f9-98f2-4a0e-8fb9-3c1cfa13873c service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG nova.compute.manager [req-a3bb49b7-7468-4905-8ec7-aefb17a184ec req-e24f75f9-98f2-4a0e-8fb9-3c1cfa13873c service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] No waiting events found dispatching network-vif-unplugged-437cdad2-00fb-4ac6-9fce-a67767cd4bda {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG nova.compute.manager [req-a3bb49b7-7468-4905-8ec7-aefb17a184ec req-e24f75f9-98f2-4a0e-8fb9-3c1cfa13873c service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-vif-unplugged-437cdad2-00fb-4ac6-9fce-a67767cd4bda for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG nova.compute.manager [req-a3bb49b7-7468-4905-8ec7-aefb17a184ec req-e24f75f9-98f2-4a0e-8fb9-3c1cfa13873c service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-vif-plugged-437cdad2-00fb-4ac6-9fce-a67767cd4bda {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a3bb49b7-7468-4905-8ec7-aefb17a184ec req-e24f75f9-98f2-4a0e-8fb9-3c1cfa13873c service nova] Acquiring lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a3bb49b7-7468-4905-8ec7-aefb17a184ec req-e24f75f9-98f2-4a0e-8fb9-3c1cfa13873c service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a3bb49b7-7468-4905-8ec7-aefb17a184ec req-e24f75f9-98f2-4a0e-8fb9-3c1cfa13873c service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG nova.compute.manager [req-a3bb49b7-7468-4905-8ec7-aefb17a184ec req-e24f75f9-98f2-4a0e-8fb9-3c1cfa13873c service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] No waiting events found dispatching network-vif-plugged-437cdad2-00fb-4ac6-9fce-a67767cd4bda {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:03:51 user nova-compute[72766]: WARNING nova.compute.manager [req-a3bb49b7-7468-4905-8ec7-aefb17a184ec req-e24f75f9-98f2-4a0e-8fb9-3c1cfa13873c service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received unexpected event network-vif-plugged-437cdad2-00fb-4ac6-9fce-a67767cd4bda for instance with vm_state active and task_state deleting.
Aug 14 23:03:51 user nova-compute[72766]: DEBUG nova.compute.manager [req-a3bb49b7-7468-4905-8ec7-aefb17a184ec req-e24f75f9-98f2-4a0e-8fb9-3c1cfa13873c service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-vif-unplugged-10cc8607-5dd0-4310-b2eb-ff4f5196573c {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a3bb49b7-7468-4905-8ec7-aefb17a184ec req-e24f75f9-98f2-4a0e-8fb9-3c1cfa13873c service nova] Acquiring lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a3bb49b7-7468-4905-8ec7-aefb17a184ec req-e24f75f9-98f2-4a0e-8fb9-3c1cfa13873c service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a3bb49b7-7468-4905-8ec7-aefb17a184ec req-e24f75f9-98f2-4a0e-8fb9-3c1cfa13873c service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG nova.compute.manager [req-a3bb49b7-7468-4905-8ec7-aefb17a184ec req-e24f75f9-98f2-4a0e-8fb9-3c1cfa13873c service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] No waiting events found dispatching network-vif-unplugged-10cc8607-5dd0-4310-b2eb-ff4f5196573c {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG nova.compute.manager [req-a3bb49b7-7468-4905-8ec7-aefb17a184ec req-e24f75f9-98f2-4a0e-8fb9-3c1cfa13873c service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-vif-unplugged-10cc8607-5dd0-4310-b2eb-ff4f5196573c for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e173fb2e-0a85-4d7a-95ee-74014a7b21d7]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Flushing IO for device /dev/sdc {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cee0fd-254f-48dc-b49f-c6c589e1eaff]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[781266f1-9c47-4642-98c3-176a25372d67]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] SCSI volumes sdc have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[7afb8015-5669-4f73-b59b-70f823bfc156]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff58e173-7f14-4575-8017-4cb7bf8a2fc1]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2, portal: 172.16.0.220,3260]
Aug 14 23:03:51 user nova-compute[72766]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2, portal: 172.16.0.220,3260] successful.
Aug 14 23:03:51 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eb7475f-1d6e-4bfc-a7d7-ee6bf38500c2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c56467-9aaa-438b-8ba6-3351620c83e7]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] <== disconnect_volume: return (328ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JLaPGNmC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:03:51 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8008c6ae-505f-40bd-bff1-eaddfd91ca6b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29ccae9-8b1d-4310-a561-cfd04f9c86ab]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)
Aug 14 23:03:51 user nova-compute[72766]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 (non-flash)
Aug 14 23:03:51 user nova-compute[72766]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 23:03:51 user nova-compute[72766]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:03:51 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)
Aug 14 23:03:51 user nova-compute[72766]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 (non-flash)
Aug 14 23:03:51 user nova-compute[72766]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 23:03:51 user nova-compute[72766]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:03:51 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff16c0eeb00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01'): ({'sdd'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Removing single pathed devices sdd {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[56547036-b396-4bba-9b47-94e94ebd14e1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3ac8a1-8c14-446f-b4f8-b0f9d36c3938]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Flushing IO for device /dev/sdd {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a083d9-f784-4bbf-bf61-4c57c185d092]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.064s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[647599b1-9958-4402-aea2-83c4fc9903b7]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] SCSI volumes sdd have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46ce457-9e77-470b-ab3d-039b30c09aa3]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG nova.compute.manager [req-7555666d-be17-4c39-9420-03ea94b44681 req-f1c0bc0e-fe72-44ec-8d88-b1a5ace0b27d service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-vif-plugged-c48d46cf-70b1-408c-aee6-8965fb8356b0 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7555666d-be17-4c39-9420-03ea94b44681 req-f1c0bc0e-fe72-44ec-8d88-b1a5ace0b27d service nova] Acquiring lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7555666d-be17-4c39-9420-03ea94b44681 req-f1c0bc0e-fe72-44ec-8d88-b1a5ace0b27d service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7555666d-be17-4c39-9420-03ea94b44681 req-f1c0bc0e-fe72-44ec-8d88-b1a5ace0b27d service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG nova.compute.manager [req-7555666d-be17-4c39-9420-03ea94b44681 req-f1c0bc0e-fe72-44ec-8d88-b1a5ace0b27d service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] No waiting events found dispatching network-vif-plugged-c48d46cf-70b1-408c-aee6-8965fb8356b0 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:03:51 user nova-compute[72766]: WARNING nova.compute.manager [req-7555666d-be17-4c39-9420-03ea94b44681 req-f1c0bc0e-fe72-44ec-8d88-b1a5ace0b27d service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received unexpected event network-vif-plugged-c48d46cf-70b1-408c-aee6-8965fb8356b0 for instance with vm_state active and task_state deleting.
Aug 14 23:03:51 user nova-compute[72766]: DEBUG nova.compute.manager [req-7555666d-be17-4c39-9420-03ea94b44681 req-f1c0bc0e-fe72-44ec-8d88-b1a5ace0b27d service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-vif-unplugged-e418f46c-a8f2-4cbe-b422-b8aad6f84236 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7555666d-be17-4c39-9420-03ea94b44681 req-f1c0bc0e-fe72-44ec-8d88-b1a5ace0b27d service nova] Acquiring lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7555666d-be17-4c39-9420-03ea94b44681 req-f1c0bc0e-fe72-44ec-8d88-b1a5ace0b27d service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7555666d-be17-4c39-9420-03ea94b44681 req-f1c0bc0e-fe72-44ec-8d88-b1a5ace0b27d service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG nova.compute.manager [req-7555666d-be17-4c39-9420-03ea94b44681 req-f1c0bc0e-fe72-44ec-8d88-b1a5ace0b27d service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] No waiting events found dispatching network-vif-unplugged-e418f46c-a8f2-4cbe-b422-b8aad6f84236 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG nova.compute.manager [req-7555666d-be17-4c39-9420-03ea94b44681 req-f1c0bc0e-fe72-44ec-8d88-b1a5ace0b27d service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-vif-unplugged-e418f46c-a8f2-4cbe-b422-b8aad6f84236 for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG nova.compute.manager [req-7555666d-be17-4c39-9420-03ea94b44681 req-f1c0bc0e-fe72-44ec-8d88-b1a5ace0b27d service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-vif-plugged-e418f46c-a8f2-4cbe-b422-b8aad6f84236 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7555666d-be17-4c39-9420-03ea94b44681 req-f1c0bc0e-fe72-44ec-8d88-b1a5ace0b27d service nova] Acquiring lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7555666d-be17-4c39-9420-03ea94b44681 req-f1c0bc0e-fe72-44ec-8d88-b1a5ace0b27d service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7555666d-be17-4c39-9420-03ea94b44681 req-f1c0bc0e-fe72-44ec-8d88-b1a5ace0b27d service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG nova.compute.manager [req-7555666d-be17-4c39-9420-03ea94b44681 req-f1c0bc0e-fe72-44ec-8d88-b1a5ace0b27d service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] No waiting events found dispatching network-vif-plugged-e418f46c-a8f2-4cbe-b422-b8aad6f84236 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:03:51 user nova-compute[72766]: WARNING nova.compute.manager [req-7555666d-be17-4c39-9420-03ea94b44681 req-f1c0bc0e-fe72-44ec-8d88-b1a5ace0b27d service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received unexpected event network-vif-plugged-e418f46c-a8f2-4cbe-b422-b8aad6f84236 for instance with vm_state active and task_state deleting.
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[77062d05-7f4e-443b-b3e5-7e81cfd4c0d6]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01, portal: 172.16.0.220,3260]
Aug 14 23:03:51 user nova-compute[72766]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01, portal: 172.16.0.220,3260] successful.
Aug 14 23:03:51 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70d02f68-0a90-4579-b065-d44fd4884b01 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[71aee4eb-fbf8-47d2-a038-3d43ae153900]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] <== disconnect_volume: return (337ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZEQyAdN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:03:51 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff105be6-2ddf-468a-aea1-cffdf16a3923]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[730a3ea3-040e-4bf3-861b-ee04d217ff5c]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)
Aug 14 23:03:51 user nova-compute[72766]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 23:03:51 user nova-compute[72766]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:03:51 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 (non-flash)
Aug 14 23:03:51 user nova-compute[72766]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 23:03:51 user nova-compute[72766]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:03:51 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff16c0eeb00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9'): ({'sdb'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Removing single pathed devices sdb {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b62c25a-8899-44ee-8bca-99714eea9e0b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af42df0-88d7-43e6-a921-049e49794113]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Flushing IO for device /dev/sdb {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[851de84f-808a-4af0-b9d4-61c61ed421de]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:03:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:52 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f724ab8-2de3-4e81-94bf-c3408d0d2772]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:52 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:03:52 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] SCSI volumes sdb have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:03:52 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:03:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:52 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[dddf4c0e-649a-4c1f-b1ce-aa6c3f602128]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:52 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:03:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:52 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[551be128-c7fa-4712-8eaa-520d455d1548]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:52 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9, portal: 172.16.0.220,3260]
Aug 14 23:03:52 user nova-compute[72766]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9, portal: 172.16.0.220,3260] successful.
Aug 14 23:03:52 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:03:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f56da68f-0792-4fe2-b21f-5a00a5c912b9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:52 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb8de76-cbbc-47cf-91d5-47e97a80cab1]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:52 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:03:52 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:03:52 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] <== disconnect_volume: return (304ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:03:52 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:03:52 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Deleting instance files /opt/stack/data/nova/instances/391b2d43-3c9d-42db-bfae-09e8410bf367_del
Aug 14 23:03:52 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Deletion of /opt/stack/data/nova/instances/391b2d43-3c9d-42db-bfae-09e8410bf367_del complete
Aug 14 23:03:52 user nova-compute[72766]: INFO nova.compute.manager [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Took 3.42 seconds to destroy the instance on the hypervisor.
Aug 14 23:03:52 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:03:52 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:03:52 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:03:53 user nova-compute[72766]: DEBUG nova.compute.manager [req-9912b2b9-7b7c-428f-8aaa-5c4318cd1f33 req-6bcd088e-6c74-431c-b834-67c6204c5dc8 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-vif-plugged-10cc8607-5dd0-4310-b2eb-ff4f5196573c {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:03:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9912b2b9-7b7c-428f-8aaa-5c4318cd1f33 req-6bcd088e-6c74-431c-b834-67c6204c5dc8 service nova] Acquiring lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9912b2b9-7b7c-428f-8aaa-5c4318cd1f33 req-6bcd088e-6c74-431c-b834-67c6204c5dc8 service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9912b2b9-7b7c-428f-8aaa-5c4318cd1f33 req-6bcd088e-6c74-431c-b834-67c6204c5dc8 service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:53 user nova-compute[72766]: DEBUG nova.compute.manager [req-9912b2b9-7b7c-428f-8aaa-5c4318cd1f33 req-6bcd088e-6c74-431c-b834-67c6204c5dc8 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] No waiting events found dispatching network-vif-plugged-10cc8607-5dd0-4310-b2eb-ff4f5196573c {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:03:53 user nova-compute[72766]: WARNING nova.compute.manager [req-9912b2b9-7b7c-428f-8aaa-5c4318cd1f33 req-6bcd088e-6c74-431c-b834-67c6204c5dc8 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received unexpected event network-vif-plugged-10cc8607-5dd0-4310-b2eb-ff4f5196573c for instance with vm_state active and task_state deleting.
Aug 14 23:03:53 user nova-compute[72766]: DEBUG nova.compute.manager [req-9912b2b9-7b7c-428f-8aaa-5c4318cd1f33 req-6bcd088e-6c74-431c-b834-67c6204c5dc8 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-vif-unplugged-f59675e3-d424-46f3-b3ef-ea1133f0aafd {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:03:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9912b2b9-7b7c-428f-8aaa-5c4318cd1f33 req-6bcd088e-6c74-431c-b834-67c6204c5dc8 service nova] Acquiring lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9912b2b9-7b7c-428f-8aaa-5c4318cd1f33 req-6bcd088e-6c74-431c-b834-67c6204c5dc8 service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9912b2b9-7b7c-428f-8aaa-5c4318cd1f33 req-6bcd088e-6c74-431c-b834-67c6204c5dc8 service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:53 user nova-compute[72766]: DEBUG nova.compute.manager [req-9912b2b9-7b7c-428f-8aaa-5c4318cd1f33 req-6bcd088e-6c74-431c-b834-67c6204c5dc8 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] No waiting events found dispatching network-vif-unplugged-f59675e3-d424-46f3-b3ef-ea1133f0aafd {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:03:53 user nova-compute[72766]: DEBUG nova.compute.manager [req-9912b2b9-7b7c-428f-8aaa-5c4318cd1f33 req-6bcd088e-6c74-431c-b834-67c6204c5dc8 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-vif-unplugged-f59675e3-d424-46f3-b3ef-ea1133f0aafd for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:03:53 user nova-compute[72766]: DEBUG nova.compute.manager [req-9912b2b9-7b7c-428f-8aaa-5c4318cd1f33 req-6bcd088e-6c74-431c-b834-67c6204c5dc8 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-vif-plugged-f59675e3-d424-46f3-b3ef-ea1133f0aafd {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:03:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9912b2b9-7b7c-428f-8aaa-5c4318cd1f33 req-6bcd088e-6c74-431c-b834-67c6204c5dc8 service nova] Acquiring lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9912b2b9-7b7c-428f-8aaa-5c4318cd1f33 req-6bcd088e-6c74-431c-b834-67c6204c5dc8 service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9912b2b9-7b7c-428f-8aaa-5c4318cd1f33 req-6bcd088e-6c74-431c-b834-67c6204c5dc8 service nova] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:53 user nova-compute[72766]: DEBUG nova.compute.manager [req-9912b2b9-7b7c-428f-8aaa-5c4318cd1f33 req-6bcd088e-6c74-431c-b834-67c6204c5dc8 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] No waiting events found dispatching network-vif-plugged-f59675e3-d424-46f3-b3ef-ea1133f0aafd {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:03:53 user nova-compute[72766]: WARNING nova.compute.manager [req-9912b2b9-7b7c-428f-8aaa-5c4318cd1f33 req-6bcd088e-6c74-431c-b834-67c6204c5dc8 service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received unexpected event network-vif-plugged-f59675e3-d424-46f3-b3ef-ea1133f0aafd for instance with vm_state active and task_state deleting.
Aug 14 23:03:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:54 user nova-compute[72766]: DEBUG nova.compute.manager [req-9f2cbdbf-8343-4858-a615-c778192f6b85 req-95e28b9b-9236-4bb7-9135-216e23cba63e service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-vif-deleted-a084e92b-2287-4ac4-a9a5-db86f3d3249e {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:03:54 user nova-compute[72766]: INFO nova.compute.manager [req-9f2cbdbf-8343-4858-a615-c778192f6b85 req-95e28b9b-9236-4bb7-9135-216e23cba63e service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Neutron deleted interface a084e92b-2287-4ac4-a9a5-db86f3d3249e; detaching it from the instance and deleting it from the info cache
Aug 14 23:03:54 user nova-compute[72766]: DEBUG nova.network.neutron [req-9f2cbdbf-8343-4858-a615-c778192f6b85 req-95e28b9b-9236-4bb7-9135-216e23cba63e service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Updating instance_info_cache with network_info: [{"id": "458b086a-58f5-451f-936d-6f64a04ad64e", "address": "fa:16:3e:23:3a:7d", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap458b086a-58", "ovs_interfaceid": "458b086a-58f5-451f-936d-6f64a04ad64e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "437cdad2-00fb-4ac6-9fce-a67767cd4bda", "address": "fa:16:3e:29:78:c5", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap437cdad2-00", "ovs_interfaceid": "437cdad2-00fb-4ac6-9fce-a67767cd4bda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c48d46cf-70b1-408c-aee6-8965fb8356b0", "address": "fa:16:3e:23:98:99", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48d46cf-70", "ovs_interfaceid": "c48d46cf-70b1-408c-aee6-8965fb8356b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e418f46c-a8f2-4cbe-b422-b8aad6f84236", "address": "fa:16:3e:5b:c8:16", "network": {"id": "0a345d47-5b12-4bbc-9e78-c6899871e7a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-593449009", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape418f46c-a8", "ovs_interfaceid": "e418f46c-a8f2-4cbe-b422-b8aad6f84236", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10cc8607-5dd0-4310-b2eb-ff4f5196573c", "address": "fa:16:3e:53:23:da", "network": {"id": "48e40549-72ed-45cc-ba38-e2155151f40c", "bridge": "br-int", "label": "tempest-device-tagging-net2-669256899", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10cc8607-5d", "ovs_interfaceid": "10cc8607-5dd0-4310-b2eb-ff4f5196573c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f59675e3-d424-46f3-b3ef-ea1133f0aafd", "address": "fa:16:3e:b3:a0:b6", "network": {"id": "48e40549-72ed-45cc-ba38-e2155151f40c", "bridge": "br-int", "label": "tempest-device-tagging-net2-669256899", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac6b2b6ac4b246ff90b646e9d1ffc9c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59675e3-d4", "ovs_interfaceid": "f59675e3-d424-46f3-b3ef-ea1133f0aafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:03:54 user nova-compute[72766]: DEBUG nova.compute.manager [req-9f2cbdbf-8343-4858-a615-c778192f6b85 req-95e28b9b-9236-4bb7-9135-216e23cba63e service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Detach interface failed, port_id=a084e92b-2287-4ac4-a9a5-db86f3d3249e, reason: Instance 391b2d43-3c9d-42db-bfae-09e8410bf367 could not be found. {{(pid=72766) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 23:03:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquiring lock "11e79581-a122-4c0a-8485-a8b6c62e73b8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "11e79581-a122-4c0a-8485-a8b6c62e73b8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 23:03:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:55 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 23:03:55 user nova-compute[72766]: INFO nova.compute.claims [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Claim successful on node user
Aug 14 23:03:55 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:03:55 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:03:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:55 user nova-compute[72766]: DEBUG nova.compute.manager [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 23:03:55 user nova-compute[72766]: DEBUG nova.compute.manager [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 23:03:55 user nova-compute[72766]: DEBUG nova.network.neutron [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 23:03:55 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 23:03:55 user nova-compute[72766]: DEBUG nova.compute.manager [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 23:03:55 user nova-compute[72766]: DEBUG nova.policy [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb167893135e4073928a60630ae7720c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36bd126bda43c6971bccdef2b1da91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 23:03:55 user nova-compute[72766]: DEBUG nova.compute.manager [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 23:03:55 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 23:03:55 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Creating image(s)
Aug 14 23:03:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquiring lock "/opt/stack/data/nova/instances/11e79581-a122-4c0a-8485-a8b6c62e73b8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "/opt/stack/data/nova/instances/11e79581-a122-4c0a-8485-a8b6c62e73b8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "/opt/stack/data/nova/instances/11e79581-a122-4c0a-8485-a8b6c62e73b8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:55 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:55 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.191s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquiring lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:55 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.172s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/11e79581-a122-4c0a-8485-a8b6c62e73b8/disk 1073741824 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/11e79581-a122-4c0a-8485-a8b6c62e73b8/disk 1073741824" returned: 0 in 0.066s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:56 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:03:56 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Took 4.09 seconds to deallocate network for instance.
Aug 14 23:03:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.200s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:56 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Checking if we can resize image /opt/stack/data/nova/instances/11e79581-a122-4c0a-8485-a8b6c62e73b8/disk. size=1073741824 {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 23:03:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e79581-a122-4c0a-8485-a8b6c62e73b8/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:56 user nova-compute[72766]: DEBUG nova.network.neutron [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Successfully created port: 0add7ef0-687d-4486-842d-2d07c0d26449 {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 23:03:56 user nova-compute[72766]: DEBUG nova.compute.manager [req-174ad7e4-2b4a-451d-b755-1af7873adc09 req-088ce4b9-c3f8-409d-9e90-baa489baf98a service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-vif-deleted-c48d46cf-70b1-408c-aee6-8965fb8356b0 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:03:56 user nova-compute[72766]: DEBUG nova.compute.manager [req-174ad7e4-2b4a-451d-b755-1af7873adc09 req-088ce4b9-c3f8-409d-9e90-baa489baf98a service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-vif-deleted-10cc8607-5dd0-4310-b2eb-ff4f5196573c {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:03:56 user nova-compute[72766]: DEBUG nova.compute.manager [req-174ad7e4-2b4a-451d-b755-1af7873adc09 req-088ce4b9-c3f8-409d-9e90-baa489baf98a service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-vif-deleted-f59675e3-d424-46f3-b3ef-ea1133f0aafd {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:03:56 user nova-compute[72766]: DEBUG nova.compute.manager [req-174ad7e4-2b4a-451d-b755-1af7873adc09 req-088ce4b9-c3f8-409d-9e90-baa489baf98a service nova] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Received event network-vif-deleted-e418f46c-a8f2-4cbe-b422-b8aad6f84236 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:03:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e79581-a122-4c0a-8485-a8b6c62e73b8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:56 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Cannot resize image /opt/stack/data/nova/instances/11e79581-a122-4c0a-8485-a8b6c62e73b8/disk to a smaller size. {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 23:03:56 user nova-compute[72766]: DEBUG nova.objects.instance [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lazy-loading 'migration_context' on Instance uuid 11e79581-a122-4c0a-8485-a8b6c62e73b8 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:03:56 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 23:03:56 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Ensure instance console log exists: /opt/stack/data/nova/instances/11e79581-a122-4c0a-8485-a8b6c62e73b8/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 23:03:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG nova.network.neutron [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Successfully updated port: 0add7ef0-687d-4486-842d-2d07c0d26449 {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquiring lock "refresh_cache-11e79581-a122-4c0a-8485-a8b6c62e73b8" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquired lock "refresh_cache-11e79581-a122-4c0a-8485-a8b6c62e73b8" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG nova.network.neutron [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG nova.compute.manager [req-cc7fbb1d-2cd3-476a-b89f-b98e229b2ddd req-f5ba7569-ae4f-4d63-b38b-3fcc8c44afbb service nova] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Received event network-changed-0add7ef0-687d-4486-842d-2d07c0d26449 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG nova.compute.manager [req-cc7fbb1d-2cd3-476a-b89f-b98e229b2ddd req-f5ba7569-ae4f-4d63-b38b-3fcc8c44afbb service nova] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Refreshing instance network info cache due to event network-changed-0add7ef0-687d-4486-842d-2d07c0d26449. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-cc7fbb1d-2cd3-476a-b89f-b98e229b2ddd req-f5ba7569-ae4f-4d63-b38b-3fcc8c44afbb service nova] Acquiring lock "refresh_cache-11e79581-a122-4c0a-8485-a8b6c62e73b8" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG nova.network.neutron [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG nova.network.neutron [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Updating instance_info_cache with network_info: [{"id": "0add7ef0-687d-4486-842d-2d07c0d26449", "address": "fa:16:3e:4a:df:6f", "network": {"id": "ed86b27c-3e64-4c0a-8824-9bf68068058a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-506861998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f36bd126bda43c6971bccdef2b1da91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0add7ef0-68", "ovs_interfaceid": "0add7ef0-687d-4486-842d-2d07c0d26449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Releasing lock "refresh_cache-11e79581-a122-4c0a-8485-a8b6c62e73b8" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG nova.compute.manager [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Instance network_info: |[{"id": "0add7ef0-687d-4486-842d-2d07c0d26449", "address": "fa:16:3e:4a:df:6f", "network": {"id": "ed86b27c-3e64-4c0a-8824-9bf68068058a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-506861998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f36bd126bda43c6971bccdef2b1da91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0add7ef0-68", "ovs_interfaceid": "0add7ef0-687d-4486-842d-2d07c0d26449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-cc7fbb1d-2cd3-476a-b89f-b98e229b2ddd req-f5ba7569-ae4f-4d63-b38b-3fcc8c44afbb service nova] Acquired lock "refresh_cache-11e79581-a122-4c0a-8485-a8b6c62e73b8" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG nova.network.neutron [req-cc7fbb1d-2cd3-476a-b89f-b98e229b2ddd req-f5ba7569-ae4f-4d63-b38b-3fcc8c44afbb service nova] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Refreshing network info cache for port 0add7ef0-687d-4486-842d-2d07c0d26449 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Start _get_guest_xml network_info=[{"id": "0add7ef0-687d-4486-842d-2d07c0d26449", "address": "fa:16:3e:4a:df:6f", "network": {"id": "ed86b27c-3e64-4c0a-8824-9bf68068058a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-506861998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f36bd126bda43c6971bccdef2b1da91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0add7ef0-68", "ovs_interfaceid": "0add7ef0-687d-4486-842d-2d07c0d26449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd2900d30-2c4c-4d57-9135-d45564c0c596'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:03:57 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:03:57 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:03:57 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:03:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-584854465',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-584854465',id=23,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ44/tjV8BW1ypYMZmiG7D1vfWXeB7Xr0eiDzs39QKWPjJ4VdMwqyWoKm6vbKzV3JsMUSI4O8FCswMnuL0W/+R28XJlRiL9zGXvdMjiPnmfiDPuJEi6nWJYbgddxoV1TcA==',key_name='tempest-keypair-1485779782',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f36bd126bda43c6971bccdef2b1da91',ramdisk_id='',reservation_id='r-6wg52w6r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1828708750',owner_user_name='tempest-AttachVolumeShelveTestJSON-1828708750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:03:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb167893135e4073928a60630ae7720c',uuid=11e79581-a122-4c0a-8485-a8b6c62e73b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0add7ef0-687d-4486-842d-2d07c0d26449", "address": "fa:16:3e:4a:df:6f", "network": {"id": "ed86b27c-3e64-4c0a-8824-9bf68068058a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-506861998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f36bd126bda43c6971bccdef2b1da91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0add7ef0-68", "ovs_interfaceid": "0add7ef0-687d-4486-842d-2d07c0d26449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Converting VIF {"id": "0add7ef0-687d-4486-842d-2d07c0d26449", "address": "fa:16:3e:4a:df:6f", "network": {"id": "ed86b27c-3e64-4c0a-8824-9bf68068058a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-506861998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f36bd126bda43c6971bccdef2b1da91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0add7ef0-68", "ovs_interfaceid": "0add7ef0-687d-4486-842d-2d07c0d26449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:df:6f,bridge_name='br-int',has_traffic_filtering=True,id=0add7ef0-687d-4486-842d-2d07c0d26449,network=Network(ed86b27c-3e64-4c0a-8824-9bf68068058a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0add7ef0-68') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG nova.objects.instance [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lazy-loading 'pci_devices' on Instance uuid 11e79581-a122-4c0a-8485-a8b6c62e73b8 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:03:57 user nova-compute[72766]:   <uuid>11e79581-a122-4c0a-8485-a8b6c62e73b8</uuid>
Aug 14 23:03:57 user nova-compute[72766]:   <name>instance-00000017</name>
Aug 14 23:03:57 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:03:57 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:03:57 user nova-compute[72766]:   <metadata>
Aug 14 23:03:57 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:03:57 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:03:57 user nova-compute[72766]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-584854465</nova:name>
Aug 14 23:03:57 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:03:57</nova:creationTime>
Aug 14 23:03:57 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:03:57 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:03:57 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:03:57 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:03:57 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:03:57 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:03:57 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:03:57 user nova-compute[72766]:       <nova:owner>
Aug 14 23:03:57 user nova-compute[72766]:         <nova:user uuid="fb167893135e4073928a60630ae7720c">tempest-AttachVolumeShelveTestJSON-1828708750-project-member</nova:user>
Aug 14 23:03:57 user nova-compute[72766]:         <nova:project uuid="3f36bd126bda43c6971bccdef2b1da91">tempest-AttachVolumeShelveTestJSON-1828708750</nova:project>
Aug 14 23:03:57 user nova-compute[72766]:       </nova:owner>
Aug 14 23:03:57 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 23:03:57 user nova-compute[72766]:       <nova:ports>
Aug 14 23:03:57 user nova-compute[72766]:         <nova:port uuid="0add7ef0-687d-4486-842d-2d07c0d26449">
Aug 14 23:03:57 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 23:03:57 user nova-compute[72766]:         </nova:port>
Aug 14 23:03:57 user nova-compute[72766]:       </nova:ports>
Aug 14 23:03:57 user nova-compute[72766]:     </nova:instance>
Aug 14 23:03:57 user nova-compute[72766]:   </metadata>
Aug 14 23:03:57 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:03:57 user nova-compute[72766]:     <system>
Aug 14 23:03:57 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:03:57 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:03:57 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:03:57 user nova-compute[72766]:       <entry name="serial">11e79581-a122-4c0a-8485-a8b6c62e73b8</entry>
Aug 14 23:03:57 user nova-compute[72766]:       <entry name="uuid">11e79581-a122-4c0a-8485-a8b6c62e73b8</entry>
Aug 14 23:03:57 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:03:57 user nova-compute[72766]:     </system>
Aug 14 23:03:57 user nova-compute[72766]:   </sysinfo>
Aug 14 23:03:57 user nova-compute[72766]:   <os>
Aug 14 23:03:57 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:03:57 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:03:57 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:03:57 user nova-compute[72766]:   </os>
Aug 14 23:03:57 user nova-compute[72766]:   <features>
Aug 14 23:03:57 user nova-compute[72766]:     <acpi/>
Aug 14 23:03:57 user nova-compute[72766]:     <apic/>
Aug 14 23:03:57 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:03:57 user nova-compute[72766]:   </features>
Aug 14 23:03:57 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:03:57 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:03:57 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:03:57 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:03:57 user nova-compute[72766]:   </clock>
Aug 14 23:03:57 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:03:57 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:03:57 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:03:57 user nova-compute[72766]:   </cpu>
Aug 14 23:03:57 user nova-compute[72766]:   <devices>
Aug 14 23:03:57 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 23:03:57 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 23:03:57 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/11e79581-a122-4c0a-8485-a8b6c62e73b8/disk"/>
Aug 14 23:03:57 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:03:57 user nova-compute[72766]:     </disk>
Aug 14 23:03:57 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:03:57 user nova-compute[72766]:       <mac address="fa:16:3e:4a:df:6f"/>
Aug 14 23:03:57 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:03:57 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:03:57 user nova-compute[72766]:       <target dev="tap0add7ef0-68"/>
Aug 14 23:03:57 user nova-compute[72766]:     </interface>
Aug 14 23:03:57 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:03:57 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/11e79581-a122-4c0a-8485-a8b6c62e73b8/console.log" append="off"/>
Aug 14 23:03:57 user nova-compute[72766]:     </serial>
Aug 14 23:03:57 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:03:57 user nova-compute[72766]:     <video>
Aug 14 23:03:57 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:03:57 user nova-compute[72766]:     </video>
Aug 14 23:03:57 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:03:57 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:03:57 user nova-compute[72766]:     </rng>
Aug 14 23:03:57 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:03:57 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:03:57 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:03:57 user nova-compute[72766]:     </memballoon>
Aug 14 23:03:57 user nova-compute[72766]:   </devices>
Aug 14 23:03:57 user nova-compute[72766]: </domain>
Aug 14 23:03:57 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:03:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-584854465',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-584854465',id=23,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ44/tjV8BW1ypYMZmiG7D1vfWXeB7Xr0eiDzs39QKWPjJ4VdMwqyWoKm6vbKzV3JsMUSI4O8FCswMnuL0W/+R28XJlRiL9zGXvdMjiPnmfiDPuJEi6nWJYbgddxoV1TcA==',key_name='tempest-keypair-1485779782',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f36bd126bda43c6971bccdef2b1da91',ramdisk_id='',reservation_id='r-6wg52w6r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1828708750',owner_user_name='tempest-AttachVolumeShelveTestJSON-1828708750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:03:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb167893135e4073928a60630ae7720c',uuid=11e79581-a122-4c0a-8485-a8b6c62e73b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0add7ef0-687d-4486-842d-2d07c0d26449", "address": "fa:16:3e:4a:df:6f", "network": {"id": "ed86b27c-3e64-4c0a-8824-9bf68068058a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-506861998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f36bd126bda43c6971bccdef2b1da91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0add7ef0-68", "ovs_interfaceid": "0add7ef0-687d-4486-842d-2d07c0d26449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Converting VIF {"id": "0add7ef0-687d-4486-842d-2d07c0d26449", "address": "fa:16:3e:4a:df:6f", "network": {"id": "ed86b27c-3e64-4c0a-8824-9bf68068058a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-506861998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f36bd126bda43c6971bccdef2b1da91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0add7ef0-68", "ovs_interfaceid": "0add7ef0-687d-4486-842d-2d07c0d26449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:df:6f,bridge_name='br-int',has_traffic_filtering=True,id=0add7ef0-687d-4486-842d-2d07c0d26449,network=Network(ed86b27c-3e64-4c0a-8824-9bf68068058a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0add7ef0-68') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG os_vif [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:df:6f,bridge_name='br-int',has_traffic_filtering=True,id=0add7ef0-687d-4486-842d-2d07c0d26449,network=Network(ed86b27c-3e64-4c0a-8824-9bf68068058a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0add7ef0-68') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0add7ef0-68, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0add7ef0-68, col_values=(('external_ids', {'iface-id': '0add7ef0-687d-4486-842d-2d07c0d26449', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:df:6f', 'vm-uuid': '11e79581-a122-4c0a-8485-a8b6c62e73b8'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:57 user nova-compute[72766]: INFO os_vif [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:df:6f,bridge_name='br-int',has_traffic_filtering=True,id=0add7ef0-687d-4486-842d-2d07c0d26449,network=Network(ed86b27c-3e64-4c0a-8824-9bf68068058a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0add7ef0-68')
Aug 14 23:03:57 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:03:57 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] No VIF found with MAC fa:16:3e:4a:df:6f, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:03:58 user nova-compute[72766]: DEBUG nova.compute.manager [req-036bb7fe-aaeb-40d2-b20d-367064d2954c req-68630213-adaa-4dea-8e79-3fdd3ca707f5 service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Received event network-changed-bb47713e-54a8-4834-a78d-749c5f72f334 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:03:58 user nova-compute[72766]: DEBUG nova.compute.manager [req-036bb7fe-aaeb-40d2-b20d-367064d2954c req-68630213-adaa-4dea-8e79-3fdd3ca707f5 service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Refreshing instance network info cache due to event network-changed-bb47713e-54a8-4834-a78d-749c5f72f334. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:03:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-036bb7fe-aaeb-40d2-b20d-367064d2954c req-68630213-adaa-4dea-8e79-3fdd3ca707f5 service nova] Acquiring lock "refresh_cache-4d919875-5f24-4bed-bf26-cf437e0de3e2" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:03:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-036bb7fe-aaeb-40d2-b20d-367064d2954c req-68630213-adaa-4dea-8e79-3fdd3ca707f5 service nova] Acquired lock "refresh_cache-4d919875-5f24-4bed-bf26-cf437e0de3e2" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:03:58 user nova-compute[72766]: DEBUG nova.network.neutron [req-036bb7fe-aaeb-40d2-b20d-367064d2954c req-68630213-adaa-4dea-8e79-3fdd3ca707f5 service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Refreshing network info cache for port bb47713e-54a8-4834-a78d-749c5f72f334 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:03:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Acquiring lock "4d919875-5f24-4bed-bf26-cf437e0de3e2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Lock "4d919875-5f24-4bed-bf26-cf437e0de3e2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Acquiring lock "4d919875-5f24-4bed-bf26-cf437e0de3e2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Lock "4d919875-5f24-4bed-bf26-cf437e0de3e2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Lock "4d919875-5f24-4bed-bf26-cf437e0de3e2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:58 user nova-compute[72766]: INFO nova.compute.manager [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Terminating instance
Aug 14 23:03:58 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:03:58 user nova-compute[72766]: DEBUG nova.network.neutron [req-cc7fbb1d-2cd3-476a-b89f-b98e229b2ddd req-f5ba7569-ae4f-4d63-b38b-3fcc8c44afbb service nova] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Updated VIF entry in instance network info cache for port 0add7ef0-687d-4486-842d-2d07c0d26449. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:03:58 user nova-compute[72766]: DEBUG nova.network.neutron [req-cc7fbb1d-2cd3-476a-b89f-b98e229b2ddd req-f5ba7569-ae4f-4d63-b38b-3fcc8c44afbb service nova] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Updating instance_info_cache with network_info: [{"id": "0add7ef0-687d-4486-842d-2d07c0d26449", "address": "fa:16:3e:4a:df:6f", "network": {"id": "ed86b27c-3e64-4c0a-8824-9bf68068058a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-506861998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f36bd126bda43c6971bccdef2b1da91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0add7ef0-68", "ovs_interfaceid": "0add7ef0-687d-4486-842d-2d07c0d26449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:03:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-cc7fbb1d-2cd3-476a-b89f-b98e229b2ddd req-f5ba7569-ae4f-4d63-b38b-3fcc8c44afbb service nova] Releasing lock "refresh_cache-11e79581-a122-4c0a-8485-a8b6c62e73b8" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:03:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:58 user nova-compute[72766]: DEBUG nova.network.neutron [req-036bb7fe-aaeb-40d2-b20d-367064d2954c req-68630213-adaa-4dea-8e79-3fdd3ca707f5 service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Updated VIF entry in instance network info cache for port bb47713e-54a8-4834-a78d-749c5f72f334. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:03:58 user nova-compute[72766]: DEBUG nova.network.neutron [req-036bb7fe-aaeb-40d2-b20d-367064d2954c req-68630213-adaa-4dea-8e79-3fdd3ca707f5 service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Updating instance_info_cache with network_info: [{"id": "bb47713e-54a8-4834-a78d-749c5f72f334", "address": "fa:16:3e:34:a4:4f", "network": {"id": "b151d906-14b7-466f-909c-18c6b9f1855d", "bridge": "br-int", "label": "tempest-TestShelveInstance-664463668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71798c25948f4c8cb02664413314a4e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb47713e-54", "ovs_interfaceid": "bb47713e-54a8-4834-a78d-749c5f72f334", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:03:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-036bb7fe-aaeb-40d2-b20d-367064d2954c req-68630213-adaa-4dea-8e79-3fdd3ca707f5 service nova] Releasing lock "refresh_cache-4d919875-5f24-4bed-bf26-cf437e0de3e2" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:03:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:58 user nova-compute[72766]: INFO nova.compute.manager [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Took 2.53 seconds to detach 3 volumes for instance.
Aug 14 23:03:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.475s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:59 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Deleted allocations for instance 391b2d43-3c9d-42db-bfae-09e8410bf367
Aug 14 23:03:59 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Starting finish_migration {{(pid=72766) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Instance directory exists: not creating {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 23:03:59 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Creating image(s)
Aug 14 23:03:59 user nova-compute[72766]: DEBUG nova.objects.instance [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lazy-loading 'trusted_certs' on Instance uuid 78f02883-99a1-493d-b6be-e43500bfba37 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:03:59 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Instance destroyed successfully.
Aug 14 23:03:59 user nova-compute[72766]: DEBUG nova.objects.instance [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Lazy-loading 'resources' on Instance uuid 4d919875-5f24-4bed-bf26-cf437e0de3e2 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T22:58:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1732259896',display_name='tempest-TestShelveInstance-server-1732259896',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1732259896',id=12,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJttuZNcmSPPc5p7oQDHUy8DHRRj8VmSdgjSZwlMP/Wog2Lw20nrGzoNtOerf71zO0Z5VMVyCvpGcPQV7yHBlJjzeBcaszN5MzjHSpERf4DytlGuAt9s2fAouYBU+yBHwA==',key_name='tempest-TestShelveInstance-1877498323',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:02:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71798c25948f4c8cb02664413314a4e1',ramdisk_id='',reservation_id='r-yvm2m86y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1305179191',owner_user_name='tempest-TestShelveInstance-1305179191-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:02:40Z,user_data=None,user_id='d46f138a683742b09a91e1f10f085c18',uuid=4d919875-5f24-4bed-bf26-cf437e0de3e2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb47713e-54a8-4834-a78d-749c5f72f334", "address": "fa:16:3e:34:a4:4f", "network": {"id": "b151d906-14b7-466f-909c-18c6b9f1855d", "bridge": "br-int", "label": "tempest-TestShelveInstance-664463668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71798c25948f4c8cb02664413314a4e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb47713e-54", "ovs_interfaceid": "bb47713e-54a8-4834-a78d-749c5f72f334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Converting VIF {"id": "bb47713e-54a8-4834-a78d-749c5f72f334", "address": "fa:16:3e:34:a4:4f", "network": {"id": "b151d906-14b7-466f-909c-18c6b9f1855d", "bridge": "br-int", "label": "tempest-TestShelveInstance-664463668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71798c25948f4c8cb02664413314a4e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb47713e-54", "ovs_interfaceid": "bb47713e-54a8-4834-a78d-749c5f72f334", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:a4:4f,bridge_name='br-int',has_traffic_filtering=True,id=bb47713e-54a8-4834-a78d-749c5f72f334,network=Network(b151d906-14b7-466f-909c-18c6b9f1855d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb47713e-54') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG os_vif [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:a4:4f,bridge_name='br-int',has_traffic_filtering=True,id=bb47713e-54a8-4834-a78d-749c5f72f334,network=Network(b151d906-14b7-466f-909c-18c6b9f1855d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb47713e-54') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbb47713e-54, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-197e149d-e4c3-4356-b5a0-ef1f3b6c0218 tempest-TaggedBootDevicesTest_v242-627581418 tempest-TaggedBootDevicesTest_v242-627581418-project-member] Lock "391b2d43-3c9d-42db-bfae-09e8410bf367" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.815s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:03:59 user nova-compute[72766]: INFO os_vif [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:a4:4f,bridge_name='br-int',has_traffic_filtering=True,id=bb47713e-54a8-4834-a78d-749c5f72f334,network=Network(b151d906-14b7-466f-909c-18c6b9f1855d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb47713e-54')
Aug 14 23:03:59 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvezkmys', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:03:59 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:03:59 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.007s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f193da6-4f60-48c4-9c02-160801fda9cf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b054cd-d5e9-4b2a-928f-7158e2a2241a]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 23:03:59 user nova-compute[72766]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:03:59 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 (non-flash)
Aug 14 23:03:59 user nova-compute[72766]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:03:59 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff1543429e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886'): ({'sde'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Removing single pathed devices sde {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[da469bd8-6306-4dc9-abdc-a88d92942cec]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a8d137-e2cc-448a-a989-6f9ba8a5b54c]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Flushing IO for device /dev/sde {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.258s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Checking if we can resize image /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk. size=21474836480 {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e295e706-3ac0-46f6-a601-68fa57e28c85]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG nova.compute.manager [req-b9f3e2f9-b0b7-4f5a-96ca-bd00b92ddf07 req-94d66c49-fc04-46d3-befa-6269ac846e4e service nova] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Received event network-vif-plugged-0add7ef0-687d-4486-842d-2d07c0d26449 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-b9f3e2f9-b0b7-4f5a-96ca-bd00b92ddf07 req-94d66c49-fc04-46d3-befa-6269ac846e4e service nova] Acquiring lock "11e79581-a122-4c0a-8485-a8b6c62e73b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-b9f3e2f9-b0b7-4f5a-96ca-bd00b92ddf07 req-94d66c49-fc04-46d3-befa-6269ac846e4e service nova] Lock "11e79581-a122-4c0a-8485-a8b6c62e73b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-b9f3e2f9-b0b7-4f5a-96ca-bd00b92ddf07 req-94d66c49-fc04-46d3-befa-6269ac846e4e service nova] Lock "11e79581-a122-4c0a-8485-a8b6c62e73b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG nova.compute.manager [req-b9f3e2f9-b0b7-4f5a-96ca-bd00b92ddf07 req-94d66c49-fc04-46d3-befa-6269ac846e4e service nova] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] No waiting events found dispatching network-vif-plugged-0add7ef0-687d-4486-842d-2d07c0d26449 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:03:59 user nova-compute[72766]: WARNING nova.compute.manager [req-b9f3e2f9-b0b7-4f5a-96ca-bd00b92ddf07 req-94d66c49-fc04-46d3-befa-6269ac846e4e service nova] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Received unexpected event network-vif-plugged-0add7ef0-687d-4486-842d-2d07c0d26449 for instance with vm_state building and task_state spawning.
Aug 14 23:03:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[f627b626-01d7-4077-b24f-09a993dbabce]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] SCSI volumes sde have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d72b51-8319-4dd1-aee4-c63e73816df4]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:03:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[68514714-669d-4273-9a48-bfaaeb816ad6]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886, portal: 172.16.0.220,3260]
Aug 14 23:04:00 user nova-compute[72766]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886, portal: 172.16.0.220,3260] successful.
Aug 14 23:04:00 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk 21474836480 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc05004f-3360-4071-bd51-ce172fb18886 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bab5cc-f831-4497-a118-5a7f4eb8859e]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.410s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] <== disconnect_volume: return (417ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:04:00 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Deleting instance files /opt/stack/data/nova/instances/4d919875-5f24-4bed-bf26-cf437e0de3e2_del
Aug 14 23:04:00 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Deletion of /opt/stack/data/nova/instances/4d919875-5f24-4bed-bf26-cf437e0de3e2_del complete
Aug 14 23:04:00 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk 21474836480" returned: 0 in 0.069s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Did not create local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Ensure instance console log exists: /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Start _get_guest_xml network_info=[{"id": "8e7e311b-453d-4e17-9652-45723c7a2944", "address": "fa:16:3e:7e:31:c1", "network": {"id": "c07935db-7a05-49df-a504-682549f30d55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-765423768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-765423768-network", "vif_mac": "fa:16:3e:7e:31:c1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ff897ef00ec45258b22d76ca60447fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e7e311b-45", "ovs_interfaceid": "8e7e311b-453d-4e17-9652-45723c7a2944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd2900d30-2c4c-4d57-9135-d45564c0c596'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'bfd63a8b-c792-42bf-8a71-ac09e1881364', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eRHNEWri', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '78f02883-99a1-493d-b6be-e43500bfba37', 'attached_at': '2023-08-14T23:03:59.000000', 'detached_at': '', 'volume_id': '6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f', 'serial': '6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f'}, 'volume_type': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:00 user nova-compute[72766]: INFO nova.compute.manager [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Took 1.95 seconds to destroy the instance on the hypervisor.
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:04:00 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:04:00 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:04:00 user nova-compute[72766]: DEBUG nova.compute.manager [req-d104c0ab-c247-47e8-9680-afc63c2d0100 req-3730ec9d-8cd4-4a9c-a76e-fe5b84856beb service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Received event network-vif-unplugged-bb47713e-54a8-4834-a78d-749c5f72f334 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d104c0ab-c247-47e8-9680-afc63c2d0100 req-3730ec9d-8cd4-4a9c-a76e-fe5b84856beb service nova] Acquiring lock "4d919875-5f24-4bed-bf26-cf437e0de3e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d104c0ab-c247-47e8-9680-afc63c2d0100 req-3730ec9d-8cd4-4a9c-a76e-fe5b84856beb service nova] Lock "4d919875-5f24-4bed-bf26-cf437e0de3e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d104c0ab-c247-47e8-9680-afc63c2d0100 req-3730ec9d-8cd4-4a9c-a76e-fe5b84856beb service nova] Lock "4d919875-5f24-4bed-bf26-cf437e0de3e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG nova.compute.manager [req-d104c0ab-c247-47e8-9680-afc63c2d0100 req-3730ec9d-8cd4-4a9c-a76e-fe5b84856beb service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] No waiting events found dispatching network-vif-unplugged-bb47713e-54a8-4834-a78d-749c5f72f334 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG nova.compute.manager [req-d104c0ab-c247-47e8-9680-afc63c2d0100 req-3730ec9d-8cd4-4a9c-a76e-fe5b84856beb service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Received event network-vif-unplugged-bb47713e-54a8-4834-a78d-749c5f72f334 for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG nova.compute.manager [req-d104c0ab-c247-47e8-9680-afc63c2d0100 req-3730ec9d-8cd4-4a9c-a76e-fe5b84856beb service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Received event network-vif-plugged-bb47713e-54a8-4834-a78d-749c5f72f334 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d104c0ab-c247-47e8-9680-afc63c2d0100 req-3730ec9d-8cd4-4a9c-a76e-fe5b84856beb service nova] Acquiring lock "4d919875-5f24-4bed-bf26-cf437e0de3e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d104c0ab-c247-47e8-9680-afc63c2d0100 req-3730ec9d-8cd4-4a9c-a76e-fe5b84856beb service nova] Lock "4d919875-5f24-4bed-bf26-cf437e0de3e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d104c0ab-c247-47e8-9680-afc63c2d0100 req-3730ec9d-8cd4-4a9c-a76e-fe5b84856beb service nova] Lock "4d919875-5f24-4bed-bf26-cf437e0de3e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG nova.compute.manager [req-d104c0ab-c247-47e8-9680-afc63c2d0100 req-3730ec9d-8cd4-4a9c-a76e-fe5b84856beb service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] No waiting events found dispatching network-vif-plugged-bb47713e-54a8-4834-a78d-749c5f72f334 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:04:00 user nova-compute[72766]: WARNING nova.compute.manager [req-d104c0ab-c247-47e8-9680-afc63c2d0100 req-3730ec9d-8cd4-4a9c-a76e-fe5b84856beb service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Received unexpected event network-vif-plugged-bb47713e-54a8-4834-a78d-749c5f72f334 for instance with vm_state active and task_state deleting.
Aug 14 23:04:00 user nova-compute[72766]: DEBUG nova.compute.manager [req-d104c0ab-c247-47e8-9680-afc63c2d0100 req-3730ec9d-8cd4-4a9c-a76e-fe5b84856beb service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Received event network-vif-plugged-bb47713e-54a8-4834-a78d-749c5f72f334 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d104c0ab-c247-47e8-9680-afc63c2d0100 req-3730ec9d-8cd4-4a9c-a76e-fe5b84856beb service nova] Acquiring lock "4d919875-5f24-4bed-bf26-cf437e0de3e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d104c0ab-c247-47e8-9680-afc63c2d0100 req-3730ec9d-8cd4-4a9c-a76e-fe5b84856beb service nova] Lock "4d919875-5f24-4bed-bf26-cf437e0de3e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d104c0ab-c247-47e8-9680-afc63c2d0100 req-3730ec9d-8cd4-4a9c-a76e-fe5b84856beb service nova] Lock "4d919875-5f24-4bed-bf26-cf437e0de3e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG nova.compute.manager [req-d104c0ab-c247-47e8-9680-afc63c2d0100 req-3730ec9d-8cd4-4a9c-a76e-fe5b84856beb service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] No waiting events found dispatching network-vif-plugged-bb47713e-54a8-4834-a78d-749c5f72f334 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:04:00 user nova-compute[72766]: WARNING nova.compute.manager [req-d104c0ab-c247-47e8-9680-afc63c2d0100 req-3730ec9d-8cd4-4a9c-a76e-fe5b84856beb service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Received unexpected event network-vif-plugged-bb47713e-54a8-4834-a78d-749c5f72f334 for instance with vm_state active and task_state deleting.
Aug 14 23:04:00 user nova-compute[72766]: DEBUG nova.compute.manager [req-d104c0ab-c247-47e8-9680-afc63c2d0100 req-3730ec9d-8cd4-4a9c-a76e-fe5b84856beb service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Received event network-vif-plugged-bb47713e-54a8-4834-a78d-749c5f72f334 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d104c0ab-c247-47e8-9680-afc63c2d0100 req-3730ec9d-8cd4-4a9c-a76e-fe5b84856beb service nova] Acquiring lock "4d919875-5f24-4bed-bf26-cf437e0de3e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d104c0ab-c247-47e8-9680-afc63c2d0100 req-3730ec9d-8cd4-4a9c-a76e-fe5b84856beb service nova] Lock "4d919875-5f24-4bed-bf26-cf437e0de3e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d104c0ab-c247-47e8-9680-afc63c2d0100 req-3730ec9d-8cd4-4a9c-a76e-fe5b84856beb service nova] Lock "4d919875-5f24-4bed-bf26-cf437e0de3e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG nova.compute.manager [req-d104c0ab-c247-47e8-9680-afc63c2d0100 req-3730ec9d-8cd4-4a9c-a76e-fe5b84856beb service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] No waiting events found dispatching network-vif-plugged-bb47713e-54a8-4834-a78d-749c5f72f334 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:04:00 user nova-compute[72766]: WARNING nova.compute.manager [req-d104c0ab-c247-47e8-9680-afc63c2d0100 req-3730ec9d-8cd4-4a9c-a76e-fe5b84856beb service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Received unexpected event network-vif-plugged-bb47713e-54a8-4834-a78d-749c5f72f334 for instance with vm_state active and task_state deleting.
Aug 14 23:04:00 user nova-compute[72766]: DEBUG nova.compute.manager [req-d104c0ab-c247-47e8-9680-afc63c2d0100 req-3730ec9d-8cd4-4a9c-a76e-fe5b84856beb service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Received event network-vif-unplugged-bb47713e-54a8-4834-a78d-749c5f72f334 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d104c0ab-c247-47e8-9680-afc63c2d0100 req-3730ec9d-8cd4-4a9c-a76e-fe5b84856beb service nova] Acquiring lock "4d919875-5f24-4bed-bf26-cf437e0de3e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d104c0ab-c247-47e8-9680-afc63c2d0100 req-3730ec9d-8cd4-4a9c-a76e-fe5b84856beb service nova] Lock "4d919875-5f24-4bed-bf26-cf437e0de3e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d104c0ab-c247-47e8-9680-afc63c2d0100 req-3730ec9d-8cd4-4a9c-a76e-fe5b84856beb service nova] Lock "4d919875-5f24-4bed-bf26-cf437e0de3e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG nova.compute.manager [req-d104c0ab-c247-47e8-9680-afc63c2d0100 req-3730ec9d-8cd4-4a9c-a76e-fe5b84856beb service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] No waiting events found dispatching network-vif-unplugged-bb47713e-54a8-4834-a78d-749c5f72f334 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG nova.compute.manager [req-d104c0ab-c247-47e8-9680-afc63c2d0100 req-3730ec9d-8cd4-4a9c-a76e-fe5b84856beb service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Received event network-vif-unplugged-bb47713e-54a8-4834-a78d-749c5f72f334 for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG nova.objects.instance [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lazy-loading 'vcpu_model' on Instance uuid 78f02883-99a1-493d-b6be-e43500bfba37 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eRHNEWri', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:04:00 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:04:00 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:04:00 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:04:00 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:04:00 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ada3a2d-df8d-4cb6-be90-074b21e54916]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 23:04:00 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[617b9c75-2cfb-48f7-9d04-99f383d6fa0e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f] added
Aug 14 23:04:00 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[720aa6d7-a552-4cea-9d46-7a1ead5291cc]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[423779d4-f506-4c1d-a5f5-eb969c7bf617]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eRHNEWri {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eRHNEWri" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ce3dee-cdb5-4224-95e3-305a9defdf19]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eRHNEWri'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c5bc33-6964-4936-b05e-058f9414a4ef]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[75396e52-67e3-41fc-b4b0-b02e60b45155]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:04:00 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:04:00 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbacb492-d609-4340-97ec-b19ecb1b7270]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f, portal: 172.16.0.220,3260]
Aug 14 23:04:00 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f, portal: 172.16.0.220,3260] successful.
Aug 14 23:04:00 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[14edf871-4764-4b93-931a-8b88386c13dd]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e42d493-3609-4d68-8038-f0696e777e28]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:04:00 user nova-compute[72766]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f (non-flash)
Aug 14 23:04:00 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:04:00 user nova-compute[72766]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f (non-flash)
Aug 14 23:04:00 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c019398-e3bc-4ada-9451-0d63370b9d72]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eRHNEWri', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:04:00 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Took 0.60 seconds to deallocate network for instance.
Aug 14 23:04:00 user nova-compute[72766]: DEBUG nova.compute.manager [req-6c2c9ccd-92ac-4c19-8744-973d3f923731 req-416b2094-910c-43e0-8d5f-3ec28b45fb5e service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Received event network-vif-deleted-bb47713e-54a8-4834-a78d-749c5f72f334 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:04:00 user nova-compute[72766]: INFO nova.compute.manager [req-6c2c9ccd-92ac-4c19-8744-973d3f923731 req-416b2094-910c-43e0-8d5f-3ec28b45fb5e service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Neutron deleted interface bb47713e-54a8-4834-a78d-749c5f72f334; detaching it from the instance and deleting it from the info cache
Aug 14 23:04:00 user nova-compute[72766]: DEBUG nova.network.neutron [req-6c2c9ccd-92ac-4c19-8744-973d3f923731 req-416b2094-910c-43e0-8d5f-3ec28b45fb5e service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG nova.compute.manager [req-6c2c9ccd-92ac-4c19-8744-973d3f923731 req-416b2094-910c-43e0-8d5f-3ec28b45fb5e service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Detach interface failed, port_id=bb47713e-54a8-4834-a78d-749c5f72f334, reason: Instance 4d919875-5f24-4bed-bf26-cf437e0de3e2 could not be found. {{(pid=72766) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692054225.9054468, 78f02883-99a1-493d-b6be-e43500bfba37 => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:04:00 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] VM Stopped (Lifecycle Event)
Aug 14 23:04:00 user nova-compute[72766]: DEBUG nova.compute.manager [None req-7576e095-8be6-4317-88c0-4d5d2b2f916c None None] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:04:00 user nova-compute[72766]: DEBUG nova.compute.manager [None req-7576e095-8be6-4317-88c0-4d5d2b2f916c None None] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:04:00 user nova-compute[72766]: INFO nova.compute.manager [None req-7576e095-8be6-4317-88c0-4d5d2b2f916c None None] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 14 23:04:01 user nova-compute[72766]: INFO nova.compute.manager [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Took 0.77 seconds to detach 1 volumes for instance.
Aug 14 23:04:01 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Deleting volume: cc05004f-3360-4071-bd51-ce172fb18886 {{(pid=72766) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 23:04:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:04:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23263633963333836', 'path': '/dev/sdb'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:04:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263633963333836', 'path': '/dev/sdb'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 23:04:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:59:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1272916435',display_name='tempest-ServerActionsTestOtherB-server-1272916435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1272916435',id=16,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsHL/Ov683ewfS5a6Ilb918RzZcGPjg2jcHmAa4FSbUUXkwfiZz6KofKWkKrLkhgLEqXzZXHVc5OIPNVj5SeE4gBrIjsJUy7rj9111gEojmIZrrW+x2JI01+TKIPNtdRQ==',key_name='tempest-keypair-2053681781',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:59:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9ff897ef00ec45258b22d76ca60447fe',ramdisk_id='',reservation_id='r-vhmch78j',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-930559363',owner_user_name='tempest-ServerActionsTestOtherB-930559363-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:03:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7bcae26ae5d406196128c0ce83d3413',uuid=78f02883-99a1-493d-b6be-e43500bfba37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e7e311b-453d-4e17-9652-45723c7a2944", "address": "fa:16:3e:7e:31:c1", "network": {"id": "c07935db-7a05-49df-a504-682549f30d55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-765423768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-765423768-network", "vif_mac": "fa:16:3e:7e:31:c1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ff897ef00ec45258b22d76ca60447fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e7e311b-45", "ovs_interfaceid": "8e7e311b-453d-4e17-9652-45723c7a2944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:04:01 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Converting VIF {"id": "8e7e311b-453d-4e17-9652-45723c7a2944", "address": "fa:16:3e:7e:31:c1", "network": {"id": "c07935db-7a05-49df-a504-682549f30d55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-765423768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-765423768-network", "vif_mac": "fa:16:3e:7e:31:c1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ff897ef00ec45258b22d76ca60447fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e7e311b-45", "ovs_interfaceid": "8e7e311b-453d-4e17-9652-45723c7a2944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:04:01 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:31:c1,bridge_name='br-int',has_traffic_filtering=True,id=8e7e311b-453d-4e17-9652-45723c7a2944,network=Network(c07935db-7a05-49df-a504-682549f30d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e7e311b-45') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:04:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:04:01 user nova-compute[72766]:   <uuid>78f02883-99a1-493d-b6be-e43500bfba37</uuid>
Aug 14 23:04:01 user nova-compute[72766]:   <name>instance-00000010</name>
Aug 14 23:04:01 user nova-compute[72766]:   <memory>2097152</memory>
Aug 14 23:04:01 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:04:01 user nova-compute[72766]:   <metadata>
Aug 14 23:04:01 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:04:01 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:04:01 user nova-compute[72766]:       <nova:name>tempest-ServerActionsTestOtherB-server-1272916435</nova:name>
Aug 14 23:04:01 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:04:00</nova:creationTime>
Aug 14 23:04:01 user nova-compute[72766]:       <nova:flavor name="m1.small">
Aug 14 23:04:01 user nova-compute[72766]:         <nova:memory>2048</nova:memory>
Aug 14 23:04:01 user nova-compute[72766]:         <nova:disk>20</nova:disk>
Aug 14 23:04:01 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:04:01 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:04:01 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:04:01 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:04:01 user nova-compute[72766]:       <nova:owner>
Aug 14 23:04:01 user nova-compute[72766]:         <nova:user uuid="b7bcae26ae5d406196128c0ce83d3413">tempest-ServerActionsTestOtherB-930559363-project-member</nova:user>
Aug 14 23:04:01 user nova-compute[72766]:         <nova:project uuid="9ff897ef00ec45258b22d76ca60447fe">tempest-ServerActionsTestOtherB-930559363</nova:project>
Aug 14 23:04:01 user nova-compute[72766]:       </nova:owner>
Aug 14 23:04:01 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 23:04:01 user nova-compute[72766]:       <nova:ports>
Aug 14 23:04:01 user nova-compute[72766]:         <nova:port uuid="8e7e311b-453d-4e17-9652-45723c7a2944">
Aug 14 23:04:01 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 23:04:01 user nova-compute[72766]:         </nova:port>
Aug 14 23:04:01 user nova-compute[72766]:       </nova:ports>
Aug 14 23:04:01 user nova-compute[72766]:     </nova:instance>
Aug 14 23:04:01 user nova-compute[72766]:   </metadata>
Aug 14 23:04:01 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:04:01 user nova-compute[72766]:     <system>
Aug 14 23:04:01 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:04:01 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:04:01 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:04:01 user nova-compute[72766]:       <entry name="serial">78f02883-99a1-493d-b6be-e43500bfba37</entry>
Aug 14 23:04:01 user nova-compute[72766]:       <entry name="uuid">78f02883-99a1-493d-b6be-e43500bfba37</entry>
Aug 14 23:04:01 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:04:01 user nova-compute[72766]:     </system>
Aug 14 23:04:01 user nova-compute[72766]:   </sysinfo>
Aug 14 23:04:01 user nova-compute[72766]:   <os>
Aug 14 23:04:01 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:04:01 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:04:01 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:04:01 user nova-compute[72766]:   </os>
Aug 14 23:04:01 user nova-compute[72766]:   <features>
Aug 14 23:04:01 user nova-compute[72766]:     <acpi/>
Aug 14 23:04:01 user nova-compute[72766]:     <apic/>
Aug 14 23:04:01 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:04:01 user nova-compute[72766]:   </features>
Aug 14 23:04:01 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:04:01 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:04:01 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:04:01 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:04:01 user nova-compute[72766]:   </clock>
Aug 14 23:04:01 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:04:01 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:04:01 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:04:01 user nova-compute[72766]:   </cpu>
Aug 14 23:04:01 user nova-compute[72766]:   <devices>
Aug 14 23:04:01 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 23:04:01 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 23:04:01 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk"/>
Aug 14 23:04:01 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:04:01 user nova-compute[72766]:     </disk>
Aug 14 23:04:01 user nova-compute[72766]:     <disk type="block" device="disk">
Aug 14 23:04:01 user nova-compute[72766]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:04:01 user nova-compute[72766]:       <source dev="/dev/sdb"/>
Aug 14 23:04:01 user nova-compute[72766]:       <target dev="vdb" bus="virtio"/>
Aug 14 23:04:01 user nova-compute[72766]:       <serial>6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f</serial>
Aug 14 23:04:01 user nova-compute[72766]:     </disk>
Aug 14 23:04:01 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:04:01 user nova-compute[72766]:       <mac address="fa:16:3e:7e:31:c1"/>
Aug 14 23:04:01 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:04:01 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:04:01 user nova-compute[72766]:       <target dev="tap8e7e311b-45"/>
Aug 14 23:04:01 user nova-compute[72766]:     </interface>
Aug 14 23:04:01 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:04:01 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/console.log" append="off"/>
Aug 14 23:04:01 user nova-compute[72766]:     </serial>
Aug 14 23:04:01 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:04:01 user nova-compute[72766]:     <video>
Aug 14 23:04:01 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:04:01 user nova-compute[72766]:     </video>
Aug 14 23:04:01 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:04:01 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:04:01 user nova-compute[72766]:     </rng>
Aug 14 23:04:01 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:04:01 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:04:01 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:04:01 user nova-compute[72766]:     </memballoon>
Aug 14 23:04:01 user nova-compute[72766]:   </devices>
Aug 14 23:04:01 user nova-compute[72766]: </domain>
Aug 14 23:04:01 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:04:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:59:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1272916435',display_name='tempest-ServerActionsTestOtherB-server-1272916435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1272916435',id=16,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsHL/Ov683ewfS5a6Ilb918RzZcGPjg2jcHmAa4FSbUUXkwfiZz6KofKWkKrLkhgLEqXzZXHVc5OIPNVj5SeE4gBrIjsJUy7rj9111gEojmIZrrW+x2JI01+TKIPNtdRQ==',key_name='tempest-keypair-2053681781',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:59:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9ff897ef00ec45258b22d76ca60447fe',ramdisk_id='',reservation_id='r-vhmch78j',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-930559363',owner_user_name='tempest-ServerActionsTestOtherB-930559363-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:03:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7bcae26ae5d406196128c0ce83d3413',uuid=78f02883-99a1-493d-b6be-e43500bfba37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e7e311b-453d-4e17-9652-45723c7a2944", "address": "fa:16:3e:7e:31:c1", "network": {"id": "c07935db-7a05-49df-a504-682549f30d55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-765423768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-765423768-network", "vif_mac": "fa:16:3e:7e:31:c1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ff897ef00ec45258b22d76ca60447fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e7e311b-45", "ovs_interfaceid": "8e7e311b-453d-4e17-9652-45723c7a2944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:04:01 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Converting VIF {"id": "8e7e311b-453d-4e17-9652-45723c7a2944", "address": "fa:16:3e:7e:31:c1", "network": {"id": "c07935db-7a05-49df-a504-682549f30d55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-765423768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-765423768-network", "vif_mac": "fa:16:3e:7e:31:c1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ff897ef00ec45258b22d76ca60447fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e7e311b-45", "ovs_interfaceid": "8e7e311b-453d-4e17-9652-45723c7a2944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:04:01 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:31:c1,bridge_name='br-int',has_traffic_filtering=True,id=8e7e311b-453d-4e17-9652-45723c7a2944,network=Network(c07935db-7a05-49df-a504-682549f30d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e7e311b-45') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:04:01 user nova-compute[72766]: DEBUG os_vif [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:31:c1,bridge_name='br-int',has_traffic_filtering=True,id=8e7e311b-453d-4e17-9652-45723c7a2944,network=Network(c07935db-7a05-49df-a504-682549f30d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e7e311b-45') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:04:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:04:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:04:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e7e311b-45, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:04:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8e7e311b-45, col_values=(('external_ids', {'iface-id': '8e7e311b-453d-4e17-9652-45723c7a2944', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:31:c1', 'vm-uuid': '78f02883-99a1-493d-b6be-e43500bfba37'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:04:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:04:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:01 user nova-compute[72766]: INFO os_vif [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:31:c1,bridge_name='br-int',has_traffic_filtering=True,id=8e7e311b-453d-4e17-9652-45723c7a2944,network=Network(c07935db-7a05-49df-a504-682549f30d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e7e311b-45')
Aug 14 23:04:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:04:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:04:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:04:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:04:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] No VIF found with MAC fa:16:3e:7e:31:c1, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:04:01 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054241.8028188, 11e79581-a122-4c0a-8485-a8b6c62e73b8 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:04:01 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] VM Resumed (Lifecycle Event)
Aug 14 23:04:01 user nova-compute[72766]: DEBUG nova.compute.manager [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:04:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 23:04:01 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Instance spawned successfully.
Aug 14 23:04:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 23:04:01 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:04:01 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:04:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:04:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:04:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:04:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:04:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:04:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:04:01 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:04:01 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054241.803939, 11e79581-a122-4c0a-8485-a8b6c62e73b8 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:04:01 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] VM Started (Lifecycle Event)
Aug 14 23:04:01 user nova-compute[72766]: DEBUG nova.compute.manager [req-03fadcb1-185b-405c-9fef-14fb9fc98e2f req-4e4dba59-77f0-4288-abcd-fa94bdbd149e service nova] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Received event network-vif-plugged-0add7ef0-687d-4486-842d-2d07c0d26449 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:04:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-03fadcb1-185b-405c-9fef-14fb9fc98e2f req-4e4dba59-77f0-4288-abcd-fa94bdbd149e service nova] Acquiring lock "11e79581-a122-4c0a-8485-a8b6c62e73b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:04:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-03fadcb1-185b-405c-9fef-14fb9fc98e2f req-4e4dba59-77f0-4288-abcd-fa94bdbd149e service nova] Lock "11e79581-a122-4c0a-8485-a8b6c62e73b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:04:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-03fadcb1-185b-405c-9fef-14fb9fc98e2f req-4e4dba59-77f0-4288-abcd-fa94bdbd149e service nova] Lock "11e79581-a122-4c0a-8485-a8b6c62e73b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:04:01 user nova-compute[72766]: DEBUG nova.compute.manager [req-03fadcb1-185b-405c-9fef-14fb9fc98e2f req-4e4dba59-77f0-4288-abcd-fa94bdbd149e service nova] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] No waiting events found dispatching network-vif-plugged-0add7ef0-687d-4486-842d-2d07c0d26449 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:04:01 user nova-compute[72766]: WARNING nova.compute.manager [req-03fadcb1-185b-405c-9fef-14fb9fc98e2f req-4e4dba59-77f0-4288-abcd-fa94bdbd149e service nova] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Received unexpected event network-vif-plugged-0add7ef0-687d-4486-842d-2d07c0d26449 for instance with vm_state building and task_state spawning.
Aug 14 23:04:01 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:04:01 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:04:01 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:04:01 user nova-compute[72766]: INFO nova.compute.manager [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Took 6.21 seconds to spawn the instance on the hypervisor.
Aug 14 23:04:01 user nova-compute[72766]: DEBUG nova.compute.manager [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:04:02 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:04:02 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:04:02 user nova-compute[72766]: INFO nova.compute.manager [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Took 7.07 seconds to build instance.
Aug 14 23:04:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.409s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:04:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-11a44317-7f6b-477f-a410-f4d8157c52ee tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "11e79581-a122-4c0a-8485-a8b6c62e73b8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.247s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:04:02 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Deleted allocations for instance 4d919875-5f24-4bed-bf26-cf437e0de3e2
Aug 14 23:04:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f817fbdc-85b3-46c4-9cee-1e75d70d7b97 tempest-TestShelveInstance-1305179191 tempest-TestShelveInstance-1305179191-project-member] Lock "4d919875-5f24-4bed-bf26-cf437e0de3e2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.007s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:04:02 user nova-compute[72766]: DEBUG nova.compute.manager [req-204e5547-f253-41e6-9e40-845535b1340b req-134299ee-4266-4a4b-a3ff-1a05bd91e5e0 service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Received event network-vif-plugged-bb47713e-54a8-4834-a78d-749c5f72f334 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:04:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-204e5547-f253-41e6-9e40-845535b1340b req-134299ee-4266-4a4b-a3ff-1a05bd91e5e0 service nova] Acquiring lock "4d919875-5f24-4bed-bf26-cf437e0de3e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:04:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-204e5547-f253-41e6-9e40-845535b1340b req-134299ee-4266-4a4b-a3ff-1a05bd91e5e0 service nova] Lock "4d919875-5f24-4bed-bf26-cf437e0de3e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:04:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-204e5547-f253-41e6-9e40-845535b1340b req-134299ee-4266-4a4b-a3ff-1a05bd91e5e0 service nova] Lock "4d919875-5f24-4bed-bf26-cf437e0de3e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:04:02 user nova-compute[72766]: DEBUG nova.compute.manager [req-204e5547-f253-41e6-9e40-845535b1340b req-134299ee-4266-4a4b-a3ff-1a05bd91e5e0 service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] No waiting events found dispatching network-vif-plugged-bb47713e-54a8-4834-a78d-749c5f72f334 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:04:02 user nova-compute[72766]: WARNING nova.compute.manager [req-204e5547-f253-41e6-9e40-845535b1340b req-134299ee-4266-4a4b-a3ff-1a05bd91e5e0 service nova] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Received unexpected event network-vif-plugged-bb47713e-54a8-4834-a78d-749c5f72f334 for instance with vm_state deleted and task_state None.
Aug 14 23:04:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:03 user nova-compute[72766]: DEBUG nova.compute.manager [req-cfc4c92e-fe21-41de-91a5-a6f037fe7ca3 req-946d0a78-6be5-400d-b81e-81d6133fab60 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Received event network-vif-plugged-8e7e311b-453d-4e17-9652-45723c7a2944 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:04:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-cfc4c92e-fe21-41de-91a5-a6f037fe7ca3 req-946d0a78-6be5-400d-b81e-81d6133fab60 service nova] Acquiring lock "78f02883-99a1-493d-b6be-e43500bfba37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:04:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-cfc4c92e-fe21-41de-91a5-a6f037fe7ca3 req-946d0a78-6be5-400d-b81e-81d6133fab60 service nova] Lock "78f02883-99a1-493d-b6be-e43500bfba37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:04:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-cfc4c92e-fe21-41de-91a5-a6f037fe7ca3 req-946d0a78-6be5-400d-b81e-81d6133fab60 service nova] Lock "78f02883-99a1-493d-b6be-e43500bfba37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:04:03 user nova-compute[72766]: DEBUG nova.compute.manager [req-cfc4c92e-fe21-41de-91a5-a6f037fe7ca3 req-946d0a78-6be5-400d-b81e-81d6133fab60 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] No waiting events found dispatching network-vif-plugged-8e7e311b-453d-4e17-9652-45723c7a2944 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:04:03 user nova-compute[72766]: WARNING nova.compute.manager [req-cfc4c92e-fe21-41de-91a5-a6f037fe7ca3 req-946d0a78-6be5-400d-b81e-81d6133fab60 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Received unexpected event network-vif-plugged-8e7e311b-453d-4e17-9652-45723c7a2944 for instance with vm_state active and task_state resize_finish.
Aug 14 23:04:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:05 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054245.3346698, 78f02883-99a1-493d-b6be-e43500bfba37 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:04:05 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] VM Resumed (Lifecycle Event)
Aug 14 23:04:05 user nova-compute[72766]: DEBUG nova.compute.manager [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:04:05 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Instance running successfully.
Aug 14 23:04:05 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Failed to set time: agent not configured {{(pid=72766) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 14 23:04:05 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-8c1e72f7-9512-4b3b-bd48-66db1d123a5b tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] finish_migration finished successfully. {{(pid=72766) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 14 23:04:05 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:04:05 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:04:05 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 14 23:04:05 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054245.3360033, 78f02883-99a1-493d-b6be-e43500bfba37 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:04:05 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] VM Started (Lifecycle Event)
Aug 14 23:04:05 user nova-compute[72766]: DEBUG nova.compute.manager [req-f911f8f5-5b6a-4b58-b173-73d1d8c9bc39 req-e4e6ab28-d597-4b2a-ae35-2711d988a6b9 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Received event network-vif-plugged-8e7e311b-453d-4e17-9652-45723c7a2944 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:04:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f911f8f5-5b6a-4b58-b173-73d1d8c9bc39 req-e4e6ab28-d597-4b2a-ae35-2711d988a6b9 service nova] Acquiring lock "78f02883-99a1-493d-b6be-e43500bfba37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:04:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f911f8f5-5b6a-4b58-b173-73d1d8c9bc39 req-e4e6ab28-d597-4b2a-ae35-2711d988a6b9 service nova] Lock "78f02883-99a1-493d-b6be-e43500bfba37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:04:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f911f8f5-5b6a-4b58-b173-73d1d8c9bc39 req-e4e6ab28-d597-4b2a-ae35-2711d988a6b9 service nova] Lock "78f02883-99a1-493d-b6be-e43500bfba37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:04:05 user nova-compute[72766]: DEBUG nova.compute.manager [req-f911f8f5-5b6a-4b58-b173-73d1d8c9bc39 req-e4e6ab28-d597-4b2a-ae35-2711d988a6b9 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] No waiting events found dispatching network-vif-plugged-8e7e311b-453d-4e17-9652-45723c7a2944 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:04:05 user nova-compute[72766]: WARNING nova.compute.manager [req-f911f8f5-5b6a-4b58-b173-73d1d8c9bc39 req-e4e6ab28-d597-4b2a-ae35-2711d988a6b9 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Received unexpected event network-vif-plugged-8e7e311b-453d-4e17-9652-45723c7a2944 for instance with vm_state active and task_state resize_finish.
Aug 14 23:04:05 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:04:05 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:04:05 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 14 23:04:05 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692054230.8175805, 391b2d43-3c9d-42db-bfae-09e8410bf367 => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:04:05 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] VM Stopped (Lifecycle Event)
Aug 14 23:04:05 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c169410a-8207-4584-8d5c-1e67c221cfdc None None] [instance: 391b2d43-3c9d-42db-bfae-09e8410bf367] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:04:06 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:14 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692054239.5115712, 4d919875-5f24-4bed-bf26-cf437e0de3e2 => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:04:14 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] VM Stopped (Lifecycle Event)
Aug 14 23:04:14 user nova-compute[72766]: DEBUG nova.compute.manager [None req-5aa3c3d0-dff1-4634-b30e-f87fe09336fa None None] [instance: 4d919875-5f24-4bed-bf26-cf437e0de3e2] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:04:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:04:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:04:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:04:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:04:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-92fdd75b-8832-4016-8a45-3a6c1c2085fb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Acquiring lock "b563c62d-d117-4bb5-9157-7387c51ed641" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:04:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-92fdd75b-8832-4016-8a45-3a6c1c2085fb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Lock "b563c62d-d117-4bb5-9157-7387c51ed641" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:04:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-92fdd75b-8832-4016-8a45-3a6c1c2085fb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Acquiring lock "b563c62d-d117-4bb5-9157-7387c51ed641-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:04:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-92fdd75b-8832-4016-8a45-3a6c1c2085fb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Lock "b563c62d-d117-4bb5-9157-7387c51ed641-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:04:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-92fdd75b-8832-4016-8a45-3a6c1c2085fb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Lock "b563c62d-d117-4bb5-9157-7387c51ed641-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:04:19 user nova-compute[72766]: INFO nova.compute.manager [None req-92fdd75b-8832-4016-8a45-3a6c1c2085fb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Terminating instance
Aug 14 23:04:19 user nova-compute[72766]: DEBUG nova.compute.manager [None req-92fdd75b-8832-4016-8a45-3a6c1c2085fb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:04:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:20 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:20 user nova-compute[72766]: DEBUG nova.compute.manager [req-f222c143-f887-4163-9a94-d4c15aac26b8 req-7280a39a-b3ae-4ece-9067-9c9c7eaf9cca service nova] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Received event network-vif-unplugged-1663df0b-566c-4588-a5e1-5082de0e3bcf {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:04:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f222c143-f887-4163-9a94-d4c15aac26b8 req-7280a39a-b3ae-4ece-9067-9c9c7eaf9cca service nova] Acquiring lock "b563c62d-d117-4bb5-9157-7387c51ed641-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:04:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f222c143-f887-4163-9a94-d4c15aac26b8 req-7280a39a-b3ae-4ece-9067-9c9c7eaf9cca service nova] Lock "b563c62d-d117-4bb5-9157-7387c51ed641-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:04:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f222c143-f887-4163-9a94-d4c15aac26b8 req-7280a39a-b3ae-4ece-9067-9c9c7eaf9cca service nova] Lock "b563c62d-d117-4bb5-9157-7387c51ed641-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:04:20 user nova-compute[72766]: DEBUG nova.compute.manager [req-f222c143-f887-4163-9a94-d4c15aac26b8 req-7280a39a-b3ae-4ece-9067-9c9c7eaf9cca service nova] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] No waiting events found dispatching network-vif-unplugged-1663df0b-566c-4588-a5e1-5082de0e3bcf {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:04:20 user nova-compute[72766]: DEBUG nova.compute.manager [req-f222c143-f887-4163-9a94-d4c15aac26b8 req-7280a39a-b3ae-4ece-9067-9c9c7eaf9cca service nova] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Received event network-vif-unplugged-1663df0b-566c-4588-a5e1-5082de0e3bcf for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:04:20 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Instance destroyed successfully.
Aug 14 23:04:20 user nova-compute[72766]: DEBUG nova.objects.instance [None req-92fdd75b-8832-4016-8a45-3a6c1c2085fb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Lazy-loading 'resources' on Instance uuid b563c62d-d117-4bb5-9157-7387c51ed641 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:04:20 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-92fdd75b-8832-4016-8a45-3a6c1c2085fb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:55:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-171284351',display_name='tempest-ServersNegativeTestJSON-server-171284351',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-171284351',id=2,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:55:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='142137ab929f4e5289b06319af10751b',ramdisk_id='',reservation_id='r-upij0d7c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-968182857',owner_user_name='tempest-ServersNegativeTestJSON-968182857-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:55:40Z,user_data=None,user_id='4701a1ef84d94ce99ec55e44c1df9032',uuid=b563c62d-d117-4bb5-9157-7387c51ed641,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1663df0b-566c-4588-a5e1-5082de0e3bcf", "address": "fa:16:3e:b7:97:01", "network": {"id": "5464d98e-0483-4d6d-895b-b51c50c0cfd9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-581355694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142137ab929f4e5289b06319af10751b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1663df0b-56", "ovs_interfaceid": "1663df0b-566c-4588-a5e1-5082de0e3bcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:04:20 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-92fdd75b-8832-4016-8a45-3a6c1c2085fb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Converting VIF {"id": "1663df0b-566c-4588-a5e1-5082de0e3bcf", "address": "fa:16:3e:b7:97:01", "network": {"id": "5464d98e-0483-4d6d-895b-b51c50c0cfd9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-581355694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142137ab929f4e5289b06319af10751b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1663df0b-56", "ovs_interfaceid": "1663df0b-566c-4588-a5e1-5082de0e3bcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:04:20 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-92fdd75b-8832-4016-8a45-3a6c1c2085fb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:97:01,bridge_name='br-int',has_traffic_filtering=True,id=1663df0b-566c-4588-a5e1-5082de0e3bcf,network=Network(5464d98e-0483-4d6d-895b-b51c50c0cfd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1663df0b-56') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:04:20 user nova-compute[72766]: DEBUG os_vif [None req-92fdd75b-8832-4016-8a45-3a6c1c2085fb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:97:01,bridge_name='br-int',has_traffic_filtering=True,id=1663df0b-566c-4588-a5e1-5082de0e3bcf,network=Network(5464d98e-0483-4d6d-895b-b51c50c0cfd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1663df0b-56') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:04:20 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:20 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1663df0b-56, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:04:20 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:20 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:04:20 user nova-compute[72766]: INFO os_vif [None req-92fdd75b-8832-4016-8a45-3a6c1c2085fb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:97:01,bridge_name='br-int',has_traffic_filtering=True,id=1663df0b-566c-4588-a5e1-5082de0e3bcf,network=Network(5464d98e-0483-4d6d-895b-b51c50c0cfd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1663df0b-56')
Aug 14 23:04:20 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-92fdd75b-8832-4016-8a45-3a6c1c2085fb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Deleting instance files /opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641_del
Aug 14 23:04:20 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-92fdd75b-8832-4016-8a45-3a6c1c2085fb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Deletion of /opt/stack/data/nova/instances/b563c62d-d117-4bb5-9157-7387c51ed641_del complete
Aug 14 23:04:20 user nova-compute[72766]: INFO nova.compute.manager [None req-92fdd75b-8832-4016-8a45-3a6c1c2085fb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Took 0.69 seconds to destroy the instance on the hypervisor.
Aug 14 23:04:20 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-92fdd75b-8832-4016-8a45-3a6c1c2085fb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:04:20 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:04:20 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:04:21 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:04:21 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Took 0.67 seconds to deallocate network for instance.
Aug 14 23:04:21 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-92fdd75b-8832-4016-8a45-3a6c1c2085fb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:04:21 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-92fdd75b-8832-4016-8a45-3a6c1c2085fb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:04:21 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-92fdd75b-8832-4016-8a45-3a6c1c2085fb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:04:21 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:04:21 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:04:21 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-92fdd75b-8832-4016-8a45-3a6c1c2085fb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:04:21 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-92fdd75b-8832-4016-8a45-3a6c1c2085fb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.362s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:04:21 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-92fdd75b-8832-4016-8a45-3a6c1c2085fb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Deleted allocations for instance b563c62d-d117-4bb5-9157-7387c51ed641
Aug 14 23:04:21 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-78f02883-99a1-493d-b6be-e43500bfba37" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:04:21 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-78f02883-99a1-493d-b6be-e43500bfba37" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:04:21 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:04:21 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-92fdd75b-8832-4016-8a45-3a6c1c2085fb tempest-ServersNegativeTestJSON-968182857 tempest-ServersNegativeTestJSON-968182857-project-member] Lock "b563c62d-d117-4bb5-9157-7387c51ed641" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.934s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:04:22 user nova-compute[72766]: DEBUG nova.compute.manager [req-ddeb4406-3abc-45a7-b4df-28ebf713af49 req-52892630-1e57-4106-901b-64885ac27e9f service nova] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Received event network-vif-plugged-1663df0b-566c-4588-a5e1-5082de0e3bcf {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:04:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ddeb4406-3abc-45a7-b4df-28ebf713af49 req-52892630-1e57-4106-901b-64885ac27e9f service nova] Acquiring lock "b563c62d-d117-4bb5-9157-7387c51ed641-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:04:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ddeb4406-3abc-45a7-b4df-28ebf713af49 req-52892630-1e57-4106-901b-64885ac27e9f service nova] Lock "b563c62d-d117-4bb5-9157-7387c51ed641-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:04:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ddeb4406-3abc-45a7-b4df-28ebf713af49 req-52892630-1e57-4106-901b-64885ac27e9f service nova] Lock "b563c62d-d117-4bb5-9157-7387c51ed641-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:04:22 user nova-compute[72766]: DEBUG nova.compute.manager [req-ddeb4406-3abc-45a7-b4df-28ebf713af49 req-52892630-1e57-4106-901b-64885ac27e9f service nova] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] No waiting events found dispatching network-vif-plugged-1663df0b-566c-4588-a5e1-5082de0e3bcf {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:04:22 user nova-compute[72766]: WARNING nova.compute.manager [req-ddeb4406-3abc-45a7-b4df-28ebf713af49 req-52892630-1e57-4106-901b-64885ac27e9f service nova] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Received unexpected event network-vif-plugged-1663df0b-566c-4588-a5e1-5082de0e3bcf for instance with vm_state deleted and task_state None.
Aug 14 23:04:22 user nova-compute[72766]: DEBUG nova.compute.manager [req-ddeb4406-3abc-45a7-b4df-28ebf713af49 req-52892630-1e57-4106-901b-64885ac27e9f service nova] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Received event network-vif-deleted-1663df0b-566c-4588-a5e1-5082de0e3bcf {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:04:22 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Updating instance_info_cache with network_info: [{"id": "8e7e311b-453d-4e17-9652-45723c7a2944", "address": "fa:16:3e:7e:31:c1", "network": {"id": "c07935db-7a05-49df-a504-682549f30d55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-765423768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ff897ef00ec45258b22d76ca60447fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e7e311b-45", "ovs_interfaceid": "8e7e311b-453d-4e17-9652-45723c7a2944", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:04:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-78f02883-99a1-493d-b6be-e43500bfba37" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:04:22 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:04:22 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:04:22 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:04:22 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:04:22 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:04:22 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:04:23 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:04:23 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:04:23 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:04:23 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:04:23 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:04:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:04:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:04:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:04:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:04:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:04:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:04:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:04:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:04:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:04:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:04:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:04:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:04:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:04:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:04:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f7a13a8-6ac1-4b19-8c5c-f54406790f58/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:04:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f7a13a8-6ac1-4b19-8c5c-f54406790f58/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:04:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f7a13a8-6ac1-4b19-8c5c-f54406790f58/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:04:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f7a13a8-6ac1-4b19-8c5c-f54406790f58/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:04:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e79581-a122-4c0a-8485-a8b6c62e73b8/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:04:25 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e79581-a122-4c0a-8485-a8b6c62e73b8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:04:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e79581-a122-4c0a-8485-a8b6c62e73b8/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:04:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e79581-a122-4c0a-8485-a8b6c62e73b8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:04:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:04:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:04:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:04:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:04:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:04:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:04:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:04:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:04:27 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:04:27 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:04:27 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=7445MB free_disk=25.556453704833984GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:04:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:04:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:04:27 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Applying migration context for instance 78f02883-99a1-493d-b6be-e43500bfba37 as it has an incoming, in-progress migration ec50a025-a46c-4108-a1b8-c141a1114543. Migration status is finished {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 14 23:04:27 user nova-compute[72766]: INFO nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Updating resource usage from migration ec50a025-a46c-4108-a1b8-c141a1114543
Aug 14 23:04:27 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance c3c0a004-8d70-4253-bf17-b83088e30031 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:04:27 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 3ff300ff-34fd-4e94-9d2d-681fb133ba32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:04:27 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance cbcf7851-e6f7-4f46-97cc-d773286ccddf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:04:27 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 4f7a13a8-6ac1-4b19-8c5c-f54406790f58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:04:27 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 66578337-cbff-4613-87a1-85ddabaebb2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:04:27 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 83084ccc-8e55-43dc-9a37-ffcb35a10922 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:04:27 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Migration ec50a025-a46c-4108-a1b8-c141a1114543 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 14 23:04:27 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 78f02883-99a1-493d-b6be-e43500bfba37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:04:27 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 11e79581-a122-4c0a-8485-a8b6c62e73b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:04:27 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:04:27 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:04:27 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:04:27 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:04:27 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:04:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.459s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:04:28 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:04:28 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:04:28 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:04:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:30 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:35 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692054260.4581883, b563c62d-d117-4bb5-9157-7387c51ed641 => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:04:35 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] VM Stopped (Lifecycle Event)
Aug 14 23:04:35 user nova-compute[72766]: DEBUG nova.compute.manager [None req-eb4aa2f1-9e4f-4e75-849a-b9af4a196f3d None None] [instance: b563c62d-d117-4bb5-9157-7387c51ed641] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:04:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:40 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:04:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7a176194-cd85-4ef5-8796-7502450f6379 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Acquiring lock "c3c0a004-8d70-4253-bf17-b83088e30031" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:04:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7a176194-cd85-4ef5-8796-7502450f6379 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "c3c0a004-8d70-4253-bf17-b83088e30031" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:04:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7a176194-cd85-4ef5-8796-7502450f6379 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Acquiring lock "c3c0a004-8d70-4253-bf17-b83088e30031-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:04:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7a176194-cd85-4ef5-8796-7502450f6379 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "c3c0a004-8d70-4253-bf17-b83088e30031-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:04:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7a176194-cd85-4ef5-8796-7502450f6379 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "c3c0a004-8d70-4253-bf17-b83088e30031-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:04:45 user nova-compute[72766]: INFO nova.compute.manager [None req-7a176194-cd85-4ef5-8796-7502450f6379 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Terminating instance
Aug 14 23:04:45 user nova-compute[72766]: DEBUG nova.compute.manager [None req-7a176194-cd85-4ef5-8796-7502450f6379 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:04:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:45 user nova-compute[72766]: DEBUG nova.compute.manager [req-699f73f9-e9e7-4bce-b10c-891ca03a51e3 req-4ccd80e7-6b58-48f1-b774-2973be4feaeb service nova] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Received event network-vif-unplugged-26e28590-b9de-41c5-809d-06e3458eca3f {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:04:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-699f73f9-e9e7-4bce-b10c-891ca03a51e3 req-4ccd80e7-6b58-48f1-b774-2973be4feaeb service nova] Acquiring lock "c3c0a004-8d70-4253-bf17-b83088e30031-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:04:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-699f73f9-e9e7-4bce-b10c-891ca03a51e3 req-4ccd80e7-6b58-48f1-b774-2973be4feaeb service nova] Lock "c3c0a004-8d70-4253-bf17-b83088e30031-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:04:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-699f73f9-e9e7-4bce-b10c-891ca03a51e3 req-4ccd80e7-6b58-48f1-b774-2973be4feaeb service nova] Lock "c3c0a004-8d70-4253-bf17-b83088e30031-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:04:45 user nova-compute[72766]: DEBUG nova.compute.manager [req-699f73f9-e9e7-4bce-b10c-891ca03a51e3 req-4ccd80e7-6b58-48f1-b774-2973be4feaeb service nova] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] No waiting events found dispatching network-vif-unplugged-26e28590-b9de-41c5-809d-06e3458eca3f {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:04:45 user nova-compute[72766]: DEBUG nova.compute.manager [req-699f73f9-e9e7-4bce-b10c-891ca03a51e3 req-4ccd80e7-6b58-48f1-b774-2973be4feaeb service nova] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Received event network-vif-unplugged-26e28590-b9de-41c5-809d-06e3458eca3f for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:04:46 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Instance destroyed successfully.
Aug 14 23:04:46 user nova-compute[72766]: DEBUG nova.objects.instance [None req-7a176194-cd85-4ef5-8796-7502450f6379 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lazy-loading 'resources' on Instance uuid c3c0a004-8d70-4253-bf17-b83088e30031 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:04:46 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-7a176194-cd85-4ef5-8796-7502450f6379 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1538328844',display_name='tempest-SnapshotDataIntegrityTests-server-1538328844',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1538328844',id=10,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1uk5EnkwBt23yCM+521zuC9oUNaMu0R5NvzZ2Z7LJw0HSX2NLAEx6ixFqAZyR0W5oNU7V9NdTJRIKUF9xsgmNT2rgRS2gwfdRHkZCgjlCnbwaaDhT3X3SOxDi/IFAXZw==',key_name='tempest-keypair-1246698965',keypairs=<?>,launch_index=0,launched_at=2023-08-14T22:57:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2811d70e7d640739c6f7bf792ec33a4',ramdisk_id='',reservation_id='r-074wiyp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1743181261',owner_user_name='tempest-SnapshotDataIntegrityTests-1743181261-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T22:57:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea644936a5024e47b68fcdd88aef0977',uuid=c3c0a004-8d70-4253-bf17-b83088e30031,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26e28590-b9de-41c5-809d-06e3458eca3f", "address": "fa:16:3e:96:85:b3", "network": {"id": "b74740ac-2ac1-45f5-8997-0e22050362e8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1094074502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2811d70e7d640739c6f7bf792ec33a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e28590-b9", "ovs_interfaceid": "26e28590-b9de-41c5-809d-06e3458eca3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:04:46 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-7a176194-cd85-4ef5-8796-7502450f6379 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Converting VIF {"id": "26e28590-b9de-41c5-809d-06e3458eca3f", "address": "fa:16:3e:96:85:b3", "network": {"id": "b74740ac-2ac1-45f5-8997-0e22050362e8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1094074502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2811d70e7d640739c6f7bf792ec33a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e28590-b9", "ovs_interfaceid": "26e28590-b9de-41c5-809d-06e3458eca3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:04:46 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-7a176194-cd85-4ef5-8796-7502450f6379 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:85:b3,bridge_name='br-int',has_traffic_filtering=True,id=26e28590-b9de-41c5-809d-06e3458eca3f,network=Network(b74740ac-2ac1-45f5-8997-0e22050362e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26e28590-b9') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:04:46 user nova-compute[72766]: DEBUG os_vif [None req-7a176194-cd85-4ef5-8796-7502450f6379 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:85:b3,bridge_name='br-int',has_traffic_filtering=True,id=26e28590-b9de-41c5-809d-06e3458eca3f,network=Network(b74740ac-2ac1-45f5-8997-0e22050362e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26e28590-b9') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:04:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26e28590-b9, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:04:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:04:46 user nova-compute[72766]: INFO os_vif [None req-7a176194-cd85-4ef5-8796-7502450f6379 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:85:b3,bridge_name='br-int',has_traffic_filtering=True,id=26e28590-b9de-41c5-809d-06e3458eca3f,network=Network(b74740ac-2ac1-45f5-8997-0e22050362e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26e28590-b9')
Aug 14 23:04:46 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-7a176194-cd85-4ef5-8796-7502450f6379 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Deleting instance files /opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031_del
Aug 14 23:04:46 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-7a176194-cd85-4ef5-8796-7502450f6379 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Deletion of /opt/stack/data/nova/instances/c3c0a004-8d70-4253-bf17-b83088e30031_del complete
Aug 14 23:04:46 user nova-compute[72766]: INFO nova.compute.manager [None req-7a176194-cd85-4ef5-8796-7502450f6379 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 14 23:04:46 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-7a176194-cd85-4ef5-8796-7502450f6379 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:04:46 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:04:46 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:04:47 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:04:47 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Took 0.96 seconds to deallocate network for instance.
Aug 14 23:04:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7a176194-cd85-4ef5-8796-7502450f6379 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:04:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7a176194-cd85-4ef5-8796-7502450f6379 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:04:47 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-7a176194-cd85-4ef5-8796-7502450f6379 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:04:47 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-7a176194-cd85-4ef5-8796-7502450f6379 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:04:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7a176194-cd85-4ef5-8796-7502450f6379 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.302s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:04:47 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-7a176194-cd85-4ef5-8796-7502450f6379 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Deleted allocations for instance c3c0a004-8d70-4253-bf17-b83088e30031
Aug 14 23:04:47 user nova-compute[72766]: DEBUG nova.compute.manager [req-2f34e7dc-0486-4dad-bab1-a66ecfdefee8 req-bac3ec35-05bc-4583-8f78-ee35099abde3 service nova] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Received event network-vif-plugged-26e28590-b9de-41c5-809d-06e3458eca3f {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:04:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2f34e7dc-0486-4dad-bab1-a66ecfdefee8 req-bac3ec35-05bc-4583-8f78-ee35099abde3 service nova] Acquiring lock "c3c0a004-8d70-4253-bf17-b83088e30031-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:04:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2f34e7dc-0486-4dad-bab1-a66ecfdefee8 req-bac3ec35-05bc-4583-8f78-ee35099abde3 service nova] Lock "c3c0a004-8d70-4253-bf17-b83088e30031-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:04:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2f34e7dc-0486-4dad-bab1-a66ecfdefee8 req-bac3ec35-05bc-4583-8f78-ee35099abde3 service nova] Lock "c3c0a004-8d70-4253-bf17-b83088e30031-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:04:47 user nova-compute[72766]: DEBUG nova.compute.manager [req-2f34e7dc-0486-4dad-bab1-a66ecfdefee8 req-bac3ec35-05bc-4583-8f78-ee35099abde3 service nova] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] No waiting events found dispatching network-vif-plugged-26e28590-b9de-41c5-809d-06e3458eca3f {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:04:47 user nova-compute[72766]: WARNING nova.compute.manager [req-2f34e7dc-0486-4dad-bab1-a66ecfdefee8 req-bac3ec35-05bc-4583-8f78-ee35099abde3 service nova] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Received unexpected event network-vif-plugged-26e28590-b9de-41c5-809d-06e3458eca3f for instance with vm_state deleted and task_state None.
Aug 14 23:04:47 user nova-compute[72766]: DEBUG nova.compute.manager [req-2f34e7dc-0486-4dad-bab1-a66ecfdefee8 req-bac3ec35-05bc-4583-8f78-ee35099abde3 service nova] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Received event network-vif-deleted-26e28590-b9de-41c5-809d-06e3458eca3f {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:04:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7a176194-cd85-4ef5-8796-7502450f6379 tempest-SnapshotDataIntegrityTests-1743181261 tempest-SnapshotDataIntegrityTests-1743181261-project-member] Lock "c3c0a004-8d70-4253-bf17-b83088e30031" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.361s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:04:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:54 user nova-compute[72766]: DEBUG nova.compute.manager [req-ecdfa654-839a-4e16-ba7c-d06a2b6526cf req-84386a25-4151-4513-a89b-53521e05bbea service nova] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Received event network-changed-8f65f8f0-60fe-4fdb-af66-424a85b12caf {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:04:54 user nova-compute[72766]: DEBUG nova.compute.manager [req-ecdfa654-839a-4e16-ba7c-d06a2b6526cf req-84386a25-4151-4513-a89b-53521e05bbea service nova] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Refreshing instance network info cache due to event network-changed-8f65f8f0-60fe-4fdb-af66-424a85b12caf. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:04:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ecdfa654-839a-4e16-ba7c-d06a2b6526cf req-84386a25-4151-4513-a89b-53521e05bbea service nova] Acquiring lock "refresh_cache-cbcf7851-e6f7-4f46-97cc-d773286ccddf" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:04:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ecdfa654-839a-4e16-ba7c-d06a2b6526cf req-84386a25-4151-4513-a89b-53521e05bbea service nova] Acquired lock "refresh_cache-cbcf7851-e6f7-4f46-97cc-d773286ccddf" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:04:54 user nova-compute[72766]: DEBUG nova.network.neutron [req-ecdfa654-839a-4e16-ba7c-d06a2b6526cf req-84386a25-4151-4513-a89b-53521e05bbea service nova] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Refreshing network info cache for port 8f65f8f0-60fe-4fdb-af66-424a85b12caf {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:04:54 user nova-compute[72766]: DEBUG nova.network.neutron [req-ecdfa654-839a-4e16-ba7c-d06a2b6526cf req-84386a25-4151-4513-a89b-53521e05bbea service nova] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Updated VIF entry in instance network info cache for port 8f65f8f0-60fe-4fdb-af66-424a85b12caf. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:04:54 user nova-compute[72766]: DEBUG nova.network.neutron [req-ecdfa654-839a-4e16-ba7c-d06a2b6526cf req-84386a25-4151-4513-a89b-53521e05bbea service nova] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Updating instance_info_cache with network_info: [{"id": "8f65f8f0-60fe-4fdb-af66-424a85b12caf", "address": "fa:16:3e:70:30:66", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f65f8f0-60", "ovs_interfaceid": "8f65f8f0-60fe-4fdb-af66-424a85b12caf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:04:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ecdfa654-839a-4e16-ba7c-d06a2b6526cf req-84386a25-4151-4513-a89b-53521e05bbea service nova] Releasing lock "refresh_cache-cbcf7851-e6f7-4f46-97cc-d773286ccddf" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:04:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f09970ef-dc81-4e77-bdd1-24952337ba12 tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Acquiring lock "4f7a13a8-6ac1-4b19-8c5c-f54406790f58" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:04:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f09970ef-dc81-4e77-bdd1-24952337ba12 tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Lock "4f7a13a8-6ac1-4b19-8c5c-f54406790f58" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:04:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f09970ef-dc81-4e77-bdd1-24952337ba12 tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Acquiring lock "4f7a13a8-6ac1-4b19-8c5c-f54406790f58-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:04:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f09970ef-dc81-4e77-bdd1-24952337ba12 tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Lock "4f7a13a8-6ac1-4b19-8c5c-f54406790f58-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:04:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f09970ef-dc81-4e77-bdd1-24952337ba12 tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Lock "4f7a13a8-6ac1-4b19-8c5c-f54406790f58-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:04:55 user nova-compute[72766]: INFO nova.compute.manager [None req-f09970ef-dc81-4e77-bdd1-24952337ba12 tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Terminating instance
Aug 14 23:04:55 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f09970ef-dc81-4e77-bdd1-24952337ba12 tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:04:55 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:55 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:55 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:55 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:55 user nova-compute[72766]: DEBUG nova.compute.manager [req-fef447cb-3391-4876-950b-4c4f5c35cb6b req-330b0bbf-8020-4290-b8e0-335918b3b8e8 service nova] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Received event network-vif-unplugged-b702ab41-e9af-4548-a80f-c68f90220afb {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:04:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-fef447cb-3391-4876-950b-4c4f5c35cb6b req-330b0bbf-8020-4290-b8e0-335918b3b8e8 service nova] Acquiring lock "4f7a13a8-6ac1-4b19-8c5c-f54406790f58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:04:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-fef447cb-3391-4876-950b-4c4f5c35cb6b req-330b0bbf-8020-4290-b8e0-335918b3b8e8 service nova] Lock "4f7a13a8-6ac1-4b19-8c5c-f54406790f58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:04:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-fef447cb-3391-4876-950b-4c4f5c35cb6b req-330b0bbf-8020-4290-b8e0-335918b3b8e8 service nova] Lock "4f7a13a8-6ac1-4b19-8c5c-f54406790f58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:04:55 user nova-compute[72766]: DEBUG nova.compute.manager [req-fef447cb-3391-4876-950b-4c4f5c35cb6b req-330b0bbf-8020-4290-b8e0-335918b3b8e8 service nova] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] No waiting events found dispatching network-vif-unplugged-b702ab41-e9af-4548-a80f-c68f90220afb {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:04:55 user nova-compute[72766]: DEBUG nova.compute.manager [req-fef447cb-3391-4876-950b-4c4f5c35cb6b req-330b0bbf-8020-4290-b8e0-335918b3b8e8 service nova] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Received event network-vif-unplugged-b702ab41-e9af-4548-a80f-c68f90220afb for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:04:55 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Instance destroyed successfully.
Aug 14 23:04:55 user nova-compute[72766]: DEBUG nova.objects.instance [None req-f09970ef-dc81-4e77-bdd1-24952337ba12 tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Lazy-loading 'resources' on Instance uuid 4f7a13a8-6ac1-4b19-8c5c-f54406790f58 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:04:55 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-f09970ef-dc81-4e77-bdd1-24952337ba12 tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:03:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1371071889',display_name='tempest-VolumesActionsTest-instance-1371071889',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1371071889',id=20,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:03:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83eb682791ee4b4b9d0637f33e1ce2b3',ramdisk_id='',reservation_id='r-wi3efbrp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-562398048',owner_user_name='tempest-VolumesActionsTest-562398048-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:03:14Z,user_data=None,user_id='0f127c1a39bb4606b5299ae048d62890',uuid=4f7a13a8-6ac1-4b19-8c5c-f54406790f58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b702ab41-e9af-4548-a80f-c68f90220afb", "address": "fa:16:3e:31:4f:b7", "network": {"id": "ba73a346-5f7e-4749-9757-4965ccb4be6f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-537717022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83eb682791ee4b4b9d0637f33e1ce2b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb702ab41-e9", "ovs_interfaceid": "b702ab41-e9af-4548-a80f-c68f90220afb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:04:55 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-f09970ef-dc81-4e77-bdd1-24952337ba12 tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Converting VIF {"id": "b702ab41-e9af-4548-a80f-c68f90220afb", "address": "fa:16:3e:31:4f:b7", "network": {"id": "ba73a346-5f7e-4749-9757-4965ccb4be6f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-537717022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83eb682791ee4b4b9d0637f33e1ce2b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb702ab41-e9", "ovs_interfaceid": "b702ab41-e9af-4548-a80f-c68f90220afb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:04:55 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-f09970ef-dc81-4e77-bdd1-24952337ba12 tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:4f:b7,bridge_name='br-int',has_traffic_filtering=True,id=b702ab41-e9af-4548-a80f-c68f90220afb,network=Network(ba73a346-5f7e-4749-9757-4965ccb4be6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb702ab41-e9') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:04:55 user nova-compute[72766]: DEBUG os_vif [None req-f09970ef-dc81-4e77-bdd1-24952337ba12 tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:4f:b7,bridge_name='br-int',has_traffic_filtering=True,id=b702ab41-e9af-4548-a80f-c68f90220afb,network=Network(ba73a346-5f7e-4749-9757-4965ccb4be6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb702ab41-e9') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:04:55 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:55 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb702ab41-e9, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:04:55 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:55 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:04:55 user nova-compute[72766]: INFO os_vif [None req-f09970ef-dc81-4e77-bdd1-24952337ba12 tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:4f:b7,bridge_name='br-int',has_traffic_filtering=True,id=b702ab41-e9af-4548-a80f-c68f90220afb,network=Network(ba73a346-5f7e-4749-9757-4965ccb4be6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb702ab41-e9')
Aug 14 23:04:55 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-f09970ef-dc81-4e77-bdd1-24952337ba12 tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Deleting instance files /opt/stack/data/nova/instances/4f7a13a8-6ac1-4b19-8c5c-f54406790f58_del
Aug 14 23:04:55 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-f09970ef-dc81-4e77-bdd1-24952337ba12 tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Deletion of /opt/stack/data/nova/instances/4f7a13a8-6ac1-4b19-8c5c-f54406790f58_del complete
Aug 14 23:04:56 user nova-compute[72766]: INFO nova.compute.manager [None req-f09970ef-dc81-4e77-bdd1-24952337ba12 tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Took 0.82 seconds to destroy the instance on the hypervisor.
Aug 14 23:04:56 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-f09970ef-dc81-4e77-bdd1-24952337ba12 tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:04:56 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:04:56 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:04:56 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:04:56 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Took 0.47 seconds to deallocate network for instance.
Aug 14 23:04:56 user nova-compute[72766]: DEBUG nova.compute.manager [req-dcf9c0ef-ac96-4765-b969-6d3be93b20c2 req-cffc21ef-c58f-4943-bc94-0e91d79b8efa service nova] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Received event network-vif-deleted-b702ab41-e9af-4548-a80f-c68f90220afb {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:04:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f09970ef-dc81-4e77-bdd1-24952337ba12 tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:04:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f09970ef-dc81-4e77-bdd1-24952337ba12 tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:04:56 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-f09970ef-dc81-4e77-bdd1-24952337ba12 tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:04:56 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-f09970ef-dc81-4e77-bdd1-24952337ba12 tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:04:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f09970ef-dc81-4e77-bdd1-24952337ba12 tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.320s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:04:57 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-f09970ef-dc81-4e77-bdd1-24952337ba12 tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Deleted allocations for instance 4f7a13a8-6ac1-4b19-8c5c-f54406790f58
Aug 14 23:04:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:04:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f09970ef-dc81-4e77-bdd1-24952337ba12 tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Lock "4f7a13a8-6ac1-4b19-8c5c-f54406790f58" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.815s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:04:57 user nova-compute[72766]: DEBUG nova.compute.manager [req-dec949c8-d055-4792-8fae-ad314eb70420 req-b3b0a5cd-3c85-4fa8-a931-144294293ccc service nova] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Received event network-vif-plugged-b702ab41-e9af-4548-a80f-c68f90220afb {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:04:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-dec949c8-d055-4792-8fae-ad314eb70420 req-b3b0a5cd-3c85-4fa8-a931-144294293ccc service nova] Acquiring lock "4f7a13a8-6ac1-4b19-8c5c-f54406790f58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:04:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-dec949c8-d055-4792-8fae-ad314eb70420 req-b3b0a5cd-3c85-4fa8-a931-144294293ccc service nova] Lock "4f7a13a8-6ac1-4b19-8c5c-f54406790f58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:04:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-dec949c8-d055-4792-8fae-ad314eb70420 req-b3b0a5cd-3c85-4fa8-a931-144294293ccc service nova] Lock "4f7a13a8-6ac1-4b19-8c5c-f54406790f58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:04:57 user nova-compute[72766]: DEBUG nova.compute.manager [req-dec949c8-d055-4792-8fae-ad314eb70420 req-b3b0a5cd-3c85-4fa8-a931-144294293ccc service nova] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] No waiting events found dispatching network-vif-plugged-b702ab41-e9af-4548-a80f-c68f90220afb {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:04:57 user nova-compute[72766]: WARNING nova.compute.manager [req-dec949c8-d055-4792-8fae-ad314eb70420 req-b3b0a5cd-3c85-4fa8-a931-144294293ccc service nova] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Received unexpected event network-vif-plugged-b702ab41-e9af-4548-a80f-c68f90220afb for instance with vm_state deleted and task_state None.
Aug 14 23:04:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:00 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:01 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692054286.1137705, c3c0a004-8d70-4253-bf17-b83088e30031 => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:05:01 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] VM Stopped (Lifecycle Event)
Aug 14 23:05:01 user nova-compute[72766]: DEBUG nova.compute.manager [None req-613a5e68-c394-48d0-8b98-af6ff216bc11 None None] [instance: c3c0a004-8d70-4253-bf17-b83088e30031] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:05:03 user nova-compute[72766]: DEBUG nova.compute.manager [req-e751c58e-6352-44ba-ab17-2c82ab7f60c2 req-900924e6-2ad7-4b3a-83d3-a80abdf97f04 service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Received event network-changed-ffc1761b-5d95-4c58-9b92-b6b43b4823a6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:05:03 user nova-compute[72766]: DEBUG nova.compute.manager [req-e751c58e-6352-44ba-ab17-2c82ab7f60c2 req-900924e6-2ad7-4b3a-83d3-a80abdf97f04 service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Refreshing instance network info cache due to event network-changed-ffc1761b-5d95-4c58-9b92-b6b43b4823a6. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:05:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e751c58e-6352-44ba-ab17-2c82ab7f60c2 req-900924e6-2ad7-4b3a-83d3-a80abdf97f04 service nova] Acquiring lock "refresh_cache-66578337-cbff-4613-87a1-85ddabaebb2d" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:05:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e751c58e-6352-44ba-ab17-2c82ab7f60c2 req-900924e6-2ad7-4b3a-83d3-a80abdf97f04 service nova] Acquired lock "refresh_cache-66578337-cbff-4613-87a1-85ddabaebb2d" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:05:03 user nova-compute[72766]: DEBUG nova.network.neutron [req-e751c58e-6352-44ba-ab17-2c82ab7f60c2 req-900924e6-2ad7-4b3a-83d3-a80abdf97f04 service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Refreshing network info cache for port ffc1761b-5d95-4c58-9b92-b6b43b4823a6 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:05:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:03 user nova-compute[72766]: DEBUG nova.network.neutron [req-e751c58e-6352-44ba-ab17-2c82ab7f60c2 req-900924e6-2ad7-4b3a-83d3-a80abdf97f04 service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Updated VIF entry in instance network info cache for port ffc1761b-5d95-4c58-9b92-b6b43b4823a6. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:05:03 user nova-compute[72766]: DEBUG nova.network.neutron [req-e751c58e-6352-44ba-ab17-2c82ab7f60c2 req-900924e6-2ad7-4b3a-83d3-a80abdf97f04 service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Updating instance_info_cache with network_info: [{"id": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "address": "fa:16:3e:e2:97:1e", "network": {"id": "b375da9b-b613-4a88-a262-962f959597b9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-462508113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1dd09415664f1aa0b0dbdeeb4b8d32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffc1761b-5d", "ovs_interfaceid": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:05:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e751c58e-6352-44ba-ab17-2c82ab7f60c2 req-900924e6-2ad7-4b3a-83d3-a80abdf97f04 service nova] Releasing lock "refresh_cache-66578337-cbff-4613-87a1-85ddabaebb2d" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:05:05 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:06 user nova-compute[72766]: INFO nova.compute.manager [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Rescuing
Aug 14 23:05:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "refresh_cache-83084ccc-8e55-43dc-9a37-ffcb35a10922" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:05:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquired lock "refresh_cache-83084ccc-8e55-43dc-9a37-ffcb35a10922" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:05:06 user nova-compute[72766]: DEBUG nova.network.neutron [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:05:06 user nova-compute[72766]: DEBUG nova.network.neutron [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Updating instance_info_cache with network_info: [{"id": "cbbf0086-17e4-41a5-8893-cf8657faf6e5", "address": "fa:16:3e:22:4b:22", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbbf0086-17", "ovs_interfaceid": "cbbf0086-17e4-41a5-8893-cf8657faf6e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:05:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Releasing lock "refresh_cache-83084ccc-8e55-43dc-9a37-ffcb35a10922" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:05:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:07 user nova-compute[72766]: DEBUG nova.compute.manager [req-fad0a88f-6111-47cc-97a8-c651f4185a8d req-8a427dda-5746-40c4-97e0-403af6abe9e9 service nova] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Received event network-vif-unplugged-cbbf0086-17e4-41a5-8893-cf8657faf6e5 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:05:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-fad0a88f-6111-47cc-97a8-c651f4185a8d req-8a427dda-5746-40c4-97e0-403af6abe9e9 service nova] Acquiring lock "83084ccc-8e55-43dc-9a37-ffcb35a10922-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:05:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-fad0a88f-6111-47cc-97a8-c651f4185a8d req-8a427dda-5746-40c4-97e0-403af6abe9e9 service nova] Lock "83084ccc-8e55-43dc-9a37-ffcb35a10922-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:05:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-fad0a88f-6111-47cc-97a8-c651f4185a8d req-8a427dda-5746-40c4-97e0-403af6abe9e9 service nova] Lock "83084ccc-8e55-43dc-9a37-ffcb35a10922-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:05:07 user nova-compute[72766]: DEBUG nova.compute.manager [req-fad0a88f-6111-47cc-97a8-c651f4185a8d req-8a427dda-5746-40c4-97e0-403af6abe9e9 service nova] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] No waiting events found dispatching network-vif-unplugged-cbbf0086-17e4-41a5-8893-cf8657faf6e5 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:05:07 user nova-compute[72766]: WARNING nova.compute.manager [req-fad0a88f-6111-47cc-97a8-c651f4185a8d req-8a427dda-5746-40c4-97e0-403af6abe9e9 service nova] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Received unexpected event network-vif-unplugged-cbbf0086-17e4-41a5-8893-cf8657faf6e5 for instance with vm_state active and task_state rescuing.
Aug 14 23:05:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:07 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Instance destroyed successfully.
Aug 14 23:05:07 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Attempting a stable device rescue
Aug 14 23:05:07 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72766) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 23:05:07 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Instance directory exists: not creating {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 23:05:07 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Creating image(s)
Aug 14 23:05:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "/opt/stack/data/nova/instances/83084ccc-8e55-43dc-9a37-ffcb35a10922/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:05:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "/opt/stack/data/nova/instances/83084ccc-8e55-43dc-9a37-ffcb35a10922/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:05:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "/opt/stack/data/nova/instances/83084ccc-8e55-43dc-9a37-ffcb35a10922/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:05:07 user nova-compute[72766]: DEBUG nova.objects.instance [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lazy-loading 'trusted_certs' on Instance uuid 83084ccc-8e55-43dc-9a37-ffcb35a10922 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:05:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "8005891b5d22480a01e40ca47f5293549de4b601" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:05:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "8005891b5d22480a01e40ca47f5293549de4b601" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:05:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8005891b5d22480a01e40ca47f5293549de4b601.part --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8005891b5d22480a01e40ca47f5293549de4b601.part --force-share --output=json" returned: 0 in 0.191s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:08 user nova-compute[72766]: DEBUG nova.virt.images [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] c606cb63-2165-4bfb-91b7-0c6f19e46f20 was qcow2, converting to raw {{(pid=72766) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 23:05:08 user nova-compute[72766]: DEBUG nova.privsep.utils [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72766) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 23:05:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8005891b5d22480a01e40ca47f5293549de4b601.part /opt/stack/data/nova/instances/_base/8005891b5d22480a01e40ca47f5293549de4b601.converted {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8005891b5d22480a01e40ca47f5293549de4b601.part /opt/stack/data/nova/instances/_base/8005891b5d22480a01e40ca47f5293549de4b601.converted" returned: 0 in 0.220s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8005891b5d22480a01e40ca47f5293549de4b601.converted --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG nova.compute.manager [req-9ef304f8-bff4-40b4-8120-bd79075eb3a5 req-9de83313-3851-42cc-8ae7-1206d0333289 service nova] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Received event network-vif-plugged-cbbf0086-17e4-41a5-8893-cf8657faf6e5 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9ef304f8-bff4-40b4-8120-bd79075eb3a5 req-9de83313-3851-42cc-8ae7-1206d0333289 service nova] Acquiring lock "83084ccc-8e55-43dc-9a37-ffcb35a10922-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9ef304f8-bff4-40b4-8120-bd79075eb3a5 req-9de83313-3851-42cc-8ae7-1206d0333289 service nova] Lock "83084ccc-8e55-43dc-9a37-ffcb35a10922-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9ef304f8-bff4-40b4-8120-bd79075eb3a5 req-9de83313-3851-42cc-8ae7-1206d0333289 service nova] Lock "83084ccc-8e55-43dc-9a37-ffcb35a10922-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG nova.compute.manager [req-9ef304f8-bff4-40b4-8120-bd79075eb3a5 req-9de83313-3851-42cc-8ae7-1206d0333289 service nova] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] No waiting events found dispatching network-vif-plugged-cbbf0086-17e4-41a5-8893-cf8657faf6e5 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:05:09 user nova-compute[72766]: WARNING nova.compute.manager [req-9ef304f8-bff4-40b4-8120-bd79075eb3a5 req-9de83313-3851-42cc-8ae7-1206d0333289 service nova] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Received unexpected event network-vif-plugged-cbbf0086-17e4-41a5-8893-cf8657faf6e5 for instance with vm_state active and task_state rescuing.
Aug 14 23:05:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8005891b5d22480a01e40ca47f5293549de4b601.converted --force-share --output=json" returned: 0 in 0.186s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "8005891b5d22480a01e40ca47f5293549de4b601" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.597s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "8005891b5d22480a01e40ca47f5293549de4b601" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "8005891b5d22480a01e40ca47f5293549de4b601" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8005891b5d22480a01e40ca47f5293549de4b601 --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8005891b5d22480a01e40ca47f5293549de4b601 --force-share --output=json" returned: 0 in 0.175s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8005891b5d22480a01e40ca47f5293549de4b601,backing_fmt=raw /opt/stack/data/nova/instances/83084ccc-8e55-43dc-9a37-ffcb35a10922/disk.rescue {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8005891b5d22480a01e40ca47f5293549de4b601,backing_fmt=raw /opt/stack/data/nova/instances/83084ccc-8e55-43dc-9a37-ffcb35a10922/disk.rescue" returned: 0 in 0.049s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "8005891b5d22480a01e40ca47f5293549de4b601" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG nova.objects.instance [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lazy-loading 'migration_context' on Instance uuid 83084ccc-8e55-43dc-9a37-ffcb35a10922 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Start _get_guest_xml network_info=[{"id": "cbbf0086-17e4-41a5-8893-cf8657faf6e5", "address": "fa:16:3e:22:4b:22", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "vif_mac": "fa:16:3e:22:4b:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbbf0086-17", "ovs_interfaceid": "cbbf0086-17e4-41a5-8893-cf8657faf6e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c606cb63-2165-4bfb-91b7-0c6f19e46f20', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '3f19e8cd-7e1c-4f24-9819-ca5835ea2e67', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JEHjDmsq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '83084ccc-8e55-43dc-9a37-ffcb35a10922', 'attached_at': '', 'detached_at': '', 'volume_id': 'c69b0c70-6633-43aa-bc9e-d46f033b8966', 'serial': 'c69b0c70-6633-43aa-bc9e-d46f033b8966'}, 'volume_type': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG nova.objects.instance [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lazy-loading 'resources' on Instance uuid 83084ccc-8e55-43dc-9a37-ffcb35a10922 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG nova.objects.instance [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lazy-loading 'numa_topology' on Instance uuid 83084ccc-8e55-43dc-9a37-ffcb35a10922 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:05:09 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:05:09 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:05:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG nova.objects.instance [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lazy-loading 'vcpu_model' on Instance uuid 83084ccc-8e55-43dc-9a37-ffcb35a10922 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JEHjDmsq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:05:09 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:05:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:05:09 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:05:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:05:09 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 23:05:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1c8e5c-341f-4e30-9a3b-0cf2d4b3fb39]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = JEHjDmsq\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 14 23:05:09 user nova-compute[72766]: node.name = iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966
Aug 14 23:05:09 user nova-compute[72766]: node.tpgt = -1
Aug 14 23:05:09 user nova-compute[72766]: node.startup = automatic
Aug 14 23:05:09 user nova-compute[72766]: node.leading_login = No
Aug 14 23:05:09 user nova-compute[72766]: iface.iscsi_ifacename = default
Aug 14 23:05:09 user nova-compute[72766]: iface.net_ifacename = <empty>
Aug 14 23:05:09 user nova-compute[72766]: iface.ipaddress = <empty>
Aug 14 23:05:09 user nova-compute[72766]: iface.prefix_len = 0
Aug 14 23:05:09 user nova-compute[72766]: iface.hwaddress = <empty>
Aug 14 23:05:09 user nova-compute[72766]: iface.transport_name = tcp
Aug 14 23:05:09 user nova-compute[72766]: iface.initiatorname = <empty>
Aug 14 23:05:09 user nova-compute[72766]: iface.state = <empty>
Aug 14 23:05:09 user nova-compute[72766]: iface.vlan_id = 0
Aug 14 23:05:09 user nova-compute[72766]: iface.vlan_priority = 0
Aug 14 23:05:09 user nova-compute[72766]: iface.vlan_state = <empty>
Aug 14 23:05:09 user nova-compute[72766]: iface.iface_num = 0
Aug 14 23:05:09 user nova-compute[72766]: iface.mtu = 0
Aug 14 23:05:09 user nova-compute[72766]: iface.port = 0
Aug 14 23:05:09 user nova-compute[72766]: iface.bootproto = <empty>
Aug 14 23:05:09 user nova-compute[72766]: iface.subnet_mask = <empty>
Aug 14 23:05:09 user nova-compute[72766]: iface.gateway = <empty>
Aug 14 23:05:09 user nova-compute[72766]: iface.dhcp_alt_client_id_state = <empty>
Aug 14 23:05:09 user nova-compute[72766]: iface.dhcp_alt_client_id = <empty>
Aug 14 23:05:09 user nova-compute[72766]: iface.dhcp_dns = <empty>
Aug 14 23:05:09 user nova-compute[72766]: iface.dhcp_learn_iqn = <empty>
Aug 14 23:05:09 user nova-compute[72766]: iface.dhcp_req_vendor_id_state = <empty>
Aug 14 23:05:09 user nova-compute[72766]: iface.dhcp_vendor_id_state = <empty>
Aug 14 23:05:09 user nova-compute[72766]: iface.dhcp_vendor_id = <empty>
Aug 14 23:05:09 user nova-compute[72766]: iface.dhcp_slp_da = <empty>
Aug 14 23:05:09 user nova-compute[72766]: iface.fragmentation = <empty>
Aug 14 23:05:09 user nova-compute[72766]: iface.gratuitous_arp = <empty>
Aug 14 23:05:09 user nova-compute[72766]: iface.incoming_forwarding = <empty>
Aug 14 23:05:09 user nova-compute[72766]: iface.tos_state = <empty>
Aug 14 23:05:09 user nova-compute[72766]: iface.tos = 0
Aug 14 23:05:09 user nova-compute[72766]: iface.ttl = 0
Aug 14 23:05:09 user nova-compute[72766]: iface.delayed_ack = <empty>
Aug 14 23:05:09 user nova-compute[72766]: iface.tcp_nagle = <empty>
Aug 14 23:05:09 user nova-compute[72766]: iface.tcp_wsf_state = <empty>
Aug 14 23:05:09 user nova-compute[72766]: iface.tcp_wsf = 0
Aug 14 23:05:09 user nova-compute[72766]: iface.tcp_timer_scale = 0
Aug 14 23:05:09 user nova-compute[72766]: iface.tcp_timestamp = <empty>
Aug 14 23:05:09 user nova-compute[72766]: iface.redirect = <empty>
Aug 14 23:05:09 user nova-compute[72766]: iface.def_task_mgmt_timeout = 0
Aug 14 23:05:09 user nova-compute[72766]: iface.header_digest = <empty>
Aug 14 23:05:09 user nova-compute[72766]: iface.data_digest = <empty>
Aug 14 23:05:09 user nova-compute[72766]: iface.immediate_data = <empty>
Aug 14 23:05:09 user nova-compute[72766]: iface.initial_r2t = <empty>
Aug 14 23:05:09 user nova-compute[72766]: iface.data_seq_inorder = <empty>
Aug 14 23:05:09 user nova-compute[72766]: iface.data_pdu_inorder = <empty>
Aug 14 23:05:09 user nova-compute[72766]: iface.erl = 0
Aug 14 23:05:09 user nova-compute[72766]: iface.max_receive_data_len = 0
Aug 14 23:05:09 user nova-compute[72766]: iface.first_burst_len = 0
Aug 14 23:05:09 user nova-compute[72766]: iface.max_outstanding_r2t = 0
Aug 14 23:05:09 user nova-compute[72766]: iface.max_burst_len = 0
Aug 14 23:05:09 user nova-compute[72766]: iface.chap_auth = <empty>
Aug 14 23:05:09 user nova-compute[72766]: iface.bidi_chap = <empty>
Aug 14 23:05:09 user nova-compute[72766]: iface.strict_login_compliance = <empty>
Aug 14 23:05:09 user nova-compute[72766]: iface.discovery_auth = <empty>
Aug 14 23:05:09 user nova-compute[72766]: iface.discovery_logout = <empty>
Aug 14 23:05:09 user nova-compute[72766]: node.discovery_address = <empty>
Aug 14 23:05:09 user nova-compute[72766]: node.discovery_port = 0
Aug 14 23:05:09 user nova-compute[72766]: node.discovery_type = static
Aug 14 23:05:09 user nova-compute[72766]: node.session.initial_cmdsn = 0
Aug 14 23:05:09 user nova-compute[72766]: node.session.initial_login_retry_max = 8
Aug 14 23:05:09 user nova-compute[72766]: node.session.xmit_thread_priority = -20
Aug 14 23:05:09 user nova-compute[72766]: node.session.cmds_max = 128
Aug 14 23:05:09 user nova-compute[72766]: node.session.queue_depth = 32
Aug 14 23:05:09 user nova-compute[72766]: node.session.nr_sessions = 1
Aug 14 23:05:09 user nova-compute[72766]: node.session.auth.authmethod = CHAP
Aug 14 23:05:09 user nova-compute[72766]: node.session.auth.username = JEHjDmsq
Aug 14 23:05:09 user nova-compute[72766]: node.session.auth.password = ***
Aug 14 23:05:09 user nova-compute[72766]: node.session.auth.username_in = <empty>
Aug 14 23:05:09 user nova-compute[72766]: node.session.auth.password_in = <empty>
Aug 14 23:05:09 user nova-compute[72766]: node.session.auth.chap_algs = MD5
Aug 14 23:05:09 user nova-compute[72766]: node.session.timeo.replacement_timeout = 120
Aug 14 23:05:09 user nova-compute[72766]: node.session.err_timeo.abort_timeout = 15
Aug 14 23:05:09 user nova-compute[72766]: node.session.err_timeo.lu_reset_timeout = 30
Aug 14 23:05:09 user nova-compute[72766]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 14 23:05:09 user nova-compute[72766]: node.session.err_timeo.host_reset_timeout = 60
Aug 14 23:05:09 user nova-compute[72766]: node.session.iscsi.FastAbort = Yes
Aug 14 23:05:09 user nova-compute[72766]: node.session.iscsi.InitialR2T = No
Aug 14 23:05:09 user nova-compute[72766]: node.session.iscsi.ImmediateData = Yes
Aug 14 23:05:09 user nova-compute[72766]: node.session.iscsi.FirstBurstLength = 262144
Aug 14 23:05:09 user nova-compute[72766]: node.session.iscsi.MaxBurstLength = 16776192
Aug 14 23:05:09 user nova-compute[72766]: node.session.iscsi.DefaultTime2Retain = 0
Aug 14 23:05:09 user nova-compute[72766]: node.session.iscsi.DefaultTime2Wait = 2
Aug 14 23:05:09 user nova-compute[72766]: node.session.iscsi.MaxConnections = 1
Aug 14 23:05:09 user nova-compute[72766]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 14 23:05:09 user nova-compute[72766]: node.session.iscsi.ERL = 0
Aug 14 23:05:09 user nova-compute[72766]: node.session.scan = manual
Aug 14 23:05:09 user nova-compute[72766]: node.session.reopen_max = 0
Aug 14 23:05:09 user nova-compute[72766]: node.conn[0].address = 172.16.0.220
Aug 14 23:05:09 user nova-compute[72766]: node.conn[0].port = 3260
Aug 14 23:05:09 user nova-compute[72766]: node.conn[0].startup = manual
Aug 14 23:05:09 user nova-compute[72766]: node.conn[0].tcp.window_size = 524288
Aug 14 23:05:09 user nova-compute[72766]: node.conn[0].tcp.type_of_service = 0
Aug 14 23:05:09 user nova-compute[72766]: node.conn[0].timeo.logout_timeout = 15
Aug 14 23:05:09 user nova-compute[72766]: node.conn[0].timeo.login_timeout = 15
Aug 14 23:05:09 user nova-compute[72766]: node.conn[0].timeo.auth_timeout = 45
Aug 14 23:05:09 user nova-compute[72766]: node.conn[0].timeo.noop_out_interval = 5
Aug 14 23:05:09 user nova-compute[72766]: node.conn[0].timeo.noop_out_timeout = 5
Aug 14 23:05:09 user nova-compute[72766]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 14 23:05:09 user nova-compute[72766]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 14 23:05:09 user nova-compute[72766]: node.conn[0].iscsi.HeaderDigest = None
Aug 14 23:05:09 user nova-compute[72766]: node.conn[0].iscsi.DataDigest = None
Aug 14 23:05:09 user nova-compute[72766]: node.conn[0].iscsi.IFMarker = No
Aug 14 23:05:09 user nova-compute[72766]: node.conn[0].iscsi.OFMarker = No
Aug 14 23:05:09 user nova-compute[72766]: # END RECORD
Aug 14 23:05:09 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e553fbbb-190b-454f-ab55-bf36e6a0fb87]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[9445d47b-c7e0-453c-98a5-85b64de00e38]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JEHjDmsq {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JEHjDmsq" returned: 0 in 0.056s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9ff93a-7cb8-459b-8ab3-f94c85864e3c]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JEHjDmsq'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da944f2-904b-4c89-bb5c-f003ac7408ca]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0288c6-accb-4173-86f5-e8b978f4b357]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:05:09 user nova-compute[72766]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f (non-flash)
Aug 14 23:05:09 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:05:09 user nova-compute[72766]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f (non-flash)
Aug 14 23:05:09 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.194s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] HCTL ('37', '0', '0', 0) found on session 27 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 23:05:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:10 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3af794a-f40e-4ce4-86b8-e05dada1d8a4]: (4, ('0 0 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:10 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Searching for a device in session 27 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:05:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JEHjDmsq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 23:05:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.222s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:05:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] <== connect_volume: return (223ms) {'type': 'block', 'scsi_wwn': '26430376662623437', 'path': '/dev/sdf'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:05:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430376662623437', 'path': '/dev/sdf'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 23:05:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:03:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1775402070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1775402070',id=22,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:03:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3725c4b1cd78403f9628c8af9f8e5cc5',ramdisk_id='',reservation_id='r-0ruzrjdf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-86235447',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:03:37Z,user_data=None,user_id='32e61321c50d4af28adeab72811a3f86',uuid=83084ccc-8e55-43dc-9a37-ffcb35a10922,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cbbf0086-17e4-41a5-8893-cf8657faf6e5", "address": "fa:16:3e:22:4b:22", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "vif_mac": "fa:16:3e:22:4b:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbbf0086-17", "ovs_interfaceid": "cbbf0086-17e4-41a5-8893-cf8657faf6e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:05:10 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Converting VIF {"id": "cbbf0086-17e4-41a5-8893-cf8657faf6e5", "address": "fa:16:3e:22:4b:22", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "vif_mac": "fa:16:3e:22:4b:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbbf0086-17", "ovs_interfaceid": "cbbf0086-17e4-41a5-8893-cf8657faf6e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:05:10 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:4b:22,bridge_name='br-int',has_traffic_filtering=True,id=cbbf0086-17e4-41a5-8893-cf8657faf6e5,network=Network(f4efdeee-d89b-45e5-b0d9-b45573564e9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbbf0086-17') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:05:10 user nova-compute[72766]: DEBUG nova.objects.instance [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lazy-loading 'pci_devices' on Instance uuid 83084ccc-8e55-43dc-9a37-ffcb35a10922 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:05:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:05:10 user nova-compute[72766]:   <uuid>83084ccc-8e55-43dc-9a37-ffcb35a10922</uuid>
Aug 14 23:05:10 user nova-compute[72766]:   <name>instance-00000016</name>
Aug 14 23:05:10 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:05:10 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:05:10 user nova-compute[72766]:   <metadata>
Aug 14 23:05:10 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:05:10 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:05:10 user nova-compute[72766]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1775402070</nova:name>
Aug 14 23:05:10 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:05:09</nova:creationTime>
Aug 14 23:05:10 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:05:10 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:05:10 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:05:10 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:05:10 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:05:10 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:05:10 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:05:10 user nova-compute[72766]:       <nova:owner>
Aug 14 23:05:10 user nova-compute[72766]:         <nova:user uuid="32e61321c50d4af28adeab72811a3f86">tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member</nova:user>
Aug 14 23:05:10 user nova-compute[72766]:         <nova:project uuid="3725c4b1cd78403f9628c8af9f8e5cc5">tempest-ServerBootFromVolumeStableRescueTest-86235447</nova:project>
Aug 14 23:05:10 user nova-compute[72766]:       </nova:owner>
Aug 14 23:05:10 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 23:05:10 user nova-compute[72766]:       <nova:ports>
Aug 14 23:05:10 user nova-compute[72766]:         <nova:port uuid="cbbf0086-17e4-41a5-8893-cf8657faf6e5">
Aug 14 23:05:10 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 23:05:10 user nova-compute[72766]:         </nova:port>
Aug 14 23:05:10 user nova-compute[72766]:       </nova:ports>
Aug 14 23:05:10 user nova-compute[72766]:     </nova:instance>
Aug 14 23:05:10 user nova-compute[72766]:   </metadata>
Aug 14 23:05:10 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:05:10 user nova-compute[72766]:     <system>
Aug 14 23:05:10 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:05:10 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:05:10 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:05:10 user nova-compute[72766]:       <entry name="serial">83084ccc-8e55-43dc-9a37-ffcb35a10922</entry>
Aug 14 23:05:10 user nova-compute[72766]:       <entry name="uuid">83084ccc-8e55-43dc-9a37-ffcb35a10922</entry>
Aug 14 23:05:10 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:05:10 user nova-compute[72766]:     </system>
Aug 14 23:05:10 user nova-compute[72766]:   </sysinfo>
Aug 14 23:05:10 user nova-compute[72766]:   <os>
Aug 14 23:05:10 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:05:10 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:05:10 user nova-compute[72766]:   </os>
Aug 14 23:05:10 user nova-compute[72766]:   <features>
Aug 14 23:05:10 user nova-compute[72766]:     <acpi/>
Aug 14 23:05:10 user nova-compute[72766]:     <apic/>
Aug 14 23:05:10 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:05:10 user nova-compute[72766]:   </features>
Aug 14 23:05:10 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:05:10 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:05:10 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:05:10 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:05:10 user nova-compute[72766]:   </clock>
Aug 14 23:05:10 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:05:10 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:05:10 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:05:10 user nova-compute[72766]:   </cpu>
Aug 14 23:05:10 user nova-compute[72766]:   <devices>
Aug 14 23:05:10 user nova-compute[72766]:     <disk type="block" device="disk">
Aug 14 23:05:10 user nova-compute[72766]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:05:10 user nova-compute[72766]:       <source dev="/dev/sdf"/>
Aug 14 23:05:10 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:05:10 user nova-compute[72766]:       <serial>c69b0c70-6633-43aa-bc9e-d46f033b8966</serial>
Aug 14 23:05:10 user nova-compute[72766]:     </disk>
Aug 14 23:05:10 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 23:05:10 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 23:05:10 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/83084ccc-8e55-43dc-9a37-ffcb35a10922/disk.rescue"/>
Aug 14 23:05:10 user nova-compute[72766]:       <target dev="vdb" bus="virtio"/>
Aug 14 23:05:10 user nova-compute[72766]:       <boot order="1"/>
Aug 14 23:05:10 user nova-compute[72766]:     </disk>
Aug 14 23:05:10 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:05:10 user nova-compute[72766]:       <mac address="fa:16:3e:22:4b:22"/>
Aug 14 23:05:10 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:05:10 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:05:10 user nova-compute[72766]:       <target dev="tapcbbf0086-17"/>
Aug 14 23:05:10 user nova-compute[72766]:     </interface>
Aug 14 23:05:10 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:05:10 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/83084ccc-8e55-43dc-9a37-ffcb35a10922/console.log" append="off"/>
Aug 14 23:05:10 user nova-compute[72766]:     </serial>
Aug 14 23:05:10 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:05:10 user nova-compute[72766]:     <video>
Aug 14 23:05:10 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:05:10 user nova-compute[72766]:     </video>
Aug 14 23:05:10 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:05:10 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:05:10 user nova-compute[72766]:     </rng>
Aug 14 23:05:10 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:05:10 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:05:10 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:05:10 user nova-compute[72766]:     </memballoon>
Aug 14 23:05:10 user nova-compute[72766]:   </devices>
Aug 14 23:05:10 user nova-compute[72766]: </domain>
Aug 14 23:05:10 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:05:10 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Instance destroyed successfully.
Aug 14 23:05:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:05:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:05:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] No VIF found with MAC fa:16:3e:22:4b:22, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:05:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquiring lock "66578337-cbff-4613-87a1-85ddabaebb2d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:05:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "66578337-cbff-4613-87a1-85ddabaebb2d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:05:10 user nova-compute[72766]: DEBUG nova.objects.instance [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lazy-loading 'flavor' on Instance uuid 66578337-cbff-4613-87a1-85ddabaebb2d {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:05:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "66578337-cbff-4613-87a1-85ddabaebb2d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:05:10 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692054295.8553247, 4f7a13a8-6ac1-4b19-8c5c-f54406790f58 => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:05:10 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] VM Stopped (Lifecycle Event)
Aug 14 23:05:10 user nova-compute[72766]: DEBUG nova.compute.manager [None req-703363a7-13fb-4cf6-8b8c-96876e01ce96 None None] [instance: 4f7a13a8-6ac1-4b19-8c5c-f54406790f58] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:05:10 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquiring lock "66578337-cbff-4613-87a1-85ddabaebb2d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:05:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "66578337-cbff-4613-87a1-85ddabaebb2d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:05:10 user nova-compute[72766]: INFO nova.compute.manager [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Attaching volume 07f50970-07ad-4c8a-be6f-d49e78dbac93 to /dev/vdb
Aug 14 23:05:11 user nova-compute[72766]: DEBUG os_brick.utils [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:05:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:11 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[225a593f-1e27-4b44-b302-54d4f5bb5bab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:11 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e664e11a-d41a-4600-85f5-17ea0e94897b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:11 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9874508-5b40-4869-99cc-6d151afad55f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:11 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6501a67-d8df-4ae2-b403-b1e8e9a32d8a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:05:11 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 23:05:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:05:11 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 23:05:11 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[67175168-b1f8-4681-8451-db4a3f7178a1]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:11 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 23:05:11 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 23:05:11 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 23:05:11 user nova-compute[72766]: DEBUG os_brick.utils [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:05:11 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Updating existing volume attachment record: 7a3ebb9e-c627-4416-b31e-ab1c17f67d39 {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 23:05:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:11 user nova-compute[72766]: DEBUG nova.compute.manager [req-2ac849b5-5cba-4d57-87d7-e05afe57da0c req-055afb23-c81b-4236-ace7-10aea4784b4c service nova] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Received event network-vif-plugged-cbbf0086-17e4-41a5-8893-cf8657faf6e5 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:05:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2ac849b5-5cba-4d57-87d7-e05afe57da0c req-055afb23-c81b-4236-ace7-10aea4784b4c service nova] Acquiring lock "83084ccc-8e55-43dc-9a37-ffcb35a10922-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:05:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2ac849b5-5cba-4d57-87d7-e05afe57da0c req-055afb23-c81b-4236-ace7-10aea4784b4c service nova] Lock "83084ccc-8e55-43dc-9a37-ffcb35a10922-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:05:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2ac849b5-5cba-4d57-87d7-e05afe57da0c req-055afb23-c81b-4236-ace7-10aea4784b4c service nova] Lock "83084ccc-8e55-43dc-9a37-ffcb35a10922-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:05:11 user nova-compute[72766]: DEBUG nova.compute.manager [req-2ac849b5-5cba-4d57-87d7-e05afe57da0c req-055afb23-c81b-4236-ace7-10aea4784b4c service nova] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] No waiting events found dispatching network-vif-plugged-cbbf0086-17e4-41a5-8893-cf8657faf6e5 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:05:11 user nova-compute[72766]: WARNING nova.compute.manager [req-2ac849b5-5cba-4d57-87d7-e05afe57da0c req-055afb23-c81b-4236-ace7-10aea4784b4c service nova] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Received unexpected event network-vif-plugged-cbbf0086-17e4-41a5-8893-cf8657faf6e5 for instance with vm_state active and task_state rescuing.
Aug 14 23:05:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:12 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:13 user nova-compute[72766]: DEBUG nova.compute.manager [req-ca775576-ec20-4525-aaca-fc2fd44d2d3f req-5f39b014-5c79-4caa-8ac2-ee7a1ee57058 service nova] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Received event network-vif-plugged-cbbf0086-17e4-41a5-8893-cf8657faf6e5 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:05:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ca775576-ec20-4525-aaca-fc2fd44d2d3f req-5f39b014-5c79-4caa-8ac2-ee7a1ee57058 service nova] Acquiring lock "83084ccc-8e55-43dc-9a37-ffcb35a10922-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:05:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ca775576-ec20-4525-aaca-fc2fd44d2d3f req-5f39b014-5c79-4caa-8ac2-ee7a1ee57058 service nova] Lock "83084ccc-8e55-43dc-9a37-ffcb35a10922-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:05:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ca775576-ec20-4525-aaca-fc2fd44d2d3f req-5f39b014-5c79-4caa-8ac2-ee7a1ee57058 service nova] Lock "83084ccc-8e55-43dc-9a37-ffcb35a10922-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:05:13 user nova-compute[72766]: DEBUG nova.compute.manager [req-ca775576-ec20-4525-aaca-fc2fd44d2d3f req-5f39b014-5c79-4caa-8ac2-ee7a1ee57058 service nova] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] No waiting events found dispatching network-vif-plugged-cbbf0086-17e4-41a5-8893-cf8657faf6e5 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:05:13 user nova-compute[72766]: WARNING nova.compute.manager [req-ca775576-ec20-4525-aaca-fc2fd44d2d3f req-5f39b014-5c79-4caa-8ac2-ee7a1ee57058 service nova] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Received unexpected event network-vif-plugged-cbbf0086-17e4-41a5-8893-cf8657faf6e5 for instance with vm_state active and task_state rescuing.
Aug 14 23:05:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:13 user nova-compute[72766]: DEBUG nova.compute.manager [None req-a7581393-e8c5-4c6b-a958-c4f381dbe0bc tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:05:13 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Removed pending event for 83084ccc-8e55-43dc-9a37-ffcb35a10922 due to event {{(pid=72766) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 23:05:13 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054313.893269, 83084ccc-8e55-43dc-9a37-ffcb35a10922 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:05:13 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] VM Resumed (Lifecycle Event)
Aug 14 23:05:13 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:05:13 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:05:13 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 23:05:13 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054313.9044535, 83084ccc-8e55-43dc-9a37-ffcb35a10922 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:05:13 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] VM Started (Lifecycle Event)
Aug 14 23:05:14 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:05:14 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:05:15 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:17 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:05:17 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:05:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-3ff300ff-34fd-4e94-9d2d-681fb133ba32" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:05:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-3ff300ff-34fd-4e94-9d2d-681fb133ba32" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:05:17 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:05:18 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Updating instance_info_cache with network_info: [{"id": "c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d", "address": "fa:16:3e:67:f9:a0", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46ab9cb-e6", "ovs_interfaceid": "c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:05:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-3ff300ff-34fd-4e94-9d2d-681fb133ba32" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:05:18 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:05:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:20 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:05:20 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'novNFwxY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:05:21 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:05:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:05:21 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:05:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:05:21 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 23:05:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7637fc3-b886-432f-b5df-f5ffd62c2f87]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 23:05:21 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5157d53-ba13-4e3d-908c-948be4db3797]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93] added
Aug 14 23:05:21 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[85077acf-8959-44c0-a5f2-b02ae84141a2]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4b606f-a736-43b8-b0a5-672c236b6f2f]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v novNFwxY {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v novNFwxY" returned: 0 in 0.028s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[5895e315-dbd5-4f48-b261-d043eaa128f0]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'novNFwxY'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0592e5-d918-4f1d-9904-ffd16e9759eb]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b63d81-3926-4440-9c8b-7f4d6d69344b]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:05:21 user nova-compute[72766]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f (non-flash)
Aug 14 23:05:21 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:05:21 user nova-compute[72766]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f (non-flash)
Aug 14 23:05:21 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d210737e-9ebc-416a-a83a-2d00de95f55b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93, portal: 172.16.0.220,3260]
Aug 14 23:05:21 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93, portal: 172.16.0.220,3260] successful.
Aug 14 23:05:21 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[17933a3c-632f-41e2-b555-d91608cb2ca5]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[950dece2-457c-4764-a919-f4e5fd6e656d]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:05:21 user nova-compute[72766]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f (non-flash)
Aug 14 23:05:21 user nova-compute[72766]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 (non-flash)
Aug 14 23:05:21 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:05:21 user nova-compute[72766]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f (non-flash)
Aug 14 23:05:21 user nova-compute[72766]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 (non-flash)
Aug 14 23:05:21 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89ba3a5-f38f-4322-9a4a-15d2493a86aa]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'novNFwxY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 23:05:21 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:05:22 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:05:22 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '23565343763303639', 'path': '/dev/sdc'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:05:22 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565343763303639', 'path': '/dev/sdc'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 23:05:22 user nova-compute[72766]: DEBUG nova.objects.instance [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lazy-loading 'flavor' on Instance uuid 66578337-cbff-4613-87a1-85ddabaebb2d {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:05:22 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 23:05:22 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:05:22 user nova-compute[72766]:   <source dev="/dev/sdc"/>
Aug 14 23:05:22 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:05:22 user nova-compute[72766]:   <serial>07f50970-07ad-4c8a-be6f-d49e78dbac93</serial>
Aug 14 23:05:22 user nova-compute[72766]: </disk>
Aug 14 23:05:22 user nova-compute[72766]:  {{(pid=72766) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 23:05:22 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:05:22 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:05:22 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:05:22 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] No VIF found with MAC fa:16:3e:e2:97:1e, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:05:23 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c55f2435-06f0-49b4-ba89-581c6a4e1363 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "66578337-cbff-4613-87a1-85ddabaebb2d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.087s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:05:23 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:05:23 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:05:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f4c970ae-f61e-48f4-a477-114a60736807 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquiring lock "66578337-cbff-4613-87a1-85ddabaebb2d" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:05:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f4c970ae-f61e-48f4-a477-114a60736807 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "66578337-cbff-4613-87a1-85ddabaebb2d" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:05:24 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f4c970ae-f61e-48f4-a477-114a60736807 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:05:24 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f4c970ae-f61e-48f4-a477-114a60736807 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72766) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 14 23:05:24 user nova-compute[72766]: DEBUG nova.objects.instance [None req-f4c970ae-f61e-48f4-a477-114a60736807 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lazy-loading 'flavor' on Instance uuid 66578337-cbff-4613-87a1-85ddabaebb2d {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:05:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:24 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:05:24 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:05:24 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:05:24 user nova-compute[72766]: DEBUG nova.compute.manager [req-4e347436-cd80-4d68-9553-f24718bf8104 req-4ffc7cc2-6bc5-4d95-9ec0-ec75cb9e3afa service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Received event network-vif-unplugged-ffc1761b-5d95-4c58-9b92-b6b43b4823a6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:05:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-4e347436-cd80-4d68-9553-f24718bf8104 req-4ffc7cc2-6bc5-4d95-9ec0-ec75cb9e3afa service nova] Acquiring lock "66578337-cbff-4613-87a1-85ddabaebb2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:05:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-4e347436-cd80-4d68-9553-f24718bf8104 req-4ffc7cc2-6bc5-4d95-9ec0-ec75cb9e3afa service nova] Lock "66578337-cbff-4613-87a1-85ddabaebb2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:05:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-4e347436-cd80-4d68-9553-f24718bf8104 req-4ffc7cc2-6bc5-4d95-9ec0-ec75cb9e3afa service nova] Lock "66578337-cbff-4613-87a1-85ddabaebb2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:05:24 user nova-compute[72766]: DEBUG nova.compute.manager [req-4e347436-cd80-4d68-9553-f24718bf8104 req-4ffc7cc2-6bc5-4d95-9ec0-ec75cb9e3afa service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] No waiting events found dispatching network-vif-unplugged-ffc1761b-5d95-4c58-9b92-b6b43b4823a6 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:05:24 user nova-compute[72766]: WARNING nova.compute.manager [req-4e347436-cd80-4d68-9553-f24718bf8104 req-4ffc7cc2-6bc5-4d95-9ec0-ec75cb9e3afa service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Received unexpected event network-vif-unplugged-ffc1761b-5d95-4c58-9b92-b6b43b4823a6 for instance with vm_state active and task_state powering-off.
Aug 14 23:05:25 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Instance destroyed successfully.
Aug 14 23:05:25 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f4c970ae-f61e-48f4-a477-114a60736807 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:05:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f4c970ae-f61e-48f4-a477-114a60736807 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "66578337-cbff-4613-87a1-85ddabaebb2d" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.944s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:05:25 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:05:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:05:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:05:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:05:25 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:05:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:25 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:26 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:05:26 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:05:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83084ccc-8e55-43dc-9a37-ffcb35a10922/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83084ccc-8e55-43dc-9a37-ffcb35a10922/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83084ccc-8e55-43dc-9a37-ffcb35a10922/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83084ccc-8e55-43dc-9a37-ffcb35a10922/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:26 user nova-compute[72766]: DEBUG nova.compute.manager [req-f4268e8c-f083-467f-89c3-f7d214516781 req-310de309-62b2-48e6-bdb2-35eee6471e01 service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Received event network-vif-plugged-ffc1761b-5d95-4c58-9b92-b6b43b4823a6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:05:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f4268e8c-f083-467f-89c3-f7d214516781 req-310de309-62b2-48e6-bdb2-35eee6471e01 service nova] Acquiring lock "66578337-cbff-4613-87a1-85ddabaebb2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:05:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f4268e8c-f083-467f-89c3-f7d214516781 req-310de309-62b2-48e6-bdb2-35eee6471e01 service nova] Lock "66578337-cbff-4613-87a1-85ddabaebb2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:05:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f4268e8c-f083-467f-89c3-f7d214516781 req-310de309-62b2-48e6-bdb2-35eee6471e01 service nova] Lock "66578337-cbff-4613-87a1-85ddabaebb2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:05:26 user nova-compute[72766]: DEBUG nova.compute.manager [req-f4268e8c-f083-467f-89c3-f7d214516781 req-310de309-62b2-48e6-bdb2-35eee6471e01 service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] No waiting events found dispatching network-vif-plugged-ffc1761b-5d95-4c58-9b92-b6b43b4823a6 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:05:26 user nova-compute[72766]: WARNING nova.compute.manager [req-f4268e8c-f083-467f-89c3-f7d214516781 req-310de309-62b2-48e6-bdb2-35eee6471e01 service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Received unexpected event network-vif-plugged-ffc1761b-5d95-4c58-9b92-b6b43b4823a6 for instance with vm_state stopped and task_state None.
Aug 14 23:05:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:27 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:05:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e79581-a122-4c0a-8485-a8b6c62e73b8/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e79581-a122-4c0a-8485-a8b6c62e73b8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e79581-a122-4c0a-8485-a8b6c62e73b8/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e79581-a122-4c0a-8485-a8b6c62e73b8/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:28 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:05:28 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:05:28 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=7814MB free_disk=25.50277328491211GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:05:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:05:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:05:28 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Applying migration context for instance 78f02883-99a1-493d-b6be-e43500bfba37 as it has an incoming, in-progress migration ec50a025-a46c-4108-a1b8-c141a1114543. Migration status is finished {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 14 23:05:28 user nova-compute[72766]: INFO nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Updating resource usage from migration ec50a025-a46c-4108-a1b8-c141a1114543
Aug 14 23:05:28 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 3ff300ff-34fd-4e94-9d2d-681fb133ba32 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:05:28 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance cbcf7851-e6f7-4f46-97cc-d773286ccddf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:05:28 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 66578337-cbff-4613-87a1-85ddabaebb2d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:05:28 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 83084ccc-8e55-43dc-9a37-ffcb35a10922 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:05:28 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Migration ec50a025-a46c-4108-a1b8-c141a1114543 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 14 23:05:28 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 78f02883-99a1-493d-b6be-e43500bfba37 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:05:28 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 11e79581-a122-4c0a-8485-a8b6c62e73b8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:05:28 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:05:28 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=25GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:05:29 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:05:29 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:05:29 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:05:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.435s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:05:30 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:05:30 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:33 user nova-compute[72766]: DEBUG nova.network.neutron [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Port 8e7e311b-453d-4e17-9652-45723c7a2944 binding to destination host user is already ACTIVE {{(pid=72766) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 14 23:05:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Acquiring lock "refresh_cache-78f02883-99a1-493d-b6be-e43500bfba37" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:05:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Acquired lock "refresh_cache-78f02883-99a1-493d-b6be-e43500bfba37" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:05:33 user nova-compute[72766]: DEBUG nova.network.neutron [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:05:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:34 user nova-compute[72766]: DEBUG nova.network.neutron [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Updating instance_info_cache with network_info: [{"id": "8e7e311b-453d-4e17-9652-45723c7a2944", "address": "fa:16:3e:7e:31:c1", "network": {"id": "c07935db-7a05-49df-a504-682549f30d55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-765423768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ff897ef00ec45258b22d76ca60447fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e7e311b-45", "ovs_interfaceid": "8e7e311b-453d-4e17-9652-45723c7a2944", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:05:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Releasing lock "refresh_cache-78f02883-99a1-493d-b6be-e43500bfba37" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:05:34 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Creating tmpfile /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/tmpezf012as to verify with other compute node that the instance is on the same shared storage. {{(pid=72766) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 14 23:05:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:34 user nova-compute[72766]: DEBUG nova.compute.manager [req-8bb61ce8-81ea-4414-be43-1d7a8ae9b807 req-07d2b07f-2ef1-43d3-ab34-f5e59085d2d4 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Received event network-vif-unplugged-8e7e311b-453d-4e17-9652-45723c7a2944 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:05:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8bb61ce8-81ea-4414-be43-1d7a8ae9b807 req-07d2b07f-2ef1-43d3-ab34-f5e59085d2d4 service nova] Acquiring lock "78f02883-99a1-493d-b6be-e43500bfba37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:05:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8bb61ce8-81ea-4414-be43-1d7a8ae9b807 req-07d2b07f-2ef1-43d3-ab34-f5e59085d2d4 service nova] Lock "78f02883-99a1-493d-b6be-e43500bfba37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:05:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8bb61ce8-81ea-4414-be43-1d7a8ae9b807 req-07d2b07f-2ef1-43d3-ab34-f5e59085d2d4 service nova] Lock "78f02883-99a1-493d-b6be-e43500bfba37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:05:34 user nova-compute[72766]: DEBUG nova.compute.manager [req-8bb61ce8-81ea-4414-be43-1d7a8ae9b807 req-07d2b07f-2ef1-43d3-ab34-f5e59085d2d4 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] No waiting events found dispatching network-vif-unplugged-8e7e311b-453d-4e17-9652-45723c7a2944 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:05:34 user nova-compute[72766]: WARNING nova.compute.manager [req-8bb61ce8-81ea-4414-be43-1d7a8ae9b807 req-07d2b07f-2ef1-43d3-ab34-f5e59085d2d4 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Received unexpected event network-vif-unplugged-8e7e311b-453d-4e17-9652-45723c7a2944 for instance with vm_state resized and task_state resize_reverting.
Aug 14 23:05:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:35 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Instance destroyed successfully.
Aug 14 23:05:35 user nova-compute[72766]: DEBUG nova.objects.instance [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lazy-loading 'resources' on Instance uuid 78f02883-99a1-493d-b6be-e43500bfba37 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:59:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1272916435',display_name='tempest-ServerActionsTestOtherB-server-1272916435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1272916435',id=16,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsHL/Ov683ewfS5a6Ilb918RzZcGPjg2jcHmAa4FSbUUXkwfiZz6KofKWkKrLkhgLEqXzZXHVc5OIPNVj5SeE4gBrIjsJUy7rj9111gEojmIZrrW+x2JI01+TKIPNtdRQ==',key_name='tempest-keypair-2053681781',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:04:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ff897ef00ec45258b22d76ca60447fe',ramdisk_id='',reservation_id='r-vhmch78j',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-930559363',owner_user_name='tempest-ServerActionsTestOtherB-930559363-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:04:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7bcae26ae5d406196128c0ce83d3413',uuid=78f02883-99a1-493d-b6be-e43500bfba37,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "8e7e311b-453d-4e17-9652-45723c7a2944", "address": "fa:16:3e:7e:31:c1", "network": {"id": "c07935db-7a05-49df-a504-682549f30d55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-765423768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ff897ef00ec45258b22d76ca60447fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e7e311b-45", "ovs_interfaceid": "8e7e311b-453d-4e17-9652-45723c7a2944", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Converting VIF {"id": "8e7e311b-453d-4e17-9652-45723c7a2944", "address": "fa:16:3e:7e:31:c1", "network": {"id": "c07935db-7a05-49df-a504-682549f30d55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-765423768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ff897ef00ec45258b22d76ca60447fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e7e311b-45", "ovs_interfaceid": "8e7e311b-453d-4e17-9652-45723c7a2944", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:31:c1,bridge_name='br-int',has_traffic_filtering=True,id=8e7e311b-453d-4e17-9652-45723c7a2944,network=Network(c07935db-7a05-49df-a504-682549f30d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e7e311b-45') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG os_vif [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:31:c1,bridge_name='br-int',has_traffic_filtering=True,id=8e7e311b-453d-4e17-9652-45723c7a2944,network=Network(c07935db-7a05-49df-a504-682549f30d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e7e311b-45') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e7e311b-45, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:35 user nova-compute[72766]: INFO os_vif [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:31:c1,bridge_name='br-int',has_traffic_filtering=True,id=8e7e311b-453d-4e17-9652-45723c7a2944,network=Network(c07935db-7a05-49df-a504-682549f30d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e7e311b-45')
Aug 14 23:05:35 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eRHNEWri', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:05:35 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:05:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c0d98d-d363-4ae2-bb27-6402b2b22b2f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d26975-daa1-4178-95cb-23daa878637e]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:05:35 user nova-compute[72766]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f (non-flash)
Aug 14 23:05:35 user nova-compute[72766]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 (non-flash)
Aug 14 23:05:35 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:05:35 user nova-compute[72766]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f (non-flash)
Aug 14 23:05:35 user nova-compute[72766]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 (non-flash)
Aug 14 23:05:35 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff1544c71c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f'): ({'sdb'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Removing single pathed devices sdb {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f8fa38-9a2f-431b-badf-bf4e295b129a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[395b221e-5b90-408d-81d8-d1fb8d1b4ce2]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Flushing IO for device /dev/sdb {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bcf06a-bbe8-4ac3-b4ae-f9f6415cd2b7]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ee8f30-8e5c-49df-a5e1-846db6ba1d57]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] SCSI volumes sdb have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a641699a-f567-463c-b757-1d1afe31ff0e]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8144ae4-2410-4618-bc7a-b716a7b420cb]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f, portal: 172.16.0.220,3260]
Aug 14 23:05:35 user nova-compute[72766]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f, portal: 172.16.0.220,3260] successful.
Aug 14 23:05:35 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[737a576b-04bc-4683-b9a4-0fae09a38c78]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] <== disconnect_volume: return (334ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:36 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:36 user nova-compute[72766]: DEBUG nova.compute.manager [req-82090bfd-874f-4148-8ddb-a57dcfc609fd req-36c4804f-edd9-42e7-a976-d34759eff1c2 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Received event network-vif-plugged-8e7e311b-453d-4e17-9652-45723c7a2944 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:05:36 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-82090bfd-874f-4148-8ddb-a57dcfc609fd req-36c4804f-edd9-42e7-a976-d34759eff1c2 service nova] Acquiring lock "78f02883-99a1-493d-b6be-e43500bfba37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:05:36 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-82090bfd-874f-4148-8ddb-a57dcfc609fd req-36c4804f-edd9-42e7-a976-d34759eff1c2 service nova] Lock "78f02883-99a1-493d-b6be-e43500bfba37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:05:36 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-82090bfd-874f-4148-8ddb-a57dcfc609fd req-36c4804f-edd9-42e7-a976-d34759eff1c2 service nova] Lock "78f02883-99a1-493d-b6be-e43500bfba37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:05:36 user nova-compute[72766]: DEBUG nova.compute.manager [req-82090bfd-874f-4148-8ddb-a57dcfc609fd req-36c4804f-edd9-42e7-a976-d34759eff1c2 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] No waiting events found dispatching network-vif-plugged-8e7e311b-453d-4e17-9652-45723c7a2944 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:05:36 user nova-compute[72766]: WARNING nova.compute.manager [req-82090bfd-874f-4148-8ddb-a57dcfc609fd req-36c4804f-edd9-42e7-a976-d34759eff1c2 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Received unexpected event network-vif-plugged-8e7e311b-453d-4e17-9652-45723c7a2944 for instance with vm_state resized and task_state resize_reverting.
Aug 14 23:05:36 user nova-compute[72766]: DEBUG nova.compute.manager [req-82090bfd-874f-4148-8ddb-a57dcfc609fd req-36c4804f-edd9-42e7-a976-d34759eff1c2 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Received event network-vif-plugged-8e7e311b-453d-4e17-9652-45723c7a2944 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:05:36 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-82090bfd-874f-4148-8ddb-a57dcfc609fd req-36c4804f-edd9-42e7-a976-d34759eff1c2 service nova] Acquiring lock "78f02883-99a1-493d-b6be-e43500bfba37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:05:36 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-82090bfd-874f-4148-8ddb-a57dcfc609fd req-36c4804f-edd9-42e7-a976-d34759eff1c2 service nova] Lock "78f02883-99a1-493d-b6be-e43500bfba37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:05:36 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-82090bfd-874f-4148-8ddb-a57dcfc609fd req-36c4804f-edd9-42e7-a976-d34759eff1c2 service nova] Lock "78f02883-99a1-493d-b6be-e43500bfba37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:05:36 user nova-compute[72766]: DEBUG nova.compute.manager [req-82090bfd-874f-4148-8ddb-a57dcfc609fd req-36c4804f-edd9-42e7-a976-d34759eff1c2 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] No waiting events found dispatching network-vif-plugged-8e7e311b-453d-4e17-9652-45723c7a2944 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:05:36 user nova-compute[72766]: WARNING nova.compute.manager [req-82090bfd-874f-4148-8ddb-a57dcfc609fd req-36c4804f-edd9-42e7-a976-d34759eff1c2 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Received unexpected event network-vif-plugged-8e7e311b-453d-4e17-9652-45723c7a2944 for instance with vm_state resized and task_state resize_reverting.
Aug 14 23:05:36 user nova-compute[72766]: DEBUG nova.compute.manager [req-82090bfd-874f-4148-8ddb-a57dcfc609fd req-36c4804f-edd9-42e7-a976-d34759eff1c2 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Received event network-vif-plugged-8e7e311b-453d-4e17-9652-45723c7a2944 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:05:36 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-82090bfd-874f-4148-8ddb-a57dcfc609fd req-36c4804f-edd9-42e7-a976-d34759eff1c2 service nova] Acquiring lock "78f02883-99a1-493d-b6be-e43500bfba37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:05:36 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-82090bfd-874f-4148-8ddb-a57dcfc609fd req-36c4804f-edd9-42e7-a976-d34759eff1c2 service nova] Lock "78f02883-99a1-493d-b6be-e43500bfba37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:05:36 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-82090bfd-874f-4148-8ddb-a57dcfc609fd req-36c4804f-edd9-42e7-a976-d34759eff1c2 service nova] Lock "78f02883-99a1-493d-b6be-e43500bfba37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:05:36 user nova-compute[72766]: DEBUG nova.compute.manager [req-82090bfd-874f-4148-8ddb-a57dcfc609fd req-36c4804f-edd9-42e7-a976-d34759eff1c2 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] No waiting events found dispatching network-vif-plugged-8e7e311b-453d-4e17-9652-45723c7a2944 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:05:36 user nova-compute[72766]: WARNING nova.compute.manager [req-82090bfd-874f-4148-8ddb-a57dcfc609fd req-36c4804f-edd9-42e7-a976-d34759eff1c2 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Received unexpected event network-vif-plugged-8e7e311b-453d-4e17-9652-45723c7a2944 for instance with vm_state resized and task_state resize_reverting.
Aug 14 23:05:36 user nova-compute[72766]: DEBUG nova.compute.manager [req-82090bfd-874f-4148-8ddb-a57dcfc609fd req-36c4804f-edd9-42e7-a976-d34759eff1c2 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Received event network-vif-unplugged-8e7e311b-453d-4e17-9652-45723c7a2944 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:05:36 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-82090bfd-874f-4148-8ddb-a57dcfc609fd req-36c4804f-edd9-42e7-a976-d34759eff1c2 service nova] Acquiring lock "78f02883-99a1-493d-b6be-e43500bfba37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:05:36 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-82090bfd-874f-4148-8ddb-a57dcfc609fd req-36c4804f-edd9-42e7-a976-d34759eff1c2 service nova] Lock "78f02883-99a1-493d-b6be-e43500bfba37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:05:36 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-82090bfd-874f-4148-8ddb-a57dcfc609fd req-36c4804f-edd9-42e7-a976-d34759eff1c2 service nova] Lock "78f02883-99a1-493d-b6be-e43500bfba37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:05:36 user nova-compute[72766]: DEBUG nova.compute.manager [req-82090bfd-874f-4148-8ddb-a57dcfc609fd req-36c4804f-edd9-42e7-a976-d34759eff1c2 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] No waiting events found dispatching network-vif-unplugged-8e7e311b-453d-4e17-9652-45723c7a2944 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:05:36 user nova-compute[72766]: WARNING nova.compute.manager [req-82090bfd-874f-4148-8ddb-a57dcfc609fd req-36c4804f-edd9-42e7-a976-d34759eff1c2 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Received unexpected event network-vif-unplugged-8e7e311b-453d-4e17-9652-45723c7a2944 for instance with vm_state resized and task_state resize_reverting.
Aug 14 23:05:36 user nova-compute[72766]: DEBUG nova.compute.manager [req-82090bfd-874f-4148-8ddb-a57dcfc609fd req-36c4804f-edd9-42e7-a976-d34759eff1c2 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Received event network-vif-plugged-8e7e311b-453d-4e17-9652-45723c7a2944 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:05:36 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-82090bfd-874f-4148-8ddb-a57dcfc609fd req-36c4804f-edd9-42e7-a976-d34759eff1c2 service nova] Acquiring lock "78f02883-99a1-493d-b6be-e43500bfba37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:05:36 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-82090bfd-874f-4148-8ddb-a57dcfc609fd req-36c4804f-edd9-42e7-a976-d34759eff1c2 service nova] Lock "78f02883-99a1-493d-b6be-e43500bfba37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:05:36 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-82090bfd-874f-4148-8ddb-a57dcfc609fd req-36c4804f-edd9-42e7-a976-d34759eff1c2 service nova] Lock "78f02883-99a1-493d-b6be-e43500bfba37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:05:36 user nova-compute[72766]: DEBUG nova.compute.manager [req-82090bfd-874f-4148-8ddb-a57dcfc609fd req-36c4804f-edd9-42e7-a976-d34759eff1c2 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] No waiting events found dispatching network-vif-plugged-8e7e311b-453d-4e17-9652-45723c7a2944 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:05:36 user nova-compute[72766]: WARNING nova.compute.manager [req-82090bfd-874f-4148-8ddb-a57dcfc609fd req-36c4804f-edd9-42e7-a976-d34759eff1c2 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Received unexpected event network-vif-plugged-8e7e311b-453d-4e17-9652-45723c7a2944 for instance with vm_state resized and task_state resize_reverting.
Aug 14 23:05:36 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:05:36 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:05:36 user nova-compute[72766]: DEBUG nova.objects.instance [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lazy-loading 'migration_context' on Instance uuid 78f02883-99a1-493d-b6be-e43500bfba37 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:05:37 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:05:37 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:05:37 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.379s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:05:37 user nova-compute[72766]: INFO nova.compute.manager [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Swapping old allocation on dict_keys(['45c8ff08-bf31-4ab6-8452-2e293102f899']) held by migration ec50a025-a46c-4108-a1b8-c141a1114543 for instance
Aug 14 23:05:37 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Overwriting current allocation {'allocations': {'45c8ff08-bf31-4ab6-8452-2e293102f899': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 28}}, 'project_id': '9ff897ef00ec45258b22d76ca60447fe', 'user_id': 'b7bcae26ae5d406196128c0ce83d3413', 'consumer_generation': 1} on consumer 78f02883-99a1-493d-b6be-e43500bfba37 {{(pid=72766) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 14 23:05:37 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Acquiring lock "refresh_cache-78f02883-99a1-493d-b6be-e43500bfba37" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:05:37 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Acquired lock "refresh_cache-78f02883-99a1-493d-b6be-e43500bfba37" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:05:37 user nova-compute[72766]: DEBUG nova.network.neutron [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:05:38 user nova-compute[72766]: DEBUG nova.network.neutron [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Updating instance_info_cache with network_info: [{"id": "8e7e311b-453d-4e17-9652-45723c7a2944", "address": "fa:16:3e:7e:31:c1", "network": {"id": "c07935db-7a05-49df-a504-682549f30d55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-765423768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ff897ef00ec45258b22d76ca60447fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e7e311b-45", "ovs_interfaceid": "8e7e311b-453d-4e17-9652-45723c7a2944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:05:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Releasing lock "refresh_cache-78f02883-99a1-493d-b6be-e43500bfba37" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:05:38 user nova-compute[72766]: DEBUG os_brick.utils [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:05:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:38 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d1edca-f333-4ab6-8ad2-64466aa7cf27]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:38 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b235ff1f-06d7-479e-acf8-87344de47279]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:38 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[04aa2f7f-8fd2-4c05-91cc-6066872205f3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:38 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a7c70e-7fad-4f9e-94e2-0ec210a7b41e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:05:38 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 23:05:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:05:38 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 23:05:38 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[622ad4ca-016c-408b-bffa-578844effd05]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:38 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 23:05:38 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 23:05:38 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 23:05:38 user nova-compute[72766]: DEBUG os_brick.utils [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:05:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:39 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:40 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692054325.1891184, 66578337-cbff-4613-87a1-85ddabaebb2d => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:05:40 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] VM Stopped (Lifecycle Event)
Aug 14 23:05:40 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:40 user nova-compute[72766]: DEBUG nova.compute.manager [None req-7791e48b-e43e-42b1-b69c-9a74cce3e885 None None] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:05:40 user nova-compute[72766]: DEBUG nova.compute.manager [None req-7791e48b-e43e-42b1-b69c-9a74cce3e885 None None] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:05:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:42 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:46 user nova-compute[72766]: DEBUG nova.compute.manager [req-bc52e642-f17c-4541-8386-2489b2727ee5 req-f0d84d47-351f-448f-9e65-87d160ebe4a1 service nova] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Received event network-changed-0add7ef0-687d-4486-842d-2d07c0d26449 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:05:46 user nova-compute[72766]: DEBUG nova.compute.manager [req-bc52e642-f17c-4541-8386-2489b2727ee5 req-f0d84d47-351f-448f-9e65-87d160ebe4a1 service nova] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Refreshing instance network info cache due to event network-changed-0add7ef0-687d-4486-842d-2d07c0d26449. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:05:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-bc52e642-f17c-4541-8386-2489b2727ee5 req-f0d84d47-351f-448f-9e65-87d160ebe4a1 service nova] Acquiring lock "refresh_cache-11e79581-a122-4c0a-8485-a8b6c62e73b8" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:05:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-bc52e642-f17c-4541-8386-2489b2727ee5 req-f0d84d47-351f-448f-9e65-87d160ebe4a1 service nova] Acquired lock "refresh_cache-11e79581-a122-4c0a-8485-a8b6c62e73b8" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:05:46 user nova-compute[72766]: DEBUG nova.network.neutron [req-bc52e642-f17c-4541-8386-2489b2727ee5 req-f0d84d47-351f-448f-9e65-87d160ebe4a1 service nova] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Refreshing network info cache for port 0add7ef0-687d-4486-842d-2d07c0d26449 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:05:47 user nova-compute[72766]: DEBUG nova.network.neutron [req-bc52e642-f17c-4541-8386-2489b2727ee5 req-f0d84d47-351f-448f-9e65-87d160ebe4a1 service nova] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Updated VIF entry in instance network info cache for port 0add7ef0-687d-4486-842d-2d07c0d26449. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:05:47 user nova-compute[72766]: DEBUG nova.network.neutron [req-bc52e642-f17c-4541-8386-2489b2727ee5 req-f0d84d47-351f-448f-9e65-87d160ebe4a1 service nova] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Updating instance_info_cache with network_info: [{"id": "0add7ef0-687d-4486-842d-2d07c0d26449", "address": "fa:16:3e:4a:df:6f", "network": {"id": "ed86b27c-3e64-4c0a-8824-9bf68068058a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-506861998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f36bd126bda43c6971bccdef2b1da91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0add7ef0-68", "ovs_interfaceid": "0add7ef0-687d-4486-842d-2d07c0d26449", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:05:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-bc52e642-f17c-4541-8386-2489b2727ee5 req-f0d84d47-351f-448f-9e65-87d160ebe4a1 service nova] Releasing lock "refresh_cache-11e79581-a122-4c0a-8485-a8b6c62e73b8" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Acquiring lock "8e358215-4455-4657-8663-1a144f39eb6e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Lock "8e358215-4455-4657-8663-1a144f39eb6e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG nova.compute.manager [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 23:05:48 user nova-compute[72766]: INFO nova.compute.claims [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Claim successful on node user
Aug 14 23:05:48 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Starting finish_revert_migration {{(pid=72766) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Start _get_guest_xml network_info=[{"id": "8e7e311b-453d-4e17-9652-45723c7a2944", "address": "fa:16:3e:7e:31:c1", "network": {"id": "c07935db-7a05-49df-a504-682549f30d55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-765423768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ff897ef00ec45258b22d76ca60447fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e7e311b-45", "ovs_interfaceid": "8e7e311b-453d-4e17-9652-45723c7a2944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd2900d30-2c4c-4d57-9135-d45564c0c596'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '7811df8a-2d27-4e4d-a37d-84f224a4fc37', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eRHNEWri', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '78f02883-99a1-493d-b6be-e43500bfba37', 'attached_at': '2023-08-14T23:05:48.000000', 'detached_at': '', 'volume_id': '6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f', 'serial': '6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f'}, 'volume_type': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:05:48 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:05:48 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:05:48 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG nova.objects.instance [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lazy-loading 'vcpu_model' on Instance uuid 78f02883-99a1-493d-b6be-e43500bfba37 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eRHNEWri', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:05:48 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:05:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:05:48 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:05:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:05:48 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 23:05:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[023cbad1-5f56-42d2-ad80-edebe6e231a7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 23:05:48 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ce9596-9053-4ada-abdf-e74bb3a29397]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f] added
Aug 14 23:05:48 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[400d0dc4-7768-4f5a-8027-2505c273d061]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[623d0e43-4873-4cca-b680-457f9c83c1a0]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eRHNEWri {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eRHNEWri" returned: 0 in 0.028s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[3943e5fa-e5c6-4875-bf71-5dec62b75c00]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eRHNEWri'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9b8d7d-9fe1-43ea-b6b6-00b2171be0e9]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[35064562-46cd-4021-afb6-c12be6bee9d7]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:05:48 user nova-compute[72766]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 (non-flash)
Aug 14 23:05:48 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:05:48 user nova-compute[72766]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 (non-flash)
Aug 14 23:05:48 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1717024-e7b3-4252-b48d-ea13fb3a4e80]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f, portal: 172.16.0.220,3260]
Aug 14 23:05:48 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f, portal: 172.16.0.220,3260] successful.
Aug 14 23:05:48 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.481s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG nova.compute.manager [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.036s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d67b0f1-d2d7-456d-b1bb-7e64cb491544]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9abf0c3-c243-4acd-8da7-5986f097f21a]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:05:48 user nova-compute[72766]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 (non-flash)
Aug 14 23:05:48 user nova-compute[72766]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f (non-flash)
Aug 14 23:05:48 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:05:48 user nova-compute[72766]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 (non-flash)
Aug 14 23:05:48 user nova-compute[72766]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f (non-flash)
Aug 14 23:05:48 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.392s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 23:05:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:49 user nova-compute[72766]: DEBUG nova.compute.manager [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 23:05:49 user nova-compute[72766]: DEBUG nova.network.neutron [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 23:05:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.027s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:49 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[df55573f-13b2-460d-b84a-edcd982f5ee2]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:05:49 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:05:49 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eRHNEWri', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 23:05:49 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 23:05:49 user nova-compute[72766]: DEBUG nova.compute.manager [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 23:05:49 user nova-compute[72766]: DEBUG nova.compute.manager [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 23:05:49 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 23:05:49 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Creating image(s)
Aug 14 23:05:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Acquiring lock "/opt/stack/data/nova/instances/8e358215-4455-4657-8663-1a144f39eb6e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:05:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Lock "/opt/stack/data/nova/instances/8e358215-4455-4657-8663-1a144f39eb6e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:05:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Lock "/opt/stack/data/nova/instances/8e358215-4455-4657-8663-1a144f39eb6e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:05:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:49 user nova-compute[72766]: DEBUG nova.policy [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f127c1a39bb4606b5299ae048d62890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83eb682791ee4b4b9d0637f33e1ce2b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 23:05:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.214s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Acquiring lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:05:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:05:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.204s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/8e358215-4455-4657-8663-1a144f39eb6e/disk 1073741824 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/8e358215-4455-4657-8663-1a144f39eb6e/disk 1073741824" returned: 0 in 0.075s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:05:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.220s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:49 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8e358215-4455-4657-8663-1a144f39eb6e/disk. size=1073741824 {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 23:05:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e358215-4455-4657-8663-1a144f39eb6e/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:50 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.450s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:05:50 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] <== connect_volume: return (1457ms) {'type': 'block', 'scsi_wwn': '23263633963333836', 'path': '/dev/sdb'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:05:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263633963333836', 'path': '/dev/sdb'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 23:05:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:59:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1272916435',display_name='tempest-ServerActionsTestOtherB-server-1272916435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1272916435',id=16,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsHL/Ov683ewfS5a6Ilb918RzZcGPjg2jcHmAa4FSbUUXkwfiZz6KofKWkKrLkhgLEqXzZXHVc5OIPNVj5SeE4gBrIjsJUy7rj9111gEojmIZrrW+x2JI01+TKIPNtdRQ==',key_name='tempest-keypair-2053681781',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:04:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9ff897ef00ec45258b22d76ca60447fe',ramdisk_id='',reservation_id='r-vhmch78j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-930559363',owner_user_name='tempest-ServerActionsTestOtherB-930559363-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:05:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7bcae26ae5d406196128c0ce83d3413',uuid=78f02883-99a1-493d-b6be-e43500bfba37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "8e7e311b-453d-4e17-9652-45723c7a2944", "address": "fa:16:3e:7e:31:c1", "network": {"id": "c07935db-7a05-49df-a504-682549f30d55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-765423768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ff897ef00ec45258b22d76ca60447fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e7e311b-45", "ovs_interfaceid": "8e7e311b-453d-4e17-9652-45723c7a2944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:05:50 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Converting VIF {"id": "8e7e311b-453d-4e17-9652-45723c7a2944", "address": "fa:16:3e:7e:31:c1", "network": {"id": "c07935db-7a05-49df-a504-682549f30d55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-765423768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ff897ef00ec45258b22d76ca60447fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e7e311b-45", "ovs_interfaceid": "8e7e311b-453d-4e17-9652-45723c7a2944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:05:50 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:31:c1,bridge_name='br-int',has_traffic_filtering=True,id=8e7e311b-453d-4e17-9652-45723c7a2944,network=Network(c07935db-7a05-49df-a504-682549f30d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e7e311b-45') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:05:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:05:50 user nova-compute[72766]:   <uuid>78f02883-99a1-493d-b6be-e43500bfba37</uuid>
Aug 14 23:05:50 user nova-compute[72766]:   <name>instance-00000010</name>
Aug 14 23:05:50 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:05:50 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:05:50 user nova-compute[72766]:   <metadata>
Aug 14 23:05:50 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:05:50 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:05:50 user nova-compute[72766]:       <nova:name>tempest-ServerActionsTestOtherB-server-1272916435</nova:name>
Aug 14 23:05:50 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:05:48</nova:creationTime>
Aug 14 23:05:50 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:05:50 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:05:50 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:05:50 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:05:50 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:05:50 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:05:50 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:05:50 user nova-compute[72766]:       <nova:owner>
Aug 14 23:05:50 user nova-compute[72766]:         <nova:user uuid="b7bcae26ae5d406196128c0ce83d3413">tempest-ServerActionsTestOtherB-930559363-project-member</nova:user>
Aug 14 23:05:50 user nova-compute[72766]:         <nova:project uuid="9ff897ef00ec45258b22d76ca60447fe">tempest-ServerActionsTestOtherB-930559363</nova:project>
Aug 14 23:05:50 user nova-compute[72766]:       </nova:owner>
Aug 14 23:05:50 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 23:05:50 user nova-compute[72766]:       <nova:ports>
Aug 14 23:05:50 user nova-compute[72766]:         <nova:port uuid="8e7e311b-453d-4e17-9652-45723c7a2944">
Aug 14 23:05:50 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 23:05:50 user nova-compute[72766]:         </nova:port>
Aug 14 23:05:50 user nova-compute[72766]:       </nova:ports>
Aug 14 23:05:50 user nova-compute[72766]:     </nova:instance>
Aug 14 23:05:50 user nova-compute[72766]:   </metadata>
Aug 14 23:05:50 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:05:50 user nova-compute[72766]:     <system>
Aug 14 23:05:50 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:05:50 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:05:50 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:05:50 user nova-compute[72766]:       <entry name="serial">78f02883-99a1-493d-b6be-e43500bfba37</entry>
Aug 14 23:05:50 user nova-compute[72766]:       <entry name="uuid">78f02883-99a1-493d-b6be-e43500bfba37</entry>
Aug 14 23:05:50 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:05:50 user nova-compute[72766]:     </system>
Aug 14 23:05:50 user nova-compute[72766]:   </sysinfo>
Aug 14 23:05:50 user nova-compute[72766]:   <os>
Aug 14 23:05:50 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:05:50 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:05:50 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:05:50 user nova-compute[72766]:   </os>
Aug 14 23:05:50 user nova-compute[72766]:   <features>
Aug 14 23:05:50 user nova-compute[72766]:     <acpi/>
Aug 14 23:05:50 user nova-compute[72766]:     <apic/>
Aug 14 23:05:50 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:05:50 user nova-compute[72766]:   </features>
Aug 14 23:05:50 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:05:50 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:05:50 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:05:50 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:05:50 user nova-compute[72766]:   </clock>
Aug 14 23:05:50 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:05:50 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:05:50 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:05:50 user nova-compute[72766]:   </cpu>
Aug 14 23:05:50 user nova-compute[72766]:   <devices>
Aug 14 23:05:50 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 23:05:50 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 23:05:50 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk"/>
Aug 14 23:05:50 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:05:50 user nova-compute[72766]:     </disk>
Aug 14 23:05:50 user nova-compute[72766]:     <disk type="block" device="disk">
Aug 14 23:05:50 user nova-compute[72766]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:05:50 user nova-compute[72766]:       <source dev="/dev/sdb"/>
Aug 14 23:05:50 user nova-compute[72766]:       <target dev="vdb" bus="virtio"/>
Aug 14 23:05:50 user nova-compute[72766]:       <serial>6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f</serial>
Aug 14 23:05:50 user nova-compute[72766]:     </disk>
Aug 14 23:05:50 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:05:50 user nova-compute[72766]:       <mac address="fa:16:3e:7e:31:c1"/>
Aug 14 23:05:50 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:05:50 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:05:50 user nova-compute[72766]:       <target dev="tap8e7e311b-45"/>
Aug 14 23:05:50 user nova-compute[72766]:     </interface>
Aug 14 23:05:50 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:05:50 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/console.log" append="off"/>
Aug 14 23:05:50 user nova-compute[72766]:     </serial>
Aug 14 23:05:50 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:05:50 user nova-compute[72766]:     <video>
Aug 14 23:05:50 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:05:50 user nova-compute[72766]:     </video>
Aug 14 23:05:50 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:05:50 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:05:50 user nova-compute[72766]:     </rng>
Aug 14 23:05:50 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:05:50 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:05:50 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:05:50 user nova-compute[72766]:     </memballoon>
Aug 14 23:05:50 user nova-compute[72766]:   </devices>
Aug 14 23:05:50 user nova-compute[72766]: </domain>
Aug 14 23:05:50 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:05:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:59:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1272916435',display_name='tempest-ServerActionsTestOtherB-server-1272916435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1272916435',id=16,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsHL/Ov683ewfS5a6Ilb918RzZcGPjg2jcHmAa4FSbUUXkwfiZz6KofKWkKrLkhgLEqXzZXHVc5OIPNVj5SeE4gBrIjsJUy7rj9111gEojmIZrrW+x2JI01+TKIPNtdRQ==',key_name='tempest-keypair-2053681781',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:04:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9ff897ef00ec45258b22d76ca60447fe',ramdisk_id='',reservation_id='r-vhmch78j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-930559363',owner_user_name='tempest-ServerActionsTestOtherB-930559363-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:05:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7bcae26ae5d406196128c0ce83d3413',uuid=78f02883-99a1-493d-b6be-e43500bfba37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "8e7e311b-453d-4e17-9652-45723c7a2944", "address": "fa:16:3e:7e:31:c1", "network": {"id": "c07935db-7a05-49df-a504-682549f30d55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-765423768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ff897ef00ec45258b22d76ca60447fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e7e311b-45", "ovs_interfaceid": "8e7e311b-453d-4e17-9652-45723c7a2944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:05:50 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Converting VIF {"id": "8e7e311b-453d-4e17-9652-45723c7a2944", "address": "fa:16:3e:7e:31:c1", "network": {"id": "c07935db-7a05-49df-a504-682549f30d55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-765423768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ff897ef00ec45258b22d76ca60447fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e7e311b-45", "ovs_interfaceid": "8e7e311b-453d-4e17-9652-45723c7a2944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:05:50 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:31:c1,bridge_name='br-int',has_traffic_filtering=True,id=8e7e311b-453d-4e17-9652-45723c7a2944,network=Network(c07935db-7a05-49df-a504-682549f30d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e7e311b-45') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:05:50 user nova-compute[72766]: DEBUG os_vif [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:31:c1,bridge_name='br-int',has_traffic_filtering=True,id=8e7e311b-453d-4e17-9652-45723c7a2944,network=Network(c07935db-7a05-49df-a504-682549f30d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e7e311b-45') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:05:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:05:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:05:50 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692054335.1512938, 78f02883-99a1-493d-b6be-e43500bfba37 => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:05:50 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] VM Stopped (Lifecycle Event)
Aug 14 23:05:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e358215-4455-4657-8663-1a144f39eb6e/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:50 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Cannot resize image /opt/stack/data/nova/instances/8e358215-4455-4657-8663-1a144f39eb6e/disk to a smaller size. {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 23:05:50 user nova-compute[72766]: DEBUG nova.objects.instance [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Lazy-loading 'migration_context' on Instance uuid 8e358215-4455-4657-8663-1a144f39eb6e {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:05:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e7e311b-45, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:05:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8e7e311b-45, col_values=(('external_ids', {'iface-id': '8e7e311b-453d-4e17-9652-45723c7a2944', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:31:c1', 'vm-uuid': '78f02883-99a1-493d-b6be-e43500bfba37'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:05:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:05:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 23:05:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Ensure instance console log exists: /opt/stack/data/nova/instances/8e358215-4455-4657-8663-1a144f39eb6e/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 23:05:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:05:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:05:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:05:50 user nova-compute[72766]: DEBUG nova.compute.manager [None req-8eb43a5e-cbc6-4d65-8170-60d0668b6a6f None None] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:05:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:50 user nova-compute[72766]: INFO os_vif [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:31:c1,bridge_name='br-int',has_traffic_filtering=True,id=8e7e311b-453d-4e17-9652-45723c7a2944,network=Network(c07935db-7a05-49df-a504-682549f30d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e7e311b-45')
Aug 14 23:05:50 user nova-compute[72766]: DEBUG nova.network.neutron [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Successfully created port: 88d8c4aa-b464-4686-8c2c-d4378e0efa65 {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 23:05:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Acquiring lock "13f8f416-9f1d-461c-95e5-fc13ffebdf81" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:05:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Lock "13f8f416-9f1d-461c-95e5-fc13ffebdf81" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:05:51 user nova-compute[72766]: DEBUG nova.compute.manager [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 23:05:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:05:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:05:51 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 23:05:51 user nova-compute[72766]: INFO nova.compute.claims [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Claim successful on node user
Aug 14 23:05:51 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:05:51 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:05:51 user nova-compute[72766]: DEBUG nova.network.neutron [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Successfully updated port: 88d8c4aa-b464-4686-8c2c-d4378e0efa65 {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 23:05:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Acquiring lock "refresh_cache-8e358215-4455-4657-8663-1a144f39eb6e" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:05:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Acquired lock "refresh_cache-8e358215-4455-4657-8663-1a144f39eb6e" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:05:51 user nova-compute[72766]: DEBUG nova.network.neutron [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:05:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.438s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:05:51 user nova-compute[72766]: DEBUG nova.compute.manager [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 23:05:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:51 user nova-compute[72766]: DEBUG nova.compute.manager [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 23:05:51 user nova-compute[72766]: DEBUG nova.network.neutron [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 23:05:51 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 23:05:51 user nova-compute[72766]: DEBUG nova.network.neutron [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 23:05:51 user nova-compute[72766]: DEBUG nova.compute.manager [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 23:05:51 user nova-compute[72766]: DEBUG nova.compute.manager [req-845102db-8278-42fd-91c3-5cc51d23a93d req-058a6d61-56ac-4c2e-9d1b-2dfc6acebfe1 service nova] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Received event network-changed-88d8c4aa-b464-4686-8c2c-d4378e0efa65 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:05:51 user nova-compute[72766]: DEBUG nova.compute.manager [req-845102db-8278-42fd-91c3-5cc51d23a93d req-058a6d61-56ac-4c2e-9d1b-2dfc6acebfe1 service nova] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Refreshing instance network info cache due to event network-changed-88d8c4aa-b464-4686-8c2c-d4378e0efa65. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:05:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-845102db-8278-42fd-91c3-5cc51d23a93d req-058a6d61-56ac-4c2e-9d1b-2dfc6acebfe1 service nova] Acquiring lock "refresh_cache-8e358215-4455-4657-8663-1a144f39eb6e" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:05:51 user nova-compute[72766]: DEBUG nova.policy [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd92da0d2b7bc4865b04564b3dda15744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e195e30a9642f0b0f2af918f03d0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 23:05:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7f95ade9-d318-4506-8a54-1c5a1918d92c tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquiring lock "11e79581-a122-4c0a-8485-a8b6c62e73b8" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:05:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7f95ade9-d318-4506-8a54-1c5a1918d92c tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "11e79581-a122-4c0a-8485-a8b6c62e73b8" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:05:51 user nova-compute[72766]: INFO nova.compute.manager [None req-7f95ade9-d318-4506-8a54-1c5a1918d92c tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Shelving
Aug 14 23:05:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:52 user nova-compute[72766]: DEBUG nova.compute.manager [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 23:05:52 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 23:05:52 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Creating image(s)
Aug 14 23:05:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Acquiring lock "/opt/stack/data/nova/instances/13f8f416-9f1d-461c-95e5-fc13ffebdf81/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:05:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Lock "/opt/stack/data/nova/instances/13f8f416-9f1d-461c-95e5-fc13ffebdf81/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:05:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Lock "/opt/stack/data/nova/instances/13f8f416-9f1d-461c-95e5-fc13ffebdf81/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:05:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.216s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Acquiring lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:05:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:05:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:52 user nova-compute[72766]: DEBUG nova.compute.manager [req-f07ec954-5a5f-4915-a130-dee53e658d07 req-4aff963c-4401-4564-9cfa-748e5b20de4b service nova] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Received event network-vif-unplugged-0add7ef0-687d-4486-842d-2d07c0d26449 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:05:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f07ec954-5a5f-4915-a130-dee53e658d07 req-4aff963c-4401-4564-9cfa-748e5b20de4b service nova] Acquiring lock "11e79581-a122-4c0a-8485-a8b6c62e73b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:05:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f07ec954-5a5f-4915-a130-dee53e658d07 req-4aff963c-4401-4564-9cfa-748e5b20de4b service nova] Lock "11e79581-a122-4c0a-8485-a8b6c62e73b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:05:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f07ec954-5a5f-4915-a130-dee53e658d07 req-4aff963c-4401-4564-9cfa-748e5b20de4b service nova] Lock "11e79581-a122-4c0a-8485-a8b6c62e73b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:05:52 user nova-compute[72766]: DEBUG nova.compute.manager [req-f07ec954-5a5f-4915-a130-dee53e658d07 req-4aff963c-4401-4564-9cfa-748e5b20de4b service nova] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] No waiting events found dispatching network-vif-unplugged-0add7ef0-687d-4486-842d-2d07c0d26449 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:05:52 user nova-compute[72766]: WARNING nova.compute.manager [req-f07ec954-5a5f-4915-a130-dee53e658d07 req-4aff963c-4401-4564-9cfa-748e5b20de4b service nova] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Received unexpected event network-vif-unplugged-0add7ef0-687d-4486-842d-2d07c0d26449 for instance with vm_state active and task_state shelving.
Aug 14 23:05:52 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Instance destroyed successfully.
Aug 14 23:05:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.221s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/13f8f416-9f1d-461c-95e5-fc13ffebdf81/disk 1073741824 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/13f8f416-9f1d-461c-95e5-fc13ffebdf81/disk 1073741824" returned: 0 in 0.067s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:05:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:52 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-7f95ade9-d318-4506-8a54-1c5a1918d92c tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Beginning cold snapshot process
Aug 14 23:05:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.198s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:52 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Checking if we can resize image /opt/stack/data/nova/instances/13f8f416-9f1d-461c-95e5-fc13ffebdf81/disk. size=1073741824 {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 23:05:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13f8f416-9f1d-461c-95e5-fc13ffebdf81/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:52 user nova-compute[72766]: DEBUG nova.network.neutron [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Updating instance_info_cache with network_info: [{"id": "88d8c4aa-b464-4686-8c2c-d4378e0efa65", "address": "fa:16:3e:13:3f:2f", "network": {"id": "ba73a346-5f7e-4749-9757-4965ccb4be6f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-537717022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83eb682791ee4b4b9d0637f33e1ce2b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d8c4aa-b4", "ovs_interfaceid": "88d8c4aa-b464-4686-8c2c-d4378e0efa65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:05:52 user nova-compute[72766]: DEBUG nova.privsep.utils [None req-7f95ade9-d318-4506-8a54-1c5a1918d92c tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72766) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 23:05:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-7f95ade9-d318-4506-8a54-1c5a1918d92c tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/11e79581-a122-4c0a-8485-a8b6c62e73b8/disk /opt/stack/data/nova/instances/snapshots/tmp38i9suii/f1e9077f235f4224ab54a58e21495208 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG nova.network.neutron [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Successfully created port: bfd9d907-21ac-4b49-8467-e281025cdb45 {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Releasing lock "refresh_cache-8e358215-4455-4657-8663-1a144f39eb6e" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG nova.compute.manager [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Instance network_info: |[{"id": "88d8c4aa-b464-4686-8c2c-d4378e0efa65", "address": "fa:16:3e:13:3f:2f", "network": {"id": "ba73a346-5f7e-4749-9757-4965ccb4be6f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-537717022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83eb682791ee4b4b9d0637f33e1ce2b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d8c4aa-b4", "ovs_interfaceid": "88d8c4aa-b464-4686-8c2c-d4378e0efa65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-845102db-8278-42fd-91c3-5cc51d23a93d req-058a6d61-56ac-4c2e-9d1b-2dfc6acebfe1 service nova] Acquired lock "refresh_cache-8e358215-4455-4657-8663-1a144f39eb6e" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG nova.network.neutron [req-845102db-8278-42fd-91c3-5cc51d23a93d req-058a6d61-56ac-4c2e-9d1b-2dfc6acebfe1 service nova] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Refreshing network info cache for port 88d8c4aa-b464-4686-8c2c-d4378e0efa65 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Start _get_guest_xml network_info=[{"id": "88d8c4aa-b464-4686-8c2c-d4378e0efa65", "address": "fa:16:3e:13:3f:2f", "network": {"id": "ba73a346-5f7e-4749-9757-4965ccb4be6f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-537717022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83eb682791ee4b4b9d0637f33e1ce2b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d8c4aa-b4", "ovs_interfaceid": "88d8c4aa-b464-4686-8c2c-d4378e0efa65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd2900d30-2c4c-4d57-9135-d45564c0c596'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13f8f416-9f1d-461c-95e5-fc13ffebdf81/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Cannot resize image /opt/stack/data/nova/instances/13f8f416-9f1d-461c-95e5-fc13ffebdf81/disk to a smaller size. {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG nova.objects.instance [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Lazy-loading 'migration_context' on Instance uuid 13f8f416-9f1d-461c-95e5-fc13ffebdf81 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:05:53 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:05:53 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:05:53 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Ensure instance console log exists: /opt/stack/data/nova/instances/13f8f416-9f1d-461c-95e5-fc13ffebdf81/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:05:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1545649618',display_name='tempest-VolumesActionsTest-instance-1545649618',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1545649618',id=24,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83eb682791ee4b4b9d0637f33e1ce2b3',ramdisk_id='',reservation_id='r-x1gtvumj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-562398048',owner_user_name='tempest-VolumesActionsTest-562398048-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:05:49Z,user_data=None,user_id='0f127c1a39bb4606b5299ae048d62890',uuid=8e358215-4455-4657-8663-1a144f39eb6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88d8c4aa-b464-4686-8c2c-d4378e0efa65", "address": "fa:16:3e:13:3f:2f", "network": {"id": "ba73a346-5f7e-4749-9757-4965ccb4be6f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-537717022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83eb682791ee4b4b9d0637f33e1ce2b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d8c4aa-b4", "ovs_interfaceid": "88d8c4aa-b464-4686-8c2c-d4378e0efa65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Converting VIF {"id": "88d8c4aa-b464-4686-8c2c-d4378e0efa65", "address": "fa:16:3e:13:3f:2f", "network": {"id": "ba73a346-5f7e-4749-9757-4965ccb4be6f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-537717022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83eb682791ee4b4b9d0637f33e1ce2b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d8c4aa-b4", "ovs_interfaceid": "88d8c4aa-b464-4686-8c2c-d4378e0efa65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:3f:2f,bridge_name='br-int',has_traffic_filtering=True,id=88d8c4aa-b464-4686-8c2c-d4378e0efa65,network=Network(ba73a346-5f7e-4749-9757-4965ccb4be6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88d8c4aa-b4') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG nova.objects.instance [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e358215-4455-4657-8663-1a144f39eb6e {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:05:53 user nova-compute[72766]:   <uuid>8e358215-4455-4657-8663-1a144f39eb6e</uuid>
Aug 14 23:05:53 user nova-compute[72766]:   <name>instance-00000018</name>
Aug 14 23:05:53 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:05:53 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:05:53 user nova-compute[72766]:   <metadata>
Aug 14 23:05:53 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:05:53 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:05:53 user nova-compute[72766]:       <nova:name>tempest-VolumesActionsTest-instance-1545649618</nova:name>
Aug 14 23:05:53 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:05:53</nova:creationTime>
Aug 14 23:05:53 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:05:53 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:05:53 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:05:53 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:05:53 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:05:53 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:05:53 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:05:53 user nova-compute[72766]:       <nova:owner>
Aug 14 23:05:53 user nova-compute[72766]:         <nova:user uuid="0f127c1a39bb4606b5299ae048d62890">tempest-VolumesActionsTest-562398048-project-member</nova:user>
Aug 14 23:05:53 user nova-compute[72766]:         <nova:project uuid="83eb682791ee4b4b9d0637f33e1ce2b3">tempest-VolumesActionsTest-562398048</nova:project>
Aug 14 23:05:53 user nova-compute[72766]:       </nova:owner>
Aug 14 23:05:53 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 23:05:53 user nova-compute[72766]:       <nova:ports>
Aug 14 23:05:53 user nova-compute[72766]:         <nova:port uuid="88d8c4aa-b464-4686-8c2c-d4378e0efa65">
Aug 14 23:05:53 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 14 23:05:53 user nova-compute[72766]:         </nova:port>
Aug 14 23:05:53 user nova-compute[72766]:       </nova:ports>
Aug 14 23:05:53 user nova-compute[72766]:     </nova:instance>
Aug 14 23:05:53 user nova-compute[72766]:   </metadata>
Aug 14 23:05:53 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:05:53 user nova-compute[72766]:     <system>
Aug 14 23:05:53 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:05:53 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:05:53 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:05:53 user nova-compute[72766]:       <entry name="serial">8e358215-4455-4657-8663-1a144f39eb6e</entry>
Aug 14 23:05:53 user nova-compute[72766]:       <entry name="uuid">8e358215-4455-4657-8663-1a144f39eb6e</entry>
Aug 14 23:05:53 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:05:53 user nova-compute[72766]:     </system>
Aug 14 23:05:53 user nova-compute[72766]:   </sysinfo>
Aug 14 23:05:53 user nova-compute[72766]:   <os>
Aug 14 23:05:53 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:05:53 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:05:53 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:05:53 user nova-compute[72766]:   </os>
Aug 14 23:05:53 user nova-compute[72766]:   <features>
Aug 14 23:05:53 user nova-compute[72766]:     <acpi/>
Aug 14 23:05:53 user nova-compute[72766]:     <apic/>
Aug 14 23:05:53 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:05:53 user nova-compute[72766]:   </features>
Aug 14 23:05:53 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:05:53 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:05:53 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:05:53 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:05:53 user nova-compute[72766]:   </clock>
Aug 14 23:05:53 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:05:53 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:05:53 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:05:53 user nova-compute[72766]:   </cpu>
Aug 14 23:05:53 user nova-compute[72766]:   <devices>
Aug 14 23:05:53 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 23:05:53 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 23:05:53 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/8e358215-4455-4657-8663-1a144f39eb6e/disk"/>
Aug 14 23:05:53 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:05:53 user nova-compute[72766]:     </disk>
Aug 14 23:05:53 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:05:53 user nova-compute[72766]:       <mac address="fa:16:3e:13:3f:2f"/>
Aug 14 23:05:53 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:05:53 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:05:53 user nova-compute[72766]:       <target dev="tap88d8c4aa-b4"/>
Aug 14 23:05:53 user nova-compute[72766]:     </interface>
Aug 14 23:05:53 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:05:53 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/8e358215-4455-4657-8663-1a144f39eb6e/console.log" append="off"/>
Aug 14 23:05:53 user nova-compute[72766]:     </serial>
Aug 14 23:05:53 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:05:53 user nova-compute[72766]:     <video>
Aug 14 23:05:53 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:05:53 user nova-compute[72766]:     </video>
Aug 14 23:05:53 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:05:53 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:05:53 user nova-compute[72766]:     </rng>
Aug 14 23:05:53 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:05:53 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:05:53 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:05:53 user nova-compute[72766]:     </memballoon>
Aug 14 23:05:53 user nova-compute[72766]:   </devices>
Aug 14 23:05:53 user nova-compute[72766]: </domain>
Aug 14 23:05:53 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:05:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1545649618',display_name='tempest-VolumesActionsTest-instance-1545649618',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1545649618',id=24,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83eb682791ee4b4b9d0637f33e1ce2b3',ramdisk_id='',reservation_id='r-x1gtvumj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-562398048',owner_user_name='tempest-VolumesActionsTest-562398048-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:05:49Z,user_data=None,user_id='0f127c1a39bb4606b5299ae048d62890',uuid=8e358215-4455-4657-8663-1a144f39eb6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88d8c4aa-b464-4686-8c2c-d4378e0efa65", "address": "fa:16:3e:13:3f:2f", "network": {"id": "ba73a346-5f7e-4749-9757-4965ccb4be6f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-537717022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83eb682791ee4b4b9d0637f33e1ce2b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d8c4aa-b4", "ovs_interfaceid": "88d8c4aa-b464-4686-8c2c-d4378e0efa65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Converting VIF {"id": "88d8c4aa-b464-4686-8c2c-d4378e0efa65", "address": "fa:16:3e:13:3f:2f", "network": {"id": "ba73a346-5f7e-4749-9757-4965ccb4be6f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-537717022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83eb682791ee4b4b9d0637f33e1ce2b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d8c4aa-b4", "ovs_interfaceid": "88d8c4aa-b464-4686-8c2c-d4378e0efa65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:3f:2f,bridge_name='br-int',has_traffic_filtering=True,id=88d8c4aa-b464-4686-8c2c-d4378e0efa65,network=Network(ba73a346-5f7e-4749-9757-4965ccb4be6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88d8c4aa-b4') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG os_vif [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:3f:2f,bridge_name='br-int',has_traffic_filtering=True,id=88d8c4aa-b464-4686-8c2c-d4378e0efa65,network=Network(ba73a346-5f7e-4749-9757-4965ccb4be6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88d8c4aa-b4') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap88d8c4aa-b4, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap88d8c4aa-b4, col_values=(('external_ids', {'iface-id': '88d8c4aa-b464-4686-8c2c-d4378e0efa65', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:3f:2f', 'vm-uuid': '8e358215-4455-4657-8663-1a144f39eb6e'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:53 user nova-compute[72766]: INFO os_vif [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:3f:2f,bridge_name='br-int',has_traffic_filtering=True,id=88d8c4aa-b464-4686-8c2c-d4378e0efa65,network=Network(ba73a346-5f7e-4749-9757-4965ccb4be6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88d8c4aa-b4')
Aug 14 23:05:53 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] No VIF found with MAC fa:16:3e:13:3f:2f, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-7f95ade9-d318-4506-8a54-1c5a1918d92c tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/11e79581-a122-4c0a-8485-a8b6c62e73b8/disk /opt/stack/data/nova/instances/snapshots/tmp38i9suii/f1e9077f235f4224ab54a58e21495208" returned: 0 in 0.406s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:05:53 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-7f95ade9-d318-4506-8a54-1c5a1918d92c tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Snapshot extracted, beginning image upload
Aug 14 23:05:53 user nova-compute[72766]: DEBUG nova.network.neutron [req-845102db-8278-42fd-91c3-5cc51d23a93d req-058a6d61-56ac-4c2e-9d1b-2dfc6acebfe1 service nova] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Updated VIF entry in instance network info cache for port 88d8c4aa-b464-4686-8c2c-d4378e0efa65. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG nova.network.neutron [req-845102db-8278-42fd-91c3-5cc51d23a93d req-058a6d61-56ac-4c2e-9d1b-2dfc6acebfe1 service nova] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Updating instance_info_cache with network_info: [{"id": "88d8c4aa-b464-4686-8c2c-d4378e0efa65", "address": "fa:16:3e:13:3f:2f", "network": {"id": "ba73a346-5f7e-4749-9757-4965ccb4be6f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-537717022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83eb682791ee4b4b9d0637f33e1ce2b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d8c4aa-b4", "ovs_interfaceid": "88d8c4aa-b464-4686-8c2c-d4378e0efa65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-845102db-8278-42fd-91c3-5cc51d23a93d req-058a6d61-56ac-4c2e-9d1b-2dfc6acebfe1 service nova] Releasing lock "refresh_cache-8e358215-4455-4657-8663-1a144f39eb6e" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG nova.compute.manager [req-06605919-f503-4366-a51f-71d2e3cdcbf3 req-8afb4bf7-7bc0-4cae-b4f8-5c5c05130101 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Received event network-vif-plugged-8e7e311b-453d-4e17-9652-45723c7a2944 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-06605919-f503-4366-a51f-71d2e3cdcbf3 req-8afb4bf7-7bc0-4cae-b4f8-5c5c05130101 service nova] Acquiring lock "78f02883-99a1-493d-b6be-e43500bfba37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-06605919-f503-4366-a51f-71d2e3cdcbf3 req-8afb4bf7-7bc0-4cae-b4f8-5c5c05130101 service nova] Lock "78f02883-99a1-493d-b6be-e43500bfba37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-06605919-f503-4366-a51f-71d2e3cdcbf3 req-8afb4bf7-7bc0-4cae-b4f8-5c5c05130101 service nova] Lock "78f02883-99a1-493d-b6be-e43500bfba37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG nova.compute.manager [req-06605919-f503-4366-a51f-71d2e3cdcbf3 req-8afb4bf7-7bc0-4cae-b4f8-5c5c05130101 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] No waiting events found dispatching network-vif-plugged-8e7e311b-453d-4e17-9652-45723c7a2944 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:05:53 user nova-compute[72766]: WARNING nova.compute.manager [req-06605919-f503-4366-a51f-71d2e3cdcbf3 req-8afb4bf7-7bc0-4cae-b4f8-5c5c05130101 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Received unexpected event network-vif-plugged-8e7e311b-453d-4e17-9652-45723c7a2944 for instance with vm_state resized and task_state resize_reverting.
Aug 14 23:05:53 user nova-compute[72766]: DEBUG nova.compute.manager [req-06605919-f503-4366-a51f-71d2e3cdcbf3 req-8afb4bf7-7bc0-4cae-b4f8-5c5c05130101 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Received event network-vif-plugged-8e7e311b-453d-4e17-9652-45723c7a2944 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-06605919-f503-4366-a51f-71d2e3cdcbf3 req-8afb4bf7-7bc0-4cae-b4f8-5c5c05130101 service nova] Acquiring lock "78f02883-99a1-493d-b6be-e43500bfba37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-06605919-f503-4366-a51f-71d2e3cdcbf3 req-8afb4bf7-7bc0-4cae-b4f8-5c5c05130101 service nova] Lock "78f02883-99a1-493d-b6be-e43500bfba37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-06605919-f503-4366-a51f-71d2e3cdcbf3 req-8afb4bf7-7bc0-4cae-b4f8-5c5c05130101 service nova] Lock "78f02883-99a1-493d-b6be-e43500bfba37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:05:53 user nova-compute[72766]: DEBUG nova.compute.manager [req-06605919-f503-4366-a51f-71d2e3cdcbf3 req-8afb4bf7-7bc0-4cae-b4f8-5c5c05130101 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] No waiting events found dispatching network-vif-plugged-8e7e311b-453d-4e17-9652-45723c7a2944 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:05:53 user nova-compute[72766]: WARNING nova.compute.manager [req-06605919-f503-4366-a51f-71d2e3cdcbf3 req-8afb4bf7-7bc0-4cae-b4f8-5c5c05130101 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Received unexpected event network-vif-plugged-8e7e311b-453d-4e17-9652-45723c7a2944 for instance with vm_state resized and task_state resize_reverting.
Aug 14 23:05:54 user nova-compute[72766]: DEBUG nova.network.neutron [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Successfully updated port: bfd9d907-21ac-4b49-8467-e281025cdb45 {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Acquiring lock "refresh_cache-13f8f416-9f1d-461c-95e5-fc13ffebdf81" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Acquired lock "refresh_cache-13f8f416-9f1d-461c-95e5-fc13ffebdf81" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG nova.network.neutron [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054354.148895, 78f02883-99a1-493d-b6be-e43500bfba37 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:05:54 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] VM Resumed (Lifecycle Event)
Aug 14 23:05:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:05:54 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Instance running successfully.
Aug 14 23:05:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] finish_revert_migration finished successfully. {{(pid=72766) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG nova.network.neutron [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 23:05:54 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 14 23:05:54 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054354.153428, 78f02883-99a1-493d-b6be-e43500bfba37 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:05:54 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] VM Started (Lifecycle Event)
Aug 14 23:05:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:05:54 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 14 23:05:54 user nova-compute[72766]: INFO nova.compute.manager [None req-b0a91796-cc60-431d-8dad-beb175061cc7 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Updating instance to original state: 'active'
Aug 14 23:05:54 user nova-compute[72766]: DEBUG nova.network.neutron [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Updating instance_info_cache with network_info: [{"id": "bfd9d907-21ac-4b49-8467-e281025cdb45", "address": "fa:16:3e:7b:7c:59", "network": {"id": "f38afcd2-d9b4-427b-a94f-46f2e935370a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-614672131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e195e30a9642f0b0f2af918f03d0a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfd9d907-21", "ovs_interfaceid": "bfd9d907-21ac-4b49-8467-e281025cdb45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Releasing lock "refresh_cache-13f8f416-9f1d-461c-95e5-fc13ffebdf81" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Instance network_info: |[{"id": "bfd9d907-21ac-4b49-8467-e281025cdb45", "address": "fa:16:3e:7b:7c:59", "network": {"id": "f38afcd2-d9b4-427b-a94f-46f2e935370a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-614672131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e195e30a9642f0b0f2af918f03d0a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfd9d907-21", "ovs_interfaceid": "bfd9d907-21ac-4b49-8467-e281025cdb45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Start _get_guest_xml network_info=[{"id": "bfd9d907-21ac-4b49-8467-e281025cdb45", "address": "fa:16:3e:7b:7c:59", "network": {"id": "f38afcd2-d9b4-427b-a94f-46f2e935370a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-614672131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e195e30a9642f0b0f2af918f03d0a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfd9d907-21", "ovs_interfaceid": "bfd9d907-21ac-4b49-8467-e281025cdb45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd2900d30-2c4c-4d57-9135-d45564c0c596'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:05:54 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:05:54 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:05:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:05:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-61243865',display_name='tempest-VolumesActionsTest-instance-61243865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-61243865',id=25,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35e195e30a9642f0b0f2af918f03d0a3',ramdisk_id='',reservation_id='r-l9n3u6pb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-786823184',owner_user_name='tempest-VolumesActionsTest-786823184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:05:52Z,user_data=None,user_id='d92da0d2b7bc4865b04564b3dda15744',uuid=13f8f416-9f1d-461c-95e5-fc13ffebdf81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfd9d907-21ac-4b49-8467-e281025cdb45", "address": "fa:16:3e:7b:7c:59", "network": {"id": "f38afcd2-d9b4-427b-a94f-46f2e935370a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-614672131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e195e30a9642f0b0f2af918f03d0a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfd9d907-21", "ovs_interfaceid": "bfd9d907-21ac-4b49-8467-e281025cdb45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Converting VIF {"id": "bfd9d907-21ac-4b49-8467-e281025cdb45", "address": "fa:16:3e:7b:7c:59", "network": {"id": "f38afcd2-d9b4-427b-a94f-46f2e935370a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-614672131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e195e30a9642f0b0f2af918f03d0a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfd9d907-21", "ovs_interfaceid": "bfd9d907-21ac-4b49-8467-e281025cdb45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:7c:59,bridge_name='br-int',has_traffic_filtering=True,id=bfd9d907-21ac-4b49-8467-e281025cdb45,network=Network(f38afcd2-d9b4-427b-a94f-46f2e935370a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfd9d907-21') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG nova.objects.instance [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Lazy-loading 'pci_devices' on Instance uuid 13f8f416-9f1d-461c-95e5-fc13ffebdf81 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG nova.compute.manager [req-d653d979-a11c-4047-8326-9e0f4bad2aca req-fcb0ad20-1dfd-45dd-b632-150bea6a60ce service nova] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Received event network-vif-plugged-0add7ef0-687d-4486-842d-2d07c0d26449 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d653d979-a11c-4047-8326-9e0f4bad2aca req-fcb0ad20-1dfd-45dd-b632-150bea6a60ce service nova] Acquiring lock "11e79581-a122-4c0a-8485-a8b6c62e73b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d653d979-a11c-4047-8326-9e0f4bad2aca req-fcb0ad20-1dfd-45dd-b632-150bea6a60ce service nova] Lock "11e79581-a122-4c0a-8485-a8b6c62e73b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d653d979-a11c-4047-8326-9e0f4bad2aca req-fcb0ad20-1dfd-45dd-b632-150bea6a60ce service nova] Lock "11e79581-a122-4c0a-8485-a8b6c62e73b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG nova.compute.manager [req-d653d979-a11c-4047-8326-9e0f4bad2aca req-fcb0ad20-1dfd-45dd-b632-150bea6a60ce service nova] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] No waiting events found dispatching network-vif-plugged-0add7ef0-687d-4486-842d-2d07c0d26449 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:05:54 user nova-compute[72766]: WARNING nova.compute.manager [req-d653d979-a11c-4047-8326-9e0f4bad2aca req-fcb0ad20-1dfd-45dd-b632-150bea6a60ce service nova] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Received unexpected event network-vif-plugged-0add7ef0-687d-4486-842d-2d07c0d26449 for instance with vm_state active and task_state shelving_image_uploading.
Aug 14 23:05:54 user nova-compute[72766]: DEBUG nova.compute.manager [req-d653d979-a11c-4047-8326-9e0f4bad2aca req-fcb0ad20-1dfd-45dd-b632-150bea6a60ce service nova] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Received event network-changed-bfd9d907-21ac-4b49-8467-e281025cdb45 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG nova.compute.manager [req-d653d979-a11c-4047-8326-9e0f4bad2aca req-fcb0ad20-1dfd-45dd-b632-150bea6a60ce service nova] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Refreshing instance network info cache due to event network-changed-bfd9d907-21ac-4b49-8467-e281025cdb45. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d653d979-a11c-4047-8326-9e0f4bad2aca req-fcb0ad20-1dfd-45dd-b632-150bea6a60ce service nova] Acquiring lock "refresh_cache-13f8f416-9f1d-461c-95e5-fc13ffebdf81" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d653d979-a11c-4047-8326-9e0f4bad2aca req-fcb0ad20-1dfd-45dd-b632-150bea6a60ce service nova] Acquired lock "refresh_cache-13f8f416-9f1d-461c-95e5-fc13ffebdf81" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG nova.network.neutron [req-d653d979-a11c-4047-8326-9e0f4bad2aca req-fcb0ad20-1dfd-45dd-b632-150bea6a60ce service nova] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Refreshing network info cache for port bfd9d907-21ac-4b49-8467-e281025cdb45 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:05:54 user nova-compute[72766]:   <uuid>13f8f416-9f1d-461c-95e5-fc13ffebdf81</uuid>
Aug 14 23:05:54 user nova-compute[72766]:   <name>instance-00000019</name>
Aug 14 23:05:54 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:05:54 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:05:54 user nova-compute[72766]:   <metadata>
Aug 14 23:05:54 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:05:54 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:05:54 user nova-compute[72766]:       <nova:name>tempest-VolumesActionsTest-instance-61243865</nova:name>
Aug 14 23:05:54 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:05:54</nova:creationTime>
Aug 14 23:05:54 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:05:54 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:05:54 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:05:54 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:05:54 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:05:54 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:05:54 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:05:54 user nova-compute[72766]:       <nova:owner>
Aug 14 23:05:54 user nova-compute[72766]:         <nova:user uuid="d92da0d2b7bc4865b04564b3dda15744">tempest-VolumesActionsTest-786823184-project-member</nova:user>
Aug 14 23:05:54 user nova-compute[72766]:         <nova:project uuid="35e195e30a9642f0b0f2af918f03d0a3">tempest-VolumesActionsTest-786823184</nova:project>
Aug 14 23:05:54 user nova-compute[72766]:       </nova:owner>
Aug 14 23:05:54 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 23:05:54 user nova-compute[72766]:       <nova:ports>
Aug 14 23:05:54 user nova-compute[72766]:         <nova:port uuid="bfd9d907-21ac-4b49-8467-e281025cdb45">
Aug 14 23:05:54 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 23:05:54 user nova-compute[72766]:         </nova:port>
Aug 14 23:05:54 user nova-compute[72766]:       </nova:ports>
Aug 14 23:05:54 user nova-compute[72766]:     </nova:instance>
Aug 14 23:05:54 user nova-compute[72766]:   </metadata>
Aug 14 23:05:54 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:05:54 user nova-compute[72766]:     <system>
Aug 14 23:05:54 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:05:54 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:05:54 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:05:54 user nova-compute[72766]:       <entry name="serial">13f8f416-9f1d-461c-95e5-fc13ffebdf81</entry>
Aug 14 23:05:54 user nova-compute[72766]:       <entry name="uuid">13f8f416-9f1d-461c-95e5-fc13ffebdf81</entry>
Aug 14 23:05:54 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:05:54 user nova-compute[72766]:     </system>
Aug 14 23:05:54 user nova-compute[72766]:   </sysinfo>
Aug 14 23:05:54 user nova-compute[72766]:   <os>
Aug 14 23:05:54 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:05:54 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:05:54 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:05:54 user nova-compute[72766]:   </os>
Aug 14 23:05:54 user nova-compute[72766]:   <features>
Aug 14 23:05:54 user nova-compute[72766]:     <acpi/>
Aug 14 23:05:54 user nova-compute[72766]:     <apic/>
Aug 14 23:05:54 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:05:54 user nova-compute[72766]:   </features>
Aug 14 23:05:54 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:05:54 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:05:54 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:05:54 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:05:54 user nova-compute[72766]:   </clock>
Aug 14 23:05:54 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:05:54 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:05:54 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:05:54 user nova-compute[72766]:   </cpu>
Aug 14 23:05:54 user nova-compute[72766]:   <devices>
Aug 14 23:05:54 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 23:05:54 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 23:05:54 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/13f8f416-9f1d-461c-95e5-fc13ffebdf81/disk"/>
Aug 14 23:05:54 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:05:54 user nova-compute[72766]:     </disk>
Aug 14 23:05:54 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:05:54 user nova-compute[72766]:       <mac address="fa:16:3e:7b:7c:59"/>
Aug 14 23:05:54 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:05:54 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:05:54 user nova-compute[72766]:       <target dev="tapbfd9d907-21"/>
Aug 14 23:05:54 user nova-compute[72766]:     </interface>
Aug 14 23:05:54 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:05:54 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/13f8f416-9f1d-461c-95e5-fc13ffebdf81/console.log" append="off"/>
Aug 14 23:05:54 user nova-compute[72766]:     </serial>
Aug 14 23:05:54 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:05:54 user nova-compute[72766]:     <video>
Aug 14 23:05:54 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:05:54 user nova-compute[72766]:     </video>
Aug 14 23:05:54 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:05:54 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:05:54 user nova-compute[72766]:     </rng>
Aug 14 23:05:54 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:05:54 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:05:54 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:05:54 user nova-compute[72766]:     </memballoon>
Aug 14 23:05:54 user nova-compute[72766]:   </devices>
Aug 14 23:05:54 user nova-compute[72766]: </domain>
Aug 14 23:05:54 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:05:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-61243865',display_name='tempest-VolumesActionsTest-instance-61243865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-61243865',id=25,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35e195e30a9642f0b0f2af918f03d0a3',ramdisk_id='',reservation_id='r-l9n3u6pb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-786823184',owner_user_name='tempest-VolumesActionsTest-786823184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:05:52Z,user_data=None,user_id='d92da0d2b7bc4865b04564b3dda15744',uuid=13f8f416-9f1d-461c-95e5-fc13ffebdf81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfd9d907-21ac-4b49-8467-e281025cdb45", "address": "fa:16:3e:7b:7c:59", "network": {"id": "f38afcd2-d9b4-427b-a94f-46f2e935370a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-614672131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e195e30a9642f0b0f2af918f03d0a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfd9d907-21", "ovs_interfaceid": "bfd9d907-21ac-4b49-8467-e281025cdb45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Converting VIF {"id": "bfd9d907-21ac-4b49-8467-e281025cdb45", "address": "fa:16:3e:7b:7c:59", "network": {"id": "f38afcd2-d9b4-427b-a94f-46f2e935370a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-614672131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e195e30a9642f0b0f2af918f03d0a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfd9d907-21", "ovs_interfaceid": "bfd9d907-21ac-4b49-8467-e281025cdb45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:7c:59,bridge_name='br-int',has_traffic_filtering=True,id=bfd9d907-21ac-4b49-8467-e281025cdb45,network=Network(f38afcd2-d9b4-427b-a94f-46f2e935370a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfd9d907-21') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG os_vif [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:7c:59,bridge_name='br-int',has_traffic_filtering=True,id=bfd9d907-21ac-4b49-8467-e281025cdb45,network=Network(f38afcd2-d9b4-427b-a94f-46f2e935370a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfd9d907-21') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbfd9d907-21, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbfd9d907-21, col_values=(('external_ids', {'iface-id': 'bfd9d907-21ac-4b49-8467-e281025cdb45', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:7c:59', 'vm-uuid': '13f8f416-9f1d-461c-95e5-fc13ffebdf81'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:54 user nova-compute[72766]: INFO os_vif [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:7c:59,bridge_name='br-int',has_traffic_filtering=True,id=bfd9d907-21ac-4b49-8467-e281025cdb45,network=Network(f38afcd2-d9b4-427b-a94f-46f2e935370a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfd9d907-21')
Aug 14 23:05:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:05:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] No VIF found with MAC fa:16:3e:7b:7c:59, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:05:55 user nova-compute[72766]: DEBUG nova.network.neutron [req-d653d979-a11c-4047-8326-9e0f4bad2aca req-fcb0ad20-1dfd-45dd-b632-150bea6a60ce service nova] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Updated VIF entry in instance network info cache for port bfd9d907-21ac-4b49-8467-e281025cdb45. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:05:55 user nova-compute[72766]: DEBUG nova.network.neutron [req-d653d979-a11c-4047-8326-9e0f4bad2aca req-fcb0ad20-1dfd-45dd-b632-150bea6a60ce service nova] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Updating instance_info_cache with network_info: [{"id": "bfd9d907-21ac-4b49-8467-e281025cdb45", "address": "fa:16:3e:7b:7c:59", "network": {"id": "f38afcd2-d9b4-427b-a94f-46f2e935370a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-614672131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e195e30a9642f0b0f2af918f03d0a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfd9d907-21", "ovs_interfaceid": "bfd9d907-21ac-4b49-8467-e281025cdb45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:05:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d653d979-a11c-4047-8326-9e0f4bad2aca req-fcb0ad20-1dfd-45dd-b632-150bea6a60ce service nova] Releasing lock "refresh_cache-13f8f416-9f1d-461c-95e5-fc13ffebdf81" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:05:55 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:55 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:55 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:55 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:55 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:56 user nova-compute[72766]: DEBUG nova.compute.manager [req-6bfd4d05-5477-4a90-b662-a5b6457f2e88 req-486c0ade-9625-4a18-b1f9-ef08199f4fb1 service nova] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Received event network-vif-plugged-88d8c4aa-b464-4686-8c2c-d4378e0efa65 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:05:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-6bfd4d05-5477-4a90-b662-a5b6457f2e88 req-486c0ade-9625-4a18-b1f9-ef08199f4fb1 service nova] Acquiring lock "8e358215-4455-4657-8663-1a144f39eb6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:05:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-6bfd4d05-5477-4a90-b662-a5b6457f2e88 req-486c0ade-9625-4a18-b1f9-ef08199f4fb1 service nova] Lock "8e358215-4455-4657-8663-1a144f39eb6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:05:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-6bfd4d05-5477-4a90-b662-a5b6457f2e88 req-486c0ade-9625-4a18-b1f9-ef08199f4fb1 service nova] Lock "8e358215-4455-4657-8663-1a144f39eb6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:05:56 user nova-compute[72766]: DEBUG nova.compute.manager [req-6bfd4d05-5477-4a90-b662-a5b6457f2e88 req-486c0ade-9625-4a18-b1f9-ef08199f4fb1 service nova] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] No waiting events found dispatching network-vif-plugged-88d8c4aa-b464-4686-8c2c-d4378e0efa65 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:05:56 user nova-compute[72766]: WARNING nova.compute.manager [req-6bfd4d05-5477-4a90-b662-a5b6457f2e88 req-486c0ade-9625-4a18-b1f9-ef08199f4fb1 service nova] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Received unexpected event network-vif-plugged-88d8c4aa-b464-4686-8c2c-d4378e0efa65 for instance with vm_state building and task_state spawning.
Aug 14 23:05:56 user nova-compute[72766]: DEBUG nova.compute.manager [req-6bfd4d05-5477-4a90-b662-a5b6457f2e88 req-486c0ade-9625-4a18-b1f9-ef08199f4fb1 service nova] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Received event network-vif-plugged-88d8c4aa-b464-4686-8c2c-d4378e0efa65 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:05:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-6bfd4d05-5477-4a90-b662-a5b6457f2e88 req-486c0ade-9625-4a18-b1f9-ef08199f4fb1 service nova] Acquiring lock "8e358215-4455-4657-8663-1a144f39eb6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:05:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-6bfd4d05-5477-4a90-b662-a5b6457f2e88 req-486c0ade-9625-4a18-b1f9-ef08199f4fb1 service nova] Lock "8e358215-4455-4657-8663-1a144f39eb6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:05:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-6bfd4d05-5477-4a90-b662-a5b6457f2e88 req-486c0ade-9625-4a18-b1f9-ef08199f4fb1 service nova] Lock "8e358215-4455-4657-8663-1a144f39eb6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:05:56 user nova-compute[72766]: DEBUG nova.compute.manager [req-6bfd4d05-5477-4a90-b662-a5b6457f2e88 req-486c0ade-9625-4a18-b1f9-ef08199f4fb1 service nova] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] No waiting events found dispatching network-vif-plugged-88d8c4aa-b464-4686-8c2c-d4378e0efa65 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:05:56 user nova-compute[72766]: WARNING nova.compute.manager [req-6bfd4d05-5477-4a90-b662-a5b6457f2e88 req-486c0ade-9625-4a18-b1f9-ef08199f4fb1 service nova] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Received unexpected event network-vif-plugged-88d8c4aa-b464-4686-8c2c-d4378e0efa65 for instance with vm_state building and task_state spawning.
Aug 14 23:05:56 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-7f95ade9-d318-4506-8a54-1c5a1918d92c tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Snapshot image upload complete
Aug 14 23:05:56 user nova-compute[72766]: DEBUG nova.compute.manager [None req-7f95ade9-d318-4506-8a54-1c5a1918d92c tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:05:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:56 user nova-compute[72766]: INFO nova.compute.manager [None req-7f95ade9-d318-4506-8a54-1c5a1918d92c tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Shelve offloading
Aug 14 23:05:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:56 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Instance destroyed successfully.
Aug 14 23:05:56 user nova-compute[72766]: DEBUG nova.compute.manager [None req-7f95ade9-d318-4506-8a54-1c5a1918d92c tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:05:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7f95ade9-d318-4506-8a54-1c5a1918d92c tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquiring lock "refresh_cache-11e79581-a122-4c0a-8485-a8b6c62e73b8" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:05:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7f95ade9-d318-4506-8a54-1c5a1918d92c tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquired lock "refresh_cache-11e79581-a122-4c0a-8485-a8b6c62e73b8" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:05:56 user nova-compute[72766]: DEBUG nova.network.neutron [None req-7f95ade9-d318-4506-8a54-1c5a1918d92c tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:05:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:56 user nova-compute[72766]: DEBUG nova.compute.manager [req-32f626f8-6835-4bb7-b104-19215fa2d69b req-a3497f28-9d45-44eb-8587-f47d1ef6bc81 service nova] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Received event network-vif-plugged-bfd9d907-21ac-4b49-8467-e281025cdb45 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:05:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-32f626f8-6835-4bb7-b104-19215fa2d69b req-a3497f28-9d45-44eb-8587-f47d1ef6bc81 service nova] Acquiring lock "13f8f416-9f1d-461c-95e5-fc13ffebdf81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:05:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-32f626f8-6835-4bb7-b104-19215fa2d69b req-a3497f28-9d45-44eb-8587-f47d1ef6bc81 service nova] Lock "13f8f416-9f1d-461c-95e5-fc13ffebdf81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:05:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-32f626f8-6835-4bb7-b104-19215fa2d69b req-a3497f28-9d45-44eb-8587-f47d1ef6bc81 service nova] Lock "13f8f416-9f1d-461c-95e5-fc13ffebdf81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:05:56 user nova-compute[72766]: DEBUG nova.compute.manager [req-32f626f8-6835-4bb7-b104-19215fa2d69b req-a3497f28-9d45-44eb-8587-f47d1ef6bc81 service nova] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] No waiting events found dispatching network-vif-plugged-bfd9d907-21ac-4b49-8467-e281025cdb45 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:05:56 user nova-compute[72766]: WARNING nova.compute.manager [req-32f626f8-6835-4bb7-b104-19215fa2d69b req-a3497f28-9d45-44eb-8587-f47d1ef6bc81 service nova] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Received unexpected event network-vif-plugged-bfd9d907-21ac-4b49-8467-e281025cdb45 for instance with vm_state building and task_state spawning.
Aug 14 23:05:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:57 user nova-compute[72766]: DEBUG nova.network.neutron [None req-7f95ade9-d318-4506-8a54-1c5a1918d92c tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Updating instance_info_cache with network_info: [{"id": "0add7ef0-687d-4486-842d-2d07c0d26449", "address": "fa:16:3e:4a:df:6f", "network": {"id": "ed86b27c-3e64-4c0a-8824-9bf68068058a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-506861998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f36bd126bda43c6971bccdef2b1da91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0add7ef0-68", "ovs_interfaceid": "0add7ef0-687d-4486-842d-2d07c0d26449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:05:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7f95ade9-d318-4506-8a54-1c5a1918d92c tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Releasing lock "refresh_cache-11e79581-a122-4c0a-8485-a8b6c62e73b8" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:05:57 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Instance destroyed successfully.
Aug 14 23:05:57 user nova-compute[72766]: DEBUG nova.objects.instance [None req-7f95ade9-d318-4506-8a54-1c5a1918d92c tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lazy-loading 'resources' on Instance uuid 11e79581-a122-4c0a-8485-a8b6c62e73b8 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:05:57 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-7f95ade9-d318-4506-8a54-1c5a1918d92c tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:03:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-584854465',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-584854465',id=23,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ44/tjV8BW1ypYMZmiG7D1vfWXeB7Xr0eiDzs39QKWPjJ4VdMwqyWoKm6vbKzV3JsMUSI4O8FCswMnuL0W/+R28XJlRiL9zGXvdMjiPnmfiDPuJEi6nWJYbgddxoV1TcA==',key_name='tempest-keypair-1485779782',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:04:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3f36bd126bda43c6971bccdef2b1da91',ramdisk_id='',reservation_id='r-6wg52w6r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1828708750',owner_user_name='tempest-AttachVolumeShelveTestJSON-1828708750-project-member',shelved_at='2023-08-14T23:05:56.310512',shelved_host='user',shelved_image_id='a2627ebd-1630-4023-a8f3-daf19b0de6c8'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:05:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb167893135e4073928a60630ae7720c',uuid=11e79581-a122-4c0a-8485-a8b6c62e73b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "0add7ef0-687d-4486-842d-2d07c0d26449", "address": "fa:16:3e:4a:df:6f", "network": {"id": "ed86b27c-3e64-4c0a-8824-9bf68068058a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-506861998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f36bd126bda43c6971bccdef2b1da91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0add7ef0-68", "ovs_interfaceid": "0add7ef0-687d-4486-842d-2d07c0d26449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:05:57 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-7f95ade9-d318-4506-8a54-1c5a1918d92c tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Converting VIF {"id": "0add7ef0-687d-4486-842d-2d07c0d26449", "address": "fa:16:3e:4a:df:6f", "network": {"id": "ed86b27c-3e64-4c0a-8824-9bf68068058a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-506861998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f36bd126bda43c6971bccdef2b1da91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0add7ef0-68", "ovs_interfaceid": "0add7ef0-687d-4486-842d-2d07c0d26449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:05:57 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-7f95ade9-d318-4506-8a54-1c5a1918d92c tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:df:6f,bridge_name='br-int',has_traffic_filtering=True,id=0add7ef0-687d-4486-842d-2d07c0d26449,network=Network(ed86b27c-3e64-4c0a-8824-9bf68068058a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0add7ef0-68') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:05:57 user nova-compute[72766]: DEBUG os_vif [None req-7f95ade9-d318-4506-8a54-1c5a1918d92c tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:df:6f,bridge_name='br-int',has_traffic_filtering=True,id=0add7ef0-687d-4486-842d-2d07c0d26449,network=Network(ed86b27c-3e64-4c0a-8824-9bf68068058a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0add7ef0-68') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:05:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0add7ef0-68, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:05:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:05:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:57 user nova-compute[72766]: INFO os_vif [None req-7f95ade9-d318-4506-8a54-1c5a1918d92c tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:df:6f,bridge_name='br-int',has_traffic_filtering=True,id=0add7ef0-687d-4486-842d-2d07c0d26449,network=Network(ed86b27c-3e64-4c0a-8824-9bf68068058a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0add7ef0-68')
Aug 14 23:05:57 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-7f95ade9-d318-4506-8a54-1c5a1918d92c tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Deleting instance files /opt/stack/data/nova/instances/11e79581-a122-4c0a-8485-a8b6c62e73b8_del
Aug 14 23:05:57 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-7f95ade9-d318-4506-8a54-1c5a1918d92c tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Deletion of /opt/stack/data/nova/instances/11e79581-a122-4c0a-8485-a8b6c62e73b8_del complete
Aug 14 23:05:58 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-7f95ade9-d318-4506-8a54-1c5a1918d92c tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Deleted allocations for instance 11e79581-a122-4c0a-8485-a8b6c62e73b8
Aug 14 23:05:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7f95ade9-d318-4506-8a54-1c5a1918d92c tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:05:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7f95ade9-d318-4506-8a54-1c5a1918d92c tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:05:58 user nova-compute[72766]: DEBUG nova.objects.instance [None req-7f95ade9-d318-4506-8a54-1c5a1918d92c tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lazy-loading 'numa_topology' on Instance uuid 11e79581-a122-4c0a-8485-a8b6c62e73b8 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:05:58 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054358.3113122, 8e358215-4455-4657-8663-1a144f39eb6e => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:05:58 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] VM Resumed (Lifecycle Event)
Aug 14 23:05:58 user nova-compute[72766]: DEBUG nova.compute.manager [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:05:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 23:05:58 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Instance spawned successfully.
Aug 14 23:05:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 23:05:58 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:05:58 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:05:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:05:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:05:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:05:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:05:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:05:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:05:58 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-7f95ade9-d318-4506-8a54-1c5a1918d92c tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:05:58 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:05:58 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054358.315375, 8e358215-4455-4657-8663-1a144f39eb6e => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:05:58 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] VM Started (Lifecycle Event)
Aug 14 23:05:58 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-7f95ade9-d318-4506-8a54-1c5a1918d92c tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:05:58 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:05:58 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:05:58 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:05:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7f95ade9-d318-4506-8a54-1c5a1918d92c tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:05:58 user nova-compute[72766]: INFO nova.compute.manager [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Took 9.26 seconds to spawn the instance on the hypervisor.
Aug 14 23:05:58 user nova-compute[72766]: DEBUG nova.compute.manager [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:05:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7f95ade9-d318-4506-8a54-1c5a1918d92c tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "11e79581-a122-4c0a-8485-a8b6c62e73b8" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.672s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:05:58 user nova-compute[72766]: INFO nova.compute.manager [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Took 10.20 seconds to build instance.
Aug 14 23:05:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a59a6454-0b09-4fcf-98d8-7d2cd50d800a tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Lock "8e358215-4455-4657-8663-1a144f39eb6e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.334s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:05:58 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054358.7857466, 13f8f416-9f1d-461c-95e5-fc13ffebdf81 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:05:58 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] VM Resumed (Lifecycle Event)
Aug 14 23:05:58 user nova-compute[72766]: DEBUG nova.compute.manager [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:05:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 23:05:58 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Instance spawned successfully.
Aug 14 23:05:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 23:05:58 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:05:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:05:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:05:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:05:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:05:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:05:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:05:58 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:05:58 user nova-compute[72766]: DEBUG nova.compute.manager [req-b546bf9d-b6c3-42f4-ba4a-6163f0277e10 req-1da99e64-acf0-4d70-8abb-30b1a67d6fa2 service nova] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Received event network-vif-plugged-bfd9d907-21ac-4b49-8467-e281025cdb45 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:05:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-b546bf9d-b6c3-42f4-ba4a-6163f0277e10 req-1da99e64-acf0-4d70-8abb-30b1a67d6fa2 service nova] Acquiring lock "13f8f416-9f1d-461c-95e5-fc13ffebdf81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:05:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-b546bf9d-b6c3-42f4-ba4a-6163f0277e10 req-1da99e64-acf0-4d70-8abb-30b1a67d6fa2 service nova] Lock "13f8f416-9f1d-461c-95e5-fc13ffebdf81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:05:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-b546bf9d-b6c3-42f4-ba4a-6163f0277e10 req-1da99e64-acf0-4d70-8abb-30b1a67d6fa2 service nova] Lock "13f8f416-9f1d-461c-95e5-fc13ffebdf81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:05:58 user nova-compute[72766]: DEBUG nova.compute.manager [req-b546bf9d-b6c3-42f4-ba4a-6163f0277e10 req-1da99e64-acf0-4d70-8abb-30b1a67d6fa2 service nova] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] No waiting events found dispatching network-vif-plugged-bfd9d907-21ac-4b49-8467-e281025cdb45 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:05:58 user nova-compute[72766]: WARNING nova.compute.manager [req-b546bf9d-b6c3-42f4-ba4a-6163f0277e10 req-1da99e64-acf0-4d70-8abb-30b1a67d6fa2 service nova] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Received unexpected event network-vif-plugged-bfd9d907-21ac-4b49-8467-e281025cdb45 for instance with vm_state building and task_state spawning.
Aug 14 23:05:58 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:05:58 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054358.7880197, 13f8f416-9f1d-461c-95e5-fc13ffebdf81 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:05:58 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] VM Started (Lifecycle Event)
Aug 14 23:05:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:05:58 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:05:58 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:05:58 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:05:58 user nova-compute[72766]: INFO nova.compute.manager [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Took 6.82 seconds to spawn the instance on the hypervisor.
Aug 14 23:05:58 user nova-compute[72766]: DEBUG nova.compute.manager [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:05:59 user nova-compute[72766]: INFO nova.compute.manager [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Took 7.84 seconds to build instance.
Aug 14 23:05:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-164dbd50-d4a1-449b-8e2f-f56d6511a0e1 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Lock "13f8f416-9f1d-461c-95e5-fc13ffebdf81" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.009s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:06:02 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:06:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:06:07 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692054352.5227795, 11e79581-a122-4c0a-8485-a8b6c62e73b8 => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:06:07 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] VM Stopped (Lifecycle Event)
Aug 14 23:06:07 user nova-compute[72766]: DEBUG nova.compute.manager [None req-48619ac0-11f4-4c0c-bd44-4d3137d7e5cb None None] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:06:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:06:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:06:12 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:06:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:06:17 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:06:18 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:06:18 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:06:18 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Rebuilding the list of instances to heal {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 23:06:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-78f02883-99a1-493d-b6be-e43500bfba37" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:06:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-78f02883-99a1-493d-b6be-e43500bfba37" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:06:18 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:06:18 user nova-compute[72766]: DEBUG nova.objects.instance [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lazy-loading 'info_cache' on Instance uuid 78f02883-99a1-493d-b6be-e43500bfba37 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:06:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:06:19 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Updating instance_info_cache with network_info: [{"id": "8e7e311b-453d-4e17-9652-45723c7a2944", "address": "fa:16:3e:7e:31:c1", "network": {"id": "c07935db-7a05-49df-a504-682549f30d55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-765423768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ff897ef00ec45258b22d76ca60447fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e7e311b-45", "ovs_interfaceid": "8e7e311b-453d-4e17-9652-45723c7a2944", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:06:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-78f02883-99a1-493d-b6be-e43500bfba37" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:06:19 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:06:20 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:06:22 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:06:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:06:23 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:06:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:06:24 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:06:26 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:06:26 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:06:26 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:06:26 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:06:27 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:06:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:06:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:06:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:06:27 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:06:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:06:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:06:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:06:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:06:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:06:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:06:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:06:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83084ccc-8e55-43dc-9a37-ffcb35a10922/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:06:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83084ccc-8e55-43dc-9a37-ffcb35a10922/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:06:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83084ccc-8e55-43dc-9a37-ffcb35a10922/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:06:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83084ccc-8e55-43dc-9a37-ffcb35a10922/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:06:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:06:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:06:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:06:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:06:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:06:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:06:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:06:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:06:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:06:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:06:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13f8f416-9f1d-461c-95e5-fc13ffebdf81/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:06:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13f8f416-9f1d-461c-95e5-fc13ffebdf81/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:06:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13f8f416-9f1d-461c-95e5-fc13ffebdf81/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:06:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13f8f416-9f1d-461c-95e5-fc13ffebdf81/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:06:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e358215-4455-4657-8663-1a144f39eb6e/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:06:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e358215-4455-4657-8663-1a144f39eb6e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:06:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e358215-4455-4657-8663-1a144f39eb6e/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:06:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e358215-4455-4657-8663-1a144f39eb6e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:06:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:06:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:06:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:06:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:06:30 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:06:30 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:06:30 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=7790MB free_disk=25.43759536743164GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:06:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:06:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:06:31 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 3ff300ff-34fd-4e94-9d2d-681fb133ba32 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:06:31 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance cbcf7851-e6f7-4f46-97cc-d773286ccddf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:06:31 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 66578337-cbff-4613-87a1-85ddabaebb2d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:06:31 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 83084ccc-8e55-43dc-9a37-ffcb35a10922 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:06:31 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 78f02883-99a1-493d-b6be-e43500bfba37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:06:31 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 8e358215-4455-4657-8663-1a144f39eb6e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:06:31 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 13f8f416-9f1d-461c-95e5-fc13ffebdf81 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:06:31 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:06:31 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:06:31 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Refreshing inventories for resource provider 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 23:06:31 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Updating ProviderTree inventory for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 23:06:31 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Updating inventory in ProviderTree for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 23:06:31 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Refreshing aggregate associations for resource provider 45c8ff08-bf31-4ab6-8452-2e293102f899, aggregates: None {{(pid=72766) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 23:06:31 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Refreshing trait associations for resource provider 45c8ff08-bf31-4ab6-8452-2e293102f899, traits: COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=72766) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 23:06:31 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:06:31 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:06:31 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:06:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.611s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:06:31 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:06:31 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Cleaning up deleted instances {{(pid=72766) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 23:06:31 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] There are 0 instances to clean {{(pid=72766) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 23:06:31 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:06:31 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72766) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 23:06:31 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:06:32 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:06:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:06:37 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:06:42 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:06:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:06:47 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:06:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:06:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:06:48 user nova-compute[72766]: DEBUG nova.compute.manager [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 23:06:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:06:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:06:49 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 23:06:49 user nova-compute[72766]: INFO nova.compute.claims [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Claim successful on node user
Aug 14 23:06:49 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:06:49 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:06:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.344s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:06:49 user nova-compute[72766]: DEBUG nova.compute.manager [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 23:06:49 user nova-compute[72766]: DEBUG nova.compute.manager [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 23:06:49 user nova-compute[72766]: DEBUG nova.network.neutron [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 23:06:49 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 23:06:49 user nova-compute[72766]: DEBUG nova.compute.manager [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 23:06:49 user nova-compute[72766]: DEBUG nova.policy [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11bf21631dd0447f8f1a3f2b012ec43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b0d4f038dbd47b1aad9829f19cb4896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 23:06:49 user nova-compute[72766]: DEBUG nova.compute.manager [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 23:06:49 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 23:06:49 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Creating image(s)
Aug 14 23:06:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "/opt/stack/data/nova/instances/99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:06:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "/opt/stack/data/nova/instances/99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:06:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "/opt/stack/data/nova/instances/99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:06:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:06:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.171s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:06:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:06:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:06:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:06:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.170s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:06:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef/disk 1073741824 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:06:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef/disk 1073741824" returned: 0 in 0.054s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:06:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:06:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:06:50 user nova-compute[72766]: DEBUG nova.network.neutron [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Successfully created port: 0df45a26-6026-4baa-bdaa-a761d2d3c2a6 {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 23:06:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.186s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:06:50 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Checking if we can resize image /opt/stack/data/nova/instances/99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef/disk. size=1073741824 {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 23:06:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:06:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:06:50 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Cannot resize image /opt/stack/data/nova/instances/99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef/disk to a smaller size. {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 23:06:50 user nova-compute[72766]: DEBUG nova.objects.instance [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lazy-loading 'migration_context' on Instance uuid 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:06:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 23:06:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Ensure instance console log exists: /opt/stack/data/nova/instances/99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 23:06:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:06:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:06:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG nova.network.neutron [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Successfully updated port: 0df45a26-6026-4baa-bdaa-a761d2d3c2a6 {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "refresh_cache-99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquired lock "refresh_cache-99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG nova.network.neutron [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG nova.compute.manager [req-96703930-fe11-4496-a976-e0af40bd444a req-55cbb5b9-536b-4666-b50e-f13a79a93d9d service nova] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Received event network-changed-0df45a26-6026-4baa-bdaa-a761d2d3c2a6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG nova.compute.manager [req-96703930-fe11-4496-a976-e0af40bd444a req-55cbb5b9-536b-4666-b50e-f13a79a93d9d service nova] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Refreshing instance network info cache due to event network-changed-0df45a26-6026-4baa-bdaa-a761d2d3c2a6. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-96703930-fe11-4496-a976-e0af40bd444a req-55cbb5b9-536b-4666-b50e-f13a79a93d9d service nova] Acquiring lock "refresh_cache-99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG nova.network.neutron [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG nova.network.neutron [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Updating instance_info_cache with network_info: [{"id": "0df45a26-6026-4baa-bdaa-a761d2d3c2a6", "address": "fa:16:3e:89:96:a5", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0df45a26-60", "ovs_interfaceid": "0df45a26-6026-4baa-bdaa-a761d2d3c2a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Releasing lock "refresh_cache-99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG nova.compute.manager [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Instance network_info: |[{"id": "0df45a26-6026-4baa-bdaa-a761d2d3c2a6", "address": "fa:16:3e:89:96:a5", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0df45a26-60", "ovs_interfaceid": "0df45a26-6026-4baa-bdaa-a761d2d3c2a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-96703930-fe11-4496-a976-e0af40bd444a req-55cbb5b9-536b-4666-b50e-f13a79a93d9d service nova] Acquired lock "refresh_cache-99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG nova.network.neutron [req-96703930-fe11-4496-a976-e0af40bd444a req-55cbb5b9-536b-4666-b50e-f13a79a93d9d service nova] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Refreshing network info cache for port 0df45a26-6026-4baa-bdaa-a761d2d3c2a6 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Start _get_guest_xml network_info=[{"id": "0df45a26-6026-4baa-bdaa-a761d2d3c2a6", "address": "fa:16:3e:89:96:a5", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0df45a26-60", "ovs_interfaceid": "0df45a26-6026-4baa-bdaa-a761d2d3c2a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd2900d30-2c4c-4d57-9135-d45564c0c596'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:06:51 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:06:51 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:06:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:06:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-150191314',display_name='tempest-tempest.common.compute-instance-150191314',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-150191314',id=26,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhBKWAdQDYNegvQl/mV+51njSAEVUmutFEgZbA9nGUhkxXmc3MlsVdSjdWdHEupxDpXGsOvLx4E4h8d+jhKDRG+ZGsHr6pYyGyF87J32gsCcwif1sgiUwbddldcHNR0PA==',key_name='tempest-keypair-293995822',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b0d4f038dbd47b1aad9829f19cb4896',ramdisk_id='',reservation_id='r-uuuhfmg4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-242565278',owner_user_name='tempest-ServerActionsTestOtherA-242565278-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:06:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11bf21631dd0447f8f1a3f2b012ec43a',uuid=99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0df45a26-6026-4baa-bdaa-a761d2d3c2a6", "address": "fa:16:3e:89:96:a5", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0df45a26-60", "ovs_interfaceid": "0df45a26-6026-4baa-bdaa-a761d2d3c2a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Converting VIF {"id": "0df45a26-6026-4baa-bdaa-a761d2d3c2a6", "address": "fa:16:3e:89:96:a5", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0df45a26-60", "ovs_interfaceid": "0df45a26-6026-4baa-bdaa-a761d2d3c2a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:96:a5,bridge_name='br-int',has_traffic_filtering=True,id=0df45a26-6026-4baa-bdaa-a761d2d3c2a6,network=Network(e0bbc182-f700-4a82-84ae-7cbcb2e517c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0df45a26-60') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG nova.objects.instance [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lazy-loading 'pci_devices' on Instance uuid 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:06:51 user nova-compute[72766]:   <uuid>99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef</uuid>
Aug 14 23:06:51 user nova-compute[72766]:   <name>instance-0000001a</name>
Aug 14 23:06:51 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:06:51 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:06:51 user nova-compute[72766]:   <metadata>
Aug 14 23:06:51 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:06:51 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:06:51 user nova-compute[72766]:       <nova:name>tempest-tempest.common.compute-instance-150191314</nova:name>
Aug 14 23:06:51 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:06:51</nova:creationTime>
Aug 14 23:06:51 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:06:51 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:06:51 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:06:51 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:06:51 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:06:51 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:06:51 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:06:51 user nova-compute[72766]:       <nova:owner>
Aug 14 23:06:51 user nova-compute[72766]:         <nova:user uuid="11bf21631dd0447f8f1a3f2b012ec43a">tempest-ServerActionsTestOtherA-242565278-project-member</nova:user>
Aug 14 23:06:51 user nova-compute[72766]:         <nova:project uuid="7b0d4f038dbd47b1aad9829f19cb4896">tempest-ServerActionsTestOtherA-242565278</nova:project>
Aug 14 23:06:51 user nova-compute[72766]:       </nova:owner>
Aug 14 23:06:51 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 23:06:51 user nova-compute[72766]:       <nova:ports>
Aug 14 23:06:51 user nova-compute[72766]:         <nova:port uuid="0df45a26-6026-4baa-bdaa-a761d2d3c2a6">
Aug 14 23:06:51 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 23:06:51 user nova-compute[72766]:         </nova:port>
Aug 14 23:06:51 user nova-compute[72766]:       </nova:ports>
Aug 14 23:06:51 user nova-compute[72766]:     </nova:instance>
Aug 14 23:06:51 user nova-compute[72766]:   </metadata>
Aug 14 23:06:51 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:06:51 user nova-compute[72766]:     <system>
Aug 14 23:06:51 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:06:51 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:06:51 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:06:51 user nova-compute[72766]:       <entry name="serial">99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef</entry>
Aug 14 23:06:51 user nova-compute[72766]:       <entry name="uuid">99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef</entry>
Aug 14 23:06:51 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:06:51 user nova-compute[72766]:     </system>
Aug 14 23:06:51 user nova-compute[72766]:   </sysinfo>
Aug 14 23:06:51 user nova-compute[72766]:   <os>
Aug 14 23:06:51 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:06:51 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:06:51 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:06:51 user nova-compute[72766]:   </os>
Aug 14 23:06:51 user nova-compute[72766]:   <features>
Aug 14 23:06:51 user nova-compute[72766]:     <acpi/>
Aug 14 23:06:51 user nova-compute[72766]:     <apic/>
Aug 14 23:06:51 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:06:51 user nova-compute[72766]:   </features>
Aug 14 23:06:51 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:06:51 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:06:51 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:06:51 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:06:51 user nova-compute[72766]:   </clock>
Aug 14 23:06:51 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:06:51 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:06:51 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:06:51 user nova-compute[72766]:   </cpu>
Aug 14 23:06:51 user nova-compute[72766]:   <devices>
Aug 14 23:06:51 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 23:06:51 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 23:06:51 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef/disk"/>
Aug 14 23:06:51 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:06:51 user nova-compute[72766]:     </disk>
Aug 14 23:06:51 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:06:51 user nova-compute[72766]:       <mac address="fa:16:3e:89:96:a5"/>
Aug 14 23:06:51 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:06:51 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:06:51 user nova-compute[72766]:       <target dev="tap0df45a26-60"/>
Aug 14 23:06:51 user nova-compute[72766]:     </interface>
Aug 14 23:06:51 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:06:51 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef/console.log" append="off"/>
Aug 14 23:06:51 user nova-compute[72766]:     </serial>
Aug 14 23:06:51 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:06:51 user nova-compute[72766]:     <video>
Aug 14 23:06:51 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:06:51 user nova-compute[72766]:     </video>
Aug 14 23:06:51 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:06:51 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:06:51 user nova-compute[72766]:     </rng>
Aug 14 23:06:51 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:06:51 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:06:51 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:06:51 user nova-compute[72766]:     </memballoon>
Aug 14 23:06:51 user nova-compute[72766]:   </devices>
Aug 14 23:06:51 user nova-compute[72766]: </domain>
Aug 14 23:06:51 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:06:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-150191314',display_name='tempest-tempest.common.compute-instance-150191314',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-150191314',id=26,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhBKWAdQDYNegvQl/mV+51njSAEVUmutFEgZbA9nGUhkxXmc3MlsVdSjdWdHEupxDpXGsOvLx4E4h8d+jhKDRG+ZGsHr6pYyGyF87J32gsCcwif1sgiUwbddldcHNR0PA==',key_name='tempest-keypair-293995822',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b0d4f038dbd47b1aad9829f19cb4896',ramdisk_id='',reservation_id='r-uuuhfmg4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-242565278',owner_user_name='tempest-ServerActionsTestOtherA-242565278-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:06:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11bf21631dd0447f8f1a3f2b012ec43a',uuid=99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0df45a26-6026-4baa-bdaa-a761d2d3c2a6", "address": "fa:16:3e:89:96:a5", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0df45a26-60", "ovs_interfaceid": "0df45a26-6026-4baa-bdaa-a761d2d3c2a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Converting VIF {"id": "0df45a26-6026-4baa-bdaa-a761d2d3c2a6", "address": "fa:16:3e:89:96:a5", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0df45a26-60", "ovs_interfaceid": "0df45a26-6026-4baa-bdaa-a761d2d3c2a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:96:a5,bridge_name='br-int',has_traffic_filtering=True,id=0df45a26-6026-4baa-bdaa-a761d2d3c2a6,network=Network(e0bbc182-f700-4a82-84ae-7cbcb2e517c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0df45a26-60') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG os_vif [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:96:a5,bridge_name='br-int',has_traffic_filtering=True,id=0df45a26-6026-4baa-bdaa-a761d2d3c2a6,network=Network(e0bbc182-f700-4a82-84ae-7cbcb2e517c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0df45a26-60') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0df45a26-60, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0df45a26-60, col_values=(('external_ids', {'iface-id': '0df45a26-6026-4baa-bdaa-a761d2d3c2a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:96:a5', 'vm-uuid': '99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:06:51 user nova-compute[72766]: INFO os_vif [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:96:a5,bridge_name='br-int',has_traffic_filtering=True,id=0df45a26-6026-4baa-bdaa-a761d2d3c2a6,network=Network(e0bbc182-f700-4a82-84ae-7cbcb2e517c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0df45a26-60')
Aug 14 23:06:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] No VIF found with MAC fa:16:3e:89:96:a5, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG nova.network.neutron [req-96703930-fe11-4496-a976-e0af40bd444a req-55cbb5b9-536b-4666-b50e-f13a79a93d9d service nova] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Updated VIF entry in instance network info cache for port 0df45a26-6026-4baa-bdaa-a761d2d3c2a6. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG nova.network.neutron [req-96703930-fe11-4496-a976-e0af40bd444a req-55cbb5b9-536b-4666-b50e-f13a79a93d9d service nova] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Updating instance_info_cache with network_info: [{"id": "0df45a26-6026-4baa-bdaa-a761d2d3c2a6", "address": "fa:16:3e:89:96:a5", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0df45a26-60", "ovs_interfaceid": "0df45a26-6026-4baa-bdaa-a761d2d3c2a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:06:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-96703930-fe11-4496-a976-e0af40bd444a req-55cbb5b9-536b-4666-b50e-f13a79a93d9d service nova] Releasing lock "refresh_cache-99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:06:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:06:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:06:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:06:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:06:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:06:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:06:53 user nova-compute[72766]: DEBUG nova.compute.manager [req-a75f196c-4dbe-4b24-b90c-c7bc86cced61 req-22f7cf1c-4e05-42db-b3d5-691dec6a5d8f service nova] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Received event network-vif-plugged-0df45a26-6026-4baa-bdaa-a761d2d3c2a6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:06:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a75f196c-4dbe-4b24-b90c-c7bc86cced61 req-22f7cf1c-4e05-42db-b3d5-691dec6a5d8f service nova] Acquiring lock "99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:06:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a75f196c-4dbe-4b24-b90c-c7bc86cced61 req-22f7cf1c-4e05-42db-b3d5-691dec6a5d8f service nova] Lock "99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:06:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a75f196c-4dbe-4b24-b90c-c7bc86cced61 req-22f7cf1c-4e05-42db-b3d5-691dec6a5d8f service nova] Lock "99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:06:53 user nova-compute[72766]: DEBUG nova.compute.manager [req-a75f196c-4dbe-4b24-b90c-c7bc86cced61 req-22f7cf1c-4e05-42db-b3d5-691dec6a5d8f service nova] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] No waiting events found dispatching network-vif-plugged-0df45a26-6026-4baa-bdaa-a761d2d3c2a6 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:06:53 user nova-compute[72766]: WARNING nova.compute.manager [req-a75f196c-4dbe-4b24-b90c-c7bc86cced61 req-22f7cf1c-4e05-42db-b3d5-691dec6a5d8f service nova] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Received unexpected event network-vif-plugged-0df45a26-6026-4baa-bdaa-a761d2d3c2a6 for instance with vm_state building and task_state spawning.
Aug 14 23:06:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:06:55 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054415.1328354, 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:06:55 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] VM Resumed (Lifecycle Event)
Aug 14 23:06:55 user nova-compute[72766]: DEBUG nova.compute.manager [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:06:55 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 23:06:55 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Instance spawned successfully.
Aug 14 23:06:55 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 23:06:55 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:06:55 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:06:55 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:06:55 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:06:55 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:06:55 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:06:55 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:06:55 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:06:55 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:06:55 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054415.1339855, 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:06:55 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] VM Started (Lifecycle Event)
Aug 14 23:06:55 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:06:55 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:06:55 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:06:55 user nova-compute[72766]: INFO nova.compute.manager [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Took 5.66 seconds to spawn the instance on the hypervisor.
Aug 14 23:06:55 user nova-compute[72766]: DEBUG nova.compute.manager [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:06:55 user nova-compute[72766]: DEBUG nova.compute.manager [req-2db783cd-6dcf-477a-b592-7eee4f976fac req-39419bdc-7946-4576-953e-f388b5307532 service nova] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Received event network-vif-plugged-0df45a26-6026-4baa-bdaa-a761d2d3c2a6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:06:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2db783cd-6dcf-477a-b592-7eee4f976fac req-39419bdc-7946-4576-953e-f388b5307532 service nova] Acquiring lock "99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:06:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2db783cd-6dcf-477a-b592-7eee4f976fac req-39419bdc-7946-4576-953e-f388b5307532 service nova] Lock "99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:06:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2db783cd-6dcf-477a-b592-7eee4f976fac req-39419bdc-7946-4576-953e-f388b5307532 service nova] Lock "99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:06:55 user nova-compute[72766]: DEBUG nova.compute.manager [req-2db783cd-6dcf-477a-b592-7eee4f976fac req-39419bdc-7946-4576-953e-f388b5307532 service nova] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] No waiting events found dispatching network-vif-plugged-0df45a26-6026-4baa-bdaa-a761d2d3c2a6 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:06:55 user nova-compute[72766]: WARNING nova.compute.manager [req-2db783cd-6dcf-477a-b592-7eee4f976fac req-39419bdc-7946-4576-953e-f388b5307532 service nova] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Received unexpected event network-vif-plugged-0df45a26-6026-4baa-bdaa-a761d2d3c2a6 for instance with vm_state building and task_state spawning.
Aug 14 23:06:55 user nova-compute[72766]: INFO nova.compute.manager [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Took 6.39 seconds to build instance.
Aug 14 23:06:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-043fcb1f-868c-40e9-9a7f-5b5c4d9dae0a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.501s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:06:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:06:57 user nova-compute[72766]: INFO nova.compute.manager [None req-aefca7d1-2740-4acb-875e-f2cade12fd9d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Unrescuing
Aug 14 23:06:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-aefca7d1-2740-4acb-875e-f2cade12fd9d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "refresh_cache-83084ccc-8e55-43dc-9a37-ffcb35a10922" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:06:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-aefca7d1-2740-4acb-875e-f2cade12fd9d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquired lock "refresh_cache-83084ccc-8e55-43dc-9a37-ffcb35a10922" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:06:57 user nova-compute[72766]: DEBUG nova.network.neutron [None req-aefca7d1-2740-4acb-875e-f2cade12fd9d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:06:58 user nova-compute[72766]: DEBUG nova.network.neutron [None req-aefca7d1-2740-4acb-875e-f2cade12fd9d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Updating instance_info_cache with network_info: [{"id": "cbbf0086-17e4-41a5-8893-cf8657faf6e5", "address": "fa:16:3e:22:4b:22", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbbf0086-17", "ovs_interfaceid": "cbbf0086-17e4-41a5-8893-cf8657faf6e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:06:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-aefca7d1-2740-4acb-875e-f2cade12fd9d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Releasing lock "refresh_cache-83084ccc-8e55-43dc-9a37-ffcb35a10922" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:06:58 user nova-compute[72766]: DEBUG nova.objects.instance [None req-aefca7d1-2740-4acb-875e-f2cade12fd9d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lazy-loading 'flavor' on Instance uuid 83084ccc-8e55-43dc-9a37-ffcb35a10922 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:06:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:06:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:06:58 user nova-compute[72766]: DEBUG nova.compute.manager [req-43405c18-6cc7-418c-b27a-23bccbe1a830 req-d9e181e0-030c-4cc0-b4d2-2b7cc1a29c17 service nova] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Received event network-vif-unplugged-cbbf0086-17e4-41a5-8893-cf8657faf6e5 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:06:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-43405c18-6cc7-418c-b27a-23bccbe1a830 req-d9e181e0-030c-4cc0-b4d2-2b7cc1a29c17 service nova] Acquiring lock "83084ccc-8e55-43dc-9a37-ffcb35a10922-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:06:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-43405c18-6cc7-418c-b27a-23bccbe1a830 req-d9e181e0-030c-4cc0-b4d2-2b7cc1a29c17 service nova] Lock "83084ccc-8e55-43dc-9a37-ffcb35a10922-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:06:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-43405c18-6cc7-418c-b27a-23bccbe1a830 req-d9e181e0-030c-4cc0-b4d2-2b7cc1a29c17 service nova] Lock "83084ccc-8e55-43dc-9a37-ffcb35a10922-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:06:58 user nova-compute[72766]: DEBUG nova.compute.manager [req-43405c18-6cc7-418c-b27a-23bccbe1a830 req-d9e181e0-030c-4cc0-b4d2-2b7cc1a29c17 service nova] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] No waiting events found dispatching network-vif-unplugged-cbbf0086-17e4-41a5-8893-cf8657faf6e5 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:06:58 user nova-compute[72766]: WARNING nova.compute.manager [req-43405c18-6cc7-418c-b27a-23bccbe1a830 req-d9e181e0-030c-4cc0-b4d2-2b7cc1a29c17 service nova] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Received unexpected event network-vif-unplugged-cbbf0086-17e4-41a5-8893-cf8657faf6e5 for instance with vm_state rescued and task_state unrescuing.
Aug 14 23:06:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:06:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:06:59 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Instance destroyed successfully.
Aug 14 23:07:00 user nova-compute[72766]: DEBUG nova.compute.manager [req-678724cb-7fb3-4f16-932a-6cdb4a3eaf00 req-c2a67a4c-3480-4f28-8961-845bcaa17d0a service nova] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Received event network-vif-plugged-cbbf0086-17e4-41a5-8893-cf8657faf6e5 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:07:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-678724cb-7fb3-4f16-932a-6cdb4a3eaf00 req-c2a67a4c-3480-4f28-8961-845bcaa17d0a service nova] Acquiring lock "83084ccc-8e55-43dc-9a37-ffcb35a10922-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:07:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-678724cb-7fb3-4f16-932a-6cdb4a3eaf00 req-c2a67a4c-3480-4f28-8961-845bcaa17d0a service nova] Lock "83084ccc-8e55-43dc-9a37-ffcb35a10922-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:07:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-678724cb-7fb3-4f16-932a-6cdb4a3eaf00 req-c2a67a4c-3480-4f28-8961-845bcaa17d0a service nova] Lock "83084ccc-8e55-43dc-9a37-ffcb35a10922-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:07:00 user nova-compute[72766]: DEBUG nova.compute.manager [req-678724cb-7fb3-4f16-932a-6cdb4a3eaf00 req-c2a67a4c-3480-4f28-8961-845bcaa17d0a service nova] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] No waiting events found dispatching network-vif-plugged-cbbf0086-17e4-41a5-8893-cf8657faf6e5 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:07:00 user nova-compute[72766]: WARNING nova.compute.manager [req-678724cb-7fb3-4f16-932a-6cdb4a3eaf00 req-c2a67a4c-3480-4f28-8961-845bcaa17d0a service nova] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Received unexpected event network-vif-plugged-cbbf0086-17e4-41a5-8893-cf8657faf6e5 for instance with vm_state rescued and task_state unrescuing.
Aug 14 23:07:00 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:00 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:00 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:00 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:00 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:00 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:02 user nova-compute[72766]: DEBUG nova.compute.manager [req-547c3f13-9be0-4b87-b7c5-6256ab188cb9 req-4decdb3b-70b6-4301-a97c-d3e882e4f268 service nova] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Received event network-vif-plugged-cbbf0086-17e4-41a5-8893-cf8657faf6e5 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:07:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-547c3f13-9be0-4b87-b7c5-6256ab188cb9 req-4decdb3b-70b6-4301-a97c-d3e882e4f268 service nova] Acquiring lock "83084ccc-8e55-43dc-9a37-ffcb35a10922-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:07:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-547c3f13-9be0-4b87-b7c5-6256ab188cb9 req-4decdb3b-70b6-4301-a97c-d3e882e4f268 service nova] Lock "83084ccc-8e55-43dc-9a37-ffcb35a10922-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:07:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-547c3f13-9be0-4b87-b7c5-6256ab188cb9 req-4decdb3b-70b6-4301-a97c-d3e882e4f268 service nova] Lock "83084ccc-8e55-43dc-9a37-ffcb35a10922-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:07:02 user nova-compute[72766]: DEBUG nova.compute.manager [req-547c3f13-9be0-4b87-b7c5-6256ab188cb9 req-4decdb3b-70b6-4301-a97c-d3e882e4f268 service nova] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] No waiting events found dispatching network-vif-plugged-cbbf0086-17e4-41a5-8893-cf8657faf6e5 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:07:02 user nova-compute[72766]: WARNING nova.compute.manager [req-547c3f13-9be0-4b87-b7c5-6256ab188cb9 req-4decdb3b-70b6-4301-a97c-d3e882e4f268 service nova] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Received unexpected event network-vif-plugged-cbbf0086-17e4-41a5-8893-cf8657faf6e5 for instance with vm_state rescued and task_state unrescuing.
Aug 14 23:07:02 user nova-compute[72766]: DEBUG nova.compute.manager [req-547c3f13-9be0-4b87-b7c5-6256ab188cb9 req-4decdb3b-70b6-4301-a97c-d3e882e4f268 service nova] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Received event network-vif-plugged-cbbf0086-17e4-41a5-8893-cf8657faf6e5 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:07:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-547c3f13-9be0-4b87-b7c5-6256ab188cb9 req-4decdb3b-70b6-4301-a97c-d3e882e4f268 service nova] Acquiring lock "83084ccc-8e55-43dc-9a37-ffcb35a10922-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:07:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-547c3f13-9be0-4b87-b7c5-6256ab188cb9 req-4decdb3b-70b6-4301-a97c-d3e882e4f268 service nova] Lock "83084ccc-8e55-43dc-9a37-ffcb35a10922-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:07:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-547c3f13-9be0-4b87-b7c5-6256ab188cb9 req-4decdb3b-70b6-4301-a97c-d3e882e4f268 service nova] Lock "83084ccc-8e55-43dc-9a37-ffcb35a10922-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:07:02 user nova-compute[72766]: DEBUG nova.compute.manager [req-547c3f13-9be0-4b87-b7c5-6256ab188cb9 req-4decdb3b-70b6-4301-a97c-d3e882e4f268 service nova] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] No waiting events found dispatching network-vif-plugged-cbbf0086-17e4-41a5-8893-cf8657faf6e5 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:07:02 user nova-compute[72766]: WARNING nova.compute.manager [req-547c3f13-9be0-4b87-b7c5-6256ab188cb9 req-4decdb3b-70b6-4301-a97c-d3e882e4f268 service nova] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Received unexpected event network-vif-plugged-cbbf0086-17e4-41a5-8893-cf8657faf6e5 for instance with vm_state rescued and task_state unrescuing.
Aug 14 23:07:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Removed pending event for 83084ccc-8e55-43dc-9a37-ffcb35a10922 due to event {{(pid=72766) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 23:07:02 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054422.7708945, 83084ccc-8e55-43dc-9a37-ffcb35a10922 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:07:02 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] VM Resumed (Lifecycle Event)
Aug 14 23:07:02 user nova-compute[72766]: DEBUG nova.compute.manager [None req-aefca7d1-2740-4acb-875e-f2cade12fd9d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:07:02 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:07:02 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:07:02 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 14 23:07:02 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054422.7743816, 83084ccc-8e55-43dc-9a37-ffcb35a10922 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:07:02 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] VM Started (Lifecycle Event)
Aug 14 23:07:02 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:07:02 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:07:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:06 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:07:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:15 user nova-compute[72766]: DEBUG nova.objects.instance [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lazy-loading 'flavor' on Instance uuid 66578337-cbff-4613-87a1-85ddabaebb2d {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:07:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquiring lock "refresh_cache-66578337-cbff-4613-87a1-85ddabaebb2d" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:07:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquired lock "refresh_cache-66578337-cbff-4613-87a1-85ddabaebb2d" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:07:15 user nova-compute[72766]: DEBUG nova.network.neutron [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:07:15 user nova-compute[72766]: DEBUG nova.objects.instance [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lazy-loading 'info_cache' on Instance uuid 66578337-cbff-4613-87a1-85ddabaebb2d {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG nova.network.neutron [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Updating instance_info_cache with network_info: [{"id": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "address": "fa:16:3e:e2:97:1e", "network": {"id": "b375da9b-b613-4a88-a262-962f959597b9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-462508113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1dd09415664f1aa0b0dbdeeb4b8d32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffc1761b-5d", "ovs_interfaceid": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Releasing lock "refresh_cache-66578337-cbff-4613-87a1-85ddabaebb2d" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:07:16 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Instance destroyed successfully.
Aug 14 23:07:16 user nova-compute[72766]: DEBUG nova.objects.instance [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lazy-loading 'resources' on Instance uuid 66578337-cbff-4613-87a1-85ddabaebb2d {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:03:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-217587435',display_name='tempest-AttachVolumeTestJSON-server-217587435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-217587435',id=21,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBINZx5RlQmHKeHXxfdC+NXwuqcWxgRblOsB0YY2uiI6sAZZohfv46zguEF36eLiA7VkgzN1UzneQgr1/yAGU0LFY6JMqRhzyWlR9BBcwz/CmcDywCLsqGwbsFhgR7C+vTQ==',key_name='tempest-keypair-1163729093',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:03:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3b1dd09415664f1aa0b0dbdeeb4b8d32',ramdisk_id='',reservation_id='r-p88w362t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-716158533',owner_user_name='tempest-AttachVolumeTestJSON-716158533-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:05:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a41813929144571a3306300dbf6f485',uuid=66578337-cbff-4613-87a1-85ddabaebb2d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "address": "fa:16:3e:e2:97:1e", "network": {"id": "b375da9b-b613-4a88-a262-962f959597b9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-462508113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1dd09415664f1aa0b0dbdeeb4b8d32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffc1761b-5d", "ovs_interfaceid": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Converting VIF {"id": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "address": "fa:16:3e:e2:97:1e", "network": {"id": "b375da9b-b613-4a88-a262-962f959597b9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-462508113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1dd09415664f1aa0b0dbdeeb4b8d32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffc1761b-5d", "ovs_interfaceid": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:97:1e,bridge_name='br-int',has_traffic_filtering=True,id=ffc1761b-5d95-4c58-9b92-b6b43b4823a6,network=Network(b375da9b-b613-4a88-a262-962f959597b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffc1761b-5d') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG os_vif [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:97:1e,bridge_name='br-int',has_traffic_filtering=True,id=ffc1761b-5d95-4c58-9b92-b6b43b4823a6,network=Network(b375da9b-b613-4a88-a262-962f959597b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffc1761b-5d') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapffc1761b-5d, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:07:16 user nova-compute[72766]: INFO os_vif [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:97:1e,bridge_name='br-int',has_traffic_filtering=True,id=ffc1761b-5d95-4c58-9b92-b6b43b4823a6,network=Network(b375da9b-b613-4a88-a262-962f959597b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffc1761b-5d')
Aug 14 23:07:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'novNFwxY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:07:16 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:07:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fb51a9-5071-4b7b-a385-d86b03a74d61]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[029fdd79-4484-4d14-bf48-27a1459897eb]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:07:16 user nova-compute[72766]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 (non-flash)
Aug 14 23:07:16 user nova-compute[72766]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f (non-flash)
Aug 14 23:07:16 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:07:16 user nova-compute[72766]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 (non-flash)
Aug 14 23:07:16 user nova-compute[72766]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f (non-flash)
Aug 14 23:07:16 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff154341d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93'): ({'sdc'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Removing single pathed devices sdc {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08d7668-dde4-46c2-b630-838f3936bc35]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f06d47-db34-4d2b-8a2d-b5d539f2aaa4]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Flushing IO for device /dev/sdc {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb469f61-e122-4d23-86fc-7cd51224e7df]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0dcec40-8495-4dc8-8561-1d71195bdb92]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] SCSI volumes sdc have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7d4535-f1a2-4a8d-bffd-36963333bb33]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e4e3af-c545-42fe-ae4a-d99eaa6a3123]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93, portal: 172.16.0.220,3260]
Aug 14 23:07:16 user nova-compute[72766]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93, portal: 172.16.0.220,3260] successful.
Aug 14 23:07:16 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[744bb060-2d68-4703-9112-b41e6add627e]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] <== disconnect_volume: return (287ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Start _get_guest_xml network_info=[{"id": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "address": "fa:16:3e:e2:97:1e", "network": {"id": "b375da9b-b613-4a88-a262-962f959597b9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-462508113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1dd09415664f1aa0b0dbdeeb4b8d32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffc1761b-5d", "ovs_interfaceid": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd2900d30-2c4c-4d57-9135-d45564c0c596'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '7a3ebb9e-c627-4416-b31e-ab1c17f67d39', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'novNFwxY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '66578337-cbff-4613-87a1-85ddabaebb2d', 'attached_at': '', 'detached_at': '', 'volume_id': '07f50970-07ad-4c8a-be6f-d49e78dbac93', 'serial': '07f50970-07ad-4c8a-be6f-d49e78dbac93'}, 'volume_type': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG nova.objects.instance [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lazy-loading 'numa_topology' on Instance uuid 66578337-cbff-4613-87a1-85ddabaebb2d {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:07:16 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:07:16 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:07:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG nova.objects.instance [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lazy-loading 'vcpu_model' on Instance uuid 66578337-cbff-4613-87a1-85ddabaebb2d {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'novNFwxY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:07:16 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:07:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:07:16 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:07:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:07:16 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee7c733-d34c-4e14-a9dc-e686345f0f5a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 23:07:16 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6e4982-215c-4dac-b83a-d53d3c8052f3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93] added
Aug 14 23:07:16 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2898da8a-c944-4da9-8a3c-272778f5d09c]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[9635a00a-0945-44c5-95ff-a2dcbe9074b9]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v novNFwxY {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v novNFwxY" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[141924d3-c02e-4bc6-a5f6-995c996ef6f2]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'novNFwxY'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[918b8084-a9b8-40e9-b59f-d7cb0d4aaafb]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c708ff8-7ac9-4be4-9310-6ab837bf924b]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:07:16 user nova-compute[72766]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f (non-flash)
Aug 14 23:07:16 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:07:16 user nova-compute[72766]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f (non-flash)
Aug 14 23:07:16 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[81574b24-b1a3-4253-87a4-7b8b2211c19d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93, portal: 172.16.0.220,3260]
Aug 14 23:07:16 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93, portal: 172.16.0.220,3260] successful.
Aug 14 23:07:16 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[034ae3e0-9301-4d2e-82de-94ec1d1db4f1]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd7b8ad-5554-41c4-86ff-d939fa102c1c]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:07:16 user nova-compute[72766]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f (non-flash)
Aug 14 23:07:16 user nova-compute[72766]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 (non-flash)
Aug 14 23:07:16 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:07:16 user nova-compute[72766]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f (non-flash)
Aug 14 23:07:16 user nova-compute[72766]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 (non-flash)
Aug 14 23:07:16 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b0cd48-2545-4702-89de-c8a8a5879ec6]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:07:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'novNFwxY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 23:07:17 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:07:17 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23565343763303639', 'path': '/dev/sdc'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:07:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565343763303639', 'path': '/dev/sdc'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 23:07:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:03:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-217587435',display_name='tempest-AttachVolumeTestJSON-server-217587435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-217587435',id=21,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBINZx5RlQmHKeHXxfdC+NXwuqcWxgRblOsB0YY2uiI6sAZZohfv46zguEF36eLiA7VkgzN1UzneQgr1/yAGU0LFY6JMqRhzyWlR9BBcwz/CmcDywCLsqGwbsFhgR7C+vTQ==',key_name='tempest-keypair-1163729093',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:03:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3b1dd09415664f1aa0b0dbdeeb4b8d32',ramdisk_id='',reservation_id='r-p88w362t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-716158533',owner_user_name='tempest-AttachVolumeTestJSON-716158533-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:05:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a41813929144571a3306300dbf6f485',uuid=66578337-cbff-4613-87a1-85ddabaebb2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "address": "fa:16:3e:e2:97:1e", "network": {"id": "b375da9b-b613-4a88-a262-962f959597b9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-462508113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1dd09415664f1aa0b0dbdeeb4b8d32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffc1761b-5d", "ovs_interfaceid": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:07:17 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Converting VIF {"id": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "address": "fa:16:3e:e2:97:1e", "network": {"id": "b375da9b-b613-4a88-a262-962f959597b9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-462508113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1dd09415664f1aa0b0dbdeeb4b8d32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffc1761b-5d", "ovs_interfaceid": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:07:17 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:97:1e,bridge_name='br-int',has_traffic_filtering=True,id=ffc1761b-5d95-4c58-9b92-b6b43b4823a6,network=Network(b375da9b-b613-4a88-a262-962f959597b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffc1761b-5d') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:07:17 user nova-compute[72766]: DEBUG nova.objects.instance [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lazy-loading 'pci_devices' on Instance uuid 66578337-cbff-4613-87a1-85ddabaebb2d {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:07:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:07:17 user nova-compute[72766]:   <uuid>66578337-cbff-4613-87a1-85ddabaebb2d</uuid>
Aug 14 23:07:17 user nova-compute[72766]:   <name>instance-00000015</name>
Aug 14 23:07:17 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:07:17 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:07:17 user nova-compute[72766]:   <metadata>
Aug 14 23:07:17 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:07:17 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:07:17 user nova-compute[72766]:       <nova:name>tempest-AttachVolumeTestJSON-server-217587435</nova:name>
Aug 14 23:07:17 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:07:16</nova:creationTime>
Aug 14 23:07:17 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:07:17 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:07:17 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:07:17 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:07:17 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:07:17 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:07:17 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:07:17 user nova-compute[72766]:       <nova:owner>
Aug 14 23:07:17 user nova-compute[72766]:         <nova:user uuid="7a41813929144571a3306300dbf6f485">tempest-AttachVolumeTestJSON-716158533-project-member</nova:user>
Aug 14 23:07:17 user nova-compute[72766]:         <nova:project uuid="3b1dd09415664f1aa0b0dbdeeb4b8d32">tempest-AttachVolumeTestJSON-716158533</nova:project>
Aug 14 23:07:17 user nova-compute[72766]:       </nova:owner>
Aug 14 23:07:17 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 23:07:17 user nova-compute[72766]:       <nova:ports>
Aug 14 23:07:17 user nova-compute[72766]:         <nova:port uuid="ffc1761b-5d95-4c58-9b92-b6b43b4823a6">
Aug 14 23:07:17 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 23:07:17 user nova-compute[72766]:         </nova:port>
Aug 14 23:07:17 user nova-compute[72766]:       </nova:ports>
Aug 14 23:07:17 user nova-compute[72766]:     </nova:instance>
Aug 14 23:07:17 user nova-compute[72766]:   </metadata>
Aug 14 23:07:17 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:07:17 user nova-compute[72766]:     <system>
Aug 14 23:07:17 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:07:17 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:07:17 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:07:17 user nova-compute[72766]:       <entry name="serial">66578337-cbff-4613-87a1-85ddabaebb2d</entry>
Aug 14 23:07:17 user nova-compute[72766]:       <entry name="uuid">66578337-cbff-4613-87a1-85ddabaebb2d</entry>
Aug 14 23:07:17 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:07:17 user nova-compute[72766]:     </system>
Aug 14 23:07:17 user nova-compute[72766]:   </sysinfo>
Aug 14 23:07:17 user nova-compute[72766]:   <os>
Aug 14 23:07:17 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:07:17 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:07:17 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:07:17 user nova-compute[72766]:   </os>
Aug 14 23:07:17 user nova-compute[72766]:   <features>
Aug 14 23:07:17 user nova-compute[72766]:     <acpi/>
Aug 14 23:07:17 user nova-compute[72766]:     <apic/>
Aug 14 23:07:17 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:07:17 user nova-compute[72766]:   </features>
Aug 14 23:07:17 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:07:17 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:07:17 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:07:17 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:07:17 user nova-compute[72766]:   </clock>
Aug 14 23:07:17 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:07:17 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:07:17 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:07:17 user nova-compute[72766]:   </cpu>
Aug 14 23:07:17 user nova-compute[72766]:   <devices>
Aug 14 23:07:17 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 23:07:17 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 23:07:17 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk"/>
Aug 14 23:07:17 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:07:17 user nova-compute[72766]:     </disk>
Aug 14 23:07:17 user nova-compute[72766]:     <disk type="block" device="disk">
Aug 14 23:07:17 user nova-compute[72766]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:07:17 user nova-compute[72766]:       <source dev="/dev/sdc"/>
Aug 14 23:07:17 user nova-compute[72766]:       <target dev="vdb" bus="virtio"/>
Aug 14 23:07:17 user nova-compute[72766]:       <serial>07f50970-07ad-4c8a-be6f-d49e78dbac93</serial>
Aug 14 23:07:17 user nova-compute[72766]:     </disk>
Aug 14 23:07:17 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:07:17 user nova-compute[72766]:       <mac address="fa:16:3e:e2:97:1e"/>
Aug 14 23:07:17 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:07:17 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:07:17 user nova-compute[72766]:       <target dev="tapffc1761b-5d"/>
Aug 14 23:07:17 user nova-compute[72766]:     </interface>
Aug 14 23:07:17 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:07:17 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/console.log" append="off"/>
Aug 14 23:07:17 user nova-compute[72766]:     </serial>
Aug 14 23:07:17 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:07:17 user nova-compute[72766]:     <video>
Aug 14 23:07:17 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:07:17 user nova-compute[72766]:     </video>
Aug 14 23:07:17 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:07:17 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:07:17 user nova-compute[72766]:     </rng>
Aug 14 23:07:17 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:07:17 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:07:17 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:07:17 user nova-compute[72766]:     </memballoon>
Aug 14 23:07:17 user nova-compute[72766]:   </devices>
Aug 14 23:07:17 user nova-compute[72766]: </domain>
Aug 14 23:07:17 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:07:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:18 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:18 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:18 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:18 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:07:18 user nova-compute[72766]: DEBUG nova.objects.instance [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lazy-loading 'trusted_certs' on Instance uuid 66578337-cbff-4613-87a1-85ddabaebb2d {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:07:18 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:18 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.175s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:18 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Checking if we can resize image /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk. size=1073741824 {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 23:07:18 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:18 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:18 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Cannot resize image /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk to a smaller size. {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 23:07:18 user nova-compute[72766]: DEBUG nova.objects.instance [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lazy-loading 'migration_context' on Instance uuid 66578337-cbff-4613-87a1-85ddabaebb2d {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:07:18 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:03:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-217587435',display_name='tempest-AttachVolumeTestJSON-server-217587435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-217587435',id=21,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBINZx5RlQmHKeHXxfdC+NXwuqcWxgRblOsB0YY2uiI6sAZZohfv46zguEF36eLiA7VkgzN1UzneQgr1/yAGU0LFY6JMqRhzyWlR9BBcwz/CmcDywCLsqGwbsFhgR7C+vTQ==',key_name='tempest-keypair-1163729093',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:03:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='3b1dd09415664f1aa0b0dbdeeb4b8d32',ramdisk_id='',reservation_id='r-p88w362t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-716158533',owner_user_name='tempest-AttachVolumeTestJSON-716158533-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:05:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a41813929144571a3306300dbf6f485',uuid=66578337-cbff-4613-87a1-85ddabaebb2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "address": "fa:16:3e:e2:97:1e", "network": {"id": "b375da9b-b613-4a88-a262-962f959597b9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-462508113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1dd09415664f1aa0b0dbdeeb4b8d32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffc1761b-5d", "ovs_interfaceid": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:07:18 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Converting VIF {"id": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "address": "fa:16:3e:e2:97:1e", "network": {"id": "b375da9b-b613-4a88-a262-962f959597b9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-462508113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1dd09415664f1aa0b0dbdeeb4b8d32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffc1761b-5d", "ovs_interfaceid": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:07:18 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:97:1e,bridge_name='br-int',has_traffic_filtering=True,id=ffc1761b-5d95-4c58-9b92-b6b43b4823a6,network=Network(b375da9b-b613-4a88-a262-962f959597b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffc1761b-5d') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:07:18 user nova-compute[72766]: DEBUG os_vif [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:97:1e,bridge_name='br-int',has_traffic_filtering=True,id=ffc1761b-5d95-4c58-9b92-b6b43b4823a6,network=Network(b375da9b-b613-4a88-a262-962f959597b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffc1761b-5d') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:07:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:07:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:07:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapffc1761b-5d, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:07:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapffc1761b-5d, col_values=(('external_ids', {'iface-id': 'ffc1761b-5d95-4c58-9b92-b6b43b4823a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:97:1e', 'vm-uuid': '66578337-cbff-4613-87a1-85ddabaebb2d'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:07:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:07:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:18 user nova-compute[72766]: INFO os_vif [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:97:1e,bridge_name='br-int',has_traffic_filtering=True,id=ffc1761b-5d95-4c58-9b92-b6b43b4823a6,network=Network(b375da9b-b613-4a88-a262-962f959597b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffc1761b-5d')
Aug 14 23:07:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:20 user nova-compute[72766]: DEBUG nova.compute.manager [req-3c8e443f-2845-4f61-83d8-4f5bd16ab8ab req-aae8e139-0cd2-483f-809a-ad2a935a4f7d service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Received event network-vif-plugged-ffc1761b-5d95-4c58-9b92-b6b43b4823a6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:07:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-3c8e443f-2845-4f61-83d8-4f5bd16ab8ab req-aae8e139-0cd2-483f-809a-ad2a935a4f7d service nova] Acquiring lock "66578337-cbff-4613-87a1-85ddabaebb2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:07:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-3c8e443f-2845-4f61-83d8-4f5bd16ab8ab req-aae8e139-0cd2-483f-809a-ad2a935a4f7d service nova] Lock "66578337-cbff-4613-87a1-85ddabaebb2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:07:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-3c8e443f-2845-4f61-83d8-4f5bd16ab8ab req-aae8e139-0cd2-483f-809a-ad2a935a4f7d service nova] Lock "66578337-cbff-4613-87a1-85ddabaebb2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:07:20 user nova-compute[72766]: DEBUG nova.compute.manager [req-3c8e443f-2845-4f61-83d8-4f5bd16ab8ab req-aae8e139-0cd2-483f-809a-ad2a935a4f7d service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] No waiting events found dispatching network-vif-plugged-ffc1761b-5d95-4c58-9b92-b6b43b4823a6 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:07:20 user nova-compute[72766]: WARNING nova.compute.manager [req-3c8e443f-2845-4f61-83d8-4f5bd16ab8ab req-aae8e139-0cd2-483f-809a-ad2a935a4f7d service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Received unexpected event network-vif-plugged-ffc1761b-5d95-4c58-9b92-b6b43b4823a6 for instance with vm_state stopped and task_state powering-on.
Aug 14 23:07:20 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:20 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:20 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:20 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:20 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:22 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054442.1050477, 66578337-cbff-4613-87a1-85ddabaebb2d => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:07:22 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] VM Resumed (Lifecycle Event)
Aug 14 23:07:22 user nova-compute[72766]: DEBUG nova.compute.manager [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:07:22 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Instance rebooted successfully.
Aug 14 23:07:22 user nova-compute[72766]: DEBUG nova.compute.manager [None req-2197c802-5aff-4a23-b920-3d42654ea899 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:07:22 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:07:22 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:07:22 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 14 23:07:22 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054442.1071084, 66578337-cbff-4613-87a1-85ddabaebb2d => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:07:22 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] VM Started (Lifecycle Event)
Aug 14 23:07:22 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:07:22 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:07:22 user nova-compute[72766]: DEBUG nova.compute.manager [req-430d3ee8-a5f9-4340-bfc9-41195779ee3b req-cf32f844-0571-42f0-95c9-3db6fb0c1e07 service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Received event network-vif-plugged-ffc1761b-5d95-4c58-9b92-b6b43b4823a6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:07:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-430d3ee8-a5f9-4340-bfc9-41195779ee3b req-cf32f844-0571-42f0-95c9-3db6fb0c1e07 service nova] Acquiring lock "66578337-cbff-4613-87a1-85ddabaebb2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:07:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-430d3ee8-a5f9-4340-bfc9-41195779ee3b req-cf32f844-0571-42f0-95c9-3db6fb0c1e07 service nova] Lock "66578337-cbff-4613-87a1-85ddabaebb2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:07:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-430d3ee8-a5f9-4340-bfc9-41195779ee3b req-cf32f844-0571-42f0-95c9-3db6fb0c1e07 service nova] Lock "66578337-cbff-4613-87a1-85ddabaebb2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:07:22 user nova-compute[72766]: DEBUG nova.compute.manager [req-430d3ee8-a5f9-4340-bfc9-41195779ee3b req-cf32f844-0571-42f0-95c9-3db6fb0c1e07 service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] No waiting events found dispatching network-vif-plugged-ffc1761b-5d95-4c58-9b92-b6b43b4823a6 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:07:22 user nova-compute[72766]: WARNING nova.compute.manager [req-430d3ee8-a5f9-4340-bfc9-41195779ee3b req-cf32f844-0571-42f0-95c9-3db6fb0c1e07 service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Received unexpected event network-vif-plugged-ffc1761b-5d95-4c58-9b92-b6b43b4823a6 for instance with vm_state active and task_state None.
Aug 14 23:07:23 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:07:23 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:07:23 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-3ff300ff-34fd-4e94-9d2d-681fb133ba32" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:07:23 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-3ff300ff-34fd-4e94-9d2d-681fb133ba32" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:07:23 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:07:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:24 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Updating instance_info_cache with network_info: [{"id": "c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d", "address": "fa:16:3e:67:f9:a0", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46ab9cb-e6", "ovs_interfaceid": "c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:07:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-3ff300ff-34fd-4e94-9d2d-681fb133ba32" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:07:24 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:07:24 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:07:24 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:07:24 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:07:24 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:07:26 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:07:26 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:07:27 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:07:27 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:07:27 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:07:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:07:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:07:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:07:27 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:07:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:07:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:07:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:29 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:07:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13f8f416-9f1d-461c-95e5-fc13ffebdf81/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13f8f416-9f1d-461c-95e5-fc13ffebdf81/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13f8f416-9f1d-461c-95e5-fc13ffebdf81/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13f8f416-9f1d-461c-95e5-fc13ffebdf81/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e358215-4455-4657-8663-1a144f39eb6e/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e358215-4455-4657-8663-1a144f39eb6e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e358215-4455-4657-8663-1a144f39eb6e/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e358215-4455-4657-8663-1a144f39eb6e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:31 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:07:31 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:07:31 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=7853MB free_disk=25.406639099121094GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:07:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:07:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:07:31 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 3ff300ff-34fd-4e94-9d2d-681fb133ba32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:07:31 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance cbcf7851-e6f7-4f46-97cc-d773286ccddf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:07:31 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 66578337-cbff-4613-87a1-85ddabaebb2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:07:31 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 83084ccc-8e55-43dc-9a37-ffcb35a10922 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:07:31 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 78f02883-99a1-493d-b6be-e43500bfba37 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:07:31 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 8e358215-4455-4657-8663-1a144f39eb6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:07:31 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 13f8f416-9f1d-461c-95e5-fc13ffebdf81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:07:31 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:07:31 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:07:31 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:07:31 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:07:31 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:07:31 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:07:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.400s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:07:32 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:07:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:07:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-277851ad-75e6-488e-8d0c-89e17eea440d tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Acquiring lock "8e358215-4455-4657-8663-1a144f39eb6e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:07:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-277851ad-75e6-488e-8d0c-89e17eea440d tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Lock "8e358215-4455-4657-8663-1a144f39eb6e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:07:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-277851ad-75e6-488e-8d0c-89e17eea440d tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Acquiring lock "8e358215-4455-4657-8663-1a144f39eb6e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:07:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-277851ad-75e6-488e-8d0c-89e17eea440d tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Lock "8e358215-4455-4657-8663-1a144f39eb6e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:07:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-277851ad-75e6-488e-8d0c-89e17eea440d tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Lock "8e358215-4455-4657-8663-1a144f39eb6e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:07:38 user nova-compute[72766]: INFO nova.compute.manager [None req-277851ad-75e6-488e-8d0c-89e17eea440d tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Terminating instance
Aug 14 23:07:38 user nova-compute[72766]: DEBUG nova.compute.manager [None req-277851ad-75e6-488e-8d0c-89e17eea440d tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:07:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:39 user nova-compute[72766]: DEBUG nova.compute.manager [req-8743ffe8-1fd0-43f8-af3f-4f508a2c4e8c req-ab555cd1-b4f8-4a2a-9414-0d6f3bd80d07 service nova] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Received event network-vif-unplugged-88d8c4aa-b464-4686-8c2c-d4378e0efa65 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:07:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8743ffe8-1fd0-43f8-af3f-4f508a2c4e8c req-ab555cd1-b4f8-4a2a-9414-0d6f3bd80d07 service nova] Acquiring lock "8e358215-4455-4657-8663-1a144f39eb6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:07:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8743ffe8-1fd0-43f8-af3f-4f508a2c4e8c req-ab555cd1-b4f8-4a2a-9414-0d6f3bd80d07 service nova] Lock "8e358215-4455-4657-8663-1a144f39eb6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:07:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8743ffe8-1fd0-43f8-af3f-4f508a2c4e8c req-ab555cd1-b4f8-4a2a-9414-0d6f3bd80d07 service nova] Lock "8e358215-4455-4657-8663-1a144f39eb6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:07:39 user nova-compute[72766]: DEBUG nova.compute.manager [req-8743ffe8-1fd0-43f8-af3f-4f508a2c4e8c req-ab555cd1-b4f8-4a2a-9414-0d6f3bd80d07 service nova] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] No waiting events found dispatching network-vif-unplugged-88d8c4aa-b464-4686-8c2c-d4378e0efa65 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:07:39 user nova-compute[72766]: DEBUG nova.compute.manager [req-8743ffe8-1fd0-43f8-af3f-4f508a2c4e8c req-ab555cd1-b4f8-4a2a-9414-0d6f3bd80d07 service nova] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Received event network-vif-unplugged-88d8c4aa-b464-4686-8c2c-d4378e0efa65 for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:07:39 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Instance destroyed successfully.
Aug 14 23:07:39 user nova-compute[72766]: DEBUG nova.objects.instance [None req-277851ad-75e6-488e-8d0c-89e17eea440d tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Lazy-loading 'resources' on Instance uuid 8e358215-4455-4657-8663-1a144f39eb6e {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:07:39 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-277851ad-75e6-488e-8d0c-89e17eea440d tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:05:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1545649618',display_name='tempest-VolumesActionsTest-instance-1545649618',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1545649618',id=24,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:05:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83eb682791ee4b4b9d0637f33e1ce2b3',ramdisk_id='',reservation_id='r-x1gtvumj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-562398048',owner_user_name='tempest-VolumesActionsTest-562398048-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:05:59Z,user_data=None,user_id='0f127c1a39bb4606b5299ae048d62890',uuid=8e358215-4455-4657-8663-1a144f39eb6e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "88d8c4aa-b464-4686-8c2c-d4378e0efa65", "address": "fa:16:3e:13:3f:2f", "network": {"id": "ba73a346-5f7e-4749-9757-4965ccb4be6f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-537717022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83eb682791ee4b4b9d0637f33e1ce2b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d8c4aa-b4", "ovs_interfaceid": "88d8c4aa-b464-4686-8c2c-d4378e0efa65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:07:39 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-277851ad-75e6-488e-8d0c-89e17eea440d tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Converting VIF {"id": "88d8c4aa-b464-4686-8c2c-d4378e0efa65", "address": "fa:16:3e:13:3f:2f", "network": {"id": "ba73a346-5f7e-4749-9757-4965ccb4be6f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-537717022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83eb682791ee4b4b9d0637f33e1ce2b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d8c4aa-b4", "ovs_interfaceid": "88d8c4aa-b464-4686-8c2c-d4378e0efa65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:07:39 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-277851ad-75e6-488e-8d0c-89e17eea440d tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:3f:2f,bridge_name='br-int',has_traffic_filtering=True,id=88d8c4aa-b464-4686-8c2c-d4378e0efa65,network=Network(ba73a346-5f7e-4749-9757-4965ccb4be6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88d8c4aa-b4') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:07:39 user nova-compute[72766]: DEBUG os_vif [None req-277851ad-75e6-488e-8d0c-89e17eea440d tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:3f:2f,bridge_name='br-int',has_traffic_filtering=True,id=88d8c4aa-b464-4686-8c2c-d4378e0efa65,network=Network(ba73a346-5f7e-4749-9757-4965ccb4be6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88d8c4aa-b4') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:07:39 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:39 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap88d8c4aa-b4, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:07:39 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:39 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:07:39 user nova-compute[72766]: INFO os_vif [None req-277851ad-75e6-488e-8d0c-89e17eea440d tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:3f:2f,bridge_name='br-int',has_traffic_filtering=True,id=88d8c4aa-b464-4686-8c2c-d4378e0efa65,network=Network(ba73a346-5f7e-4749-9757-4965ccb4be6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88d8c4aa-b4')
Aug 14 23:07:39 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-277851ad-75e6-488e-8d0c-89e17eea440d tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Deleting instance files /opt/stack/data/nova/instances/8e358215-4455-4657-8663-1a144f39eb6e_del
Aug 14 23:07:39 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-277851ad-75e6-488e-8d0c-89e17eea440d tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Deletion of /opt/stack/data/nova/instances/8e358215-4455-4657-8663-1a144f39eb6e_del complete
Aug 14 23:07:39 user nova-compute[72766]: INFO nova.compute.manager [None req-277851ad-75e6-488e-8d0c-89e17eea440d tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Took 0.70 seconds to destroy the instance on the hypervisor.
Aug 14 23:07:39 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-277851ad-75e6-488e-8d0c-89e17eea440d tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:07:39 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:07:39 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:07:39 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:07:39 user nova-compute[72766]: DEBUG nova.compute.manager [req-c1b05156-65f0-4e5a-9398-b385908f6c4b req-1674d6ca-b9c9-435c-af5b-d1b5441c666f service nova] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Received event network-vif-deleted-88d8c4aa-b464-4686-8c2c-d4378e0efa65 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:07:39 user nova-compute[72766]: INFO nova.compute.manager [req-c1b05156-65f0-4e5a-9398-b385908f6c4b req-1674d6ca-b9c9-435c-af5b-d1b5441c666f service nova] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Neutron deleted interface 88d8c4aa-b464-4686-8c2c-d4378e0efa65; detaching it from the instance and deleting it from the info cache
Aug 14 23:07:39 user nova-compute[72766]: DEBUG nova.network.neutron [req-c1b05156-65f0-4e5a-9398-b385908f6c4b req-1674d6ca-b9c9-435c-af5b-d1b5441c666f service nova] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:07:39 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Took 0.50 seconds to deallocate network for instance.
Aug 14 23:07:39 user nova-compute[72766]: DEBUG nova.compute.manager [req-c1b05156-65f0-4e5a-9398-b385908f6c4b req-1674d6ca-b9c9-435c-af5b-d1b5441c666f service nova] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Detach interface failed, port_id=88d8c4aa-b464-4686-8c2c-d4378e0efa65, reason: Instance 8e358215-4455-4657-8663-1a144f39eb6e could not be found. {{(pid=72766) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 23:07:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-277851ad-75e6-488e-8d0c-89e17eea440d tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:07:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-277851ad-75e6-488e-8d0c-89e17eea440d tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:07:40 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-277851ad-75e6-488e-8d0c-89e17eea440d tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:07:40 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-277851ad-75e6-488e-8d0c-89e17eea440d tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:07:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-277851ad-75e6-488e-8d0c-89e17eea440d tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.314s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:07:40 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-277851ad-75e6-488e-8d0c-89e17eea440d tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Deleted allocations for instance 8e358215-4455-4657-8663-1a144f39eb6e
Aug 14 23:07:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-277851ad-75e6-488e-8d0c-89e17eea440d tempest-VolumesActionsTest-562398048 tempest-VolumesActionsTest-562398048-project-member] Lock "8e358215-4455-4657-8663-1a144f39eb6e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.720s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:07:41 user nova-compute[72766]: DEBUG nova.compute.manager [req-fea9baf6-0c76-4228-88b0-b8c6ab3b35c3 req-2524a6bc-0f9e-49dd-8a76-8360bd41b04f service nova] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Received event network-vif-plugged-88d8c4aa-b464-4686-8c2c-d4378e0efa65 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:07:41 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-fea9baf6-0c76-4228-88b0-b8c6ab3b35c3 req-2524a6bc-0f9e-49dd-8a76-8360bd41b04f service nova] Acquiring lock "8e358215-4455-4657-8663-1a144f39eb6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:07:41 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-fea9baf6-0c76-4228-88b0-b8c6ab3b35c3 req-2524a6bc-0f9e-49dd-8a76-8360bd41b04f service nova] Lock "8e358215-4455-4657-8663-1a144f39eb6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:07:41 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-fea9baf6-0c76-4228-88b0-b8c6ab3b35c3 req-2524a6bc-0f9e-49dd-8a76-8360bd41b04f service nova] Lock "8e358215-4455-4657-8663-1a144f39eb6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:07:41 user nova-compute[72766]: DEBUG nova.compute.manager [req-fea9baf6-0c76-4228-88b0-b8c6ab3b35c3 req-2524a6bc-0f9e-49dd-8a76-8360bd41b04f service nova] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] No waiting events found dispatching network-vif-plugged-88d8c4aa-b464-4686-8c2c-d4378e0efa65 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:07:41 user nova-compute[72766]: WARNING nova.compute.manager [req-fea9baf6-0c76-4228-88b0-b8c6ab3b35c3 req-2524a6bc-0f9e-49dd-8a76-8360bd41b04f service nova] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Received unexpected event network-vif-plugged-88d8c4aa-b464-4686-8c2c-d4378e0efa65 for instance with vm_state deleted and task_state None.
Aug 14 23:07:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:44 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquiring lock "11e79581-a122-4c0a-8485-a8b6c62e73b8" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:07:44 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "11e79581-a122-4c0a-8485-a8b6c62e73b8" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:07:44 user nova-compute[72766]: INFO nova.compute.manager [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Unshelving
Aug 14 23:07:44 user nova-compute[72766]: INFO nova.virt.block_device [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Booting with volume a8190fbe-e5c5-4adc-84f5-278ba6384470 at /dev/vdc
Aug 14 23:07:45 user nova-compute[72766]: DEBUG os_brick.utils [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:07:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:45 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[19775c42-6db3-4cc4-a9ef-0b662c4635ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:07:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:45 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93b2ec3-b8e3-433b-bf15-580fb10f2b34]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:07:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:45 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b725e918-aa7c-4618-a695-7c3faeb273c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:07:45 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee0f519-129d-4201-a0bf-2d7c42060862]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:07:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:07:45 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 23:07:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:07:45 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 23:07:45 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d1692e-d932-4982-b694-2b8235b9f58a]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:07:45 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 23:07:45 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 23:07:45 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 23:07:45 user nova-compute[72766]: DEBUG os_brick.utils [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:07:45 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Updating existing volume attachment record: 0d7da4b9-9009-41e2-b8ff-6b8ed5654b67 {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 23:07:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-4c291c6a-5589-4a6b-8377-b06ceb704753 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Acquiring lock "13f8f416-9f1d-461c-95e5-fc13ffebdf81" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:07:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-4c291c6a-5589-4a6b-8377-b06ceb704753 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Lock "13f8f416-9f1d-461c-95e5-fc13ffebdf81" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:07:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-4c291c6a-5589-4a6b-8377-b06ceb704753 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Acquiring lock "13f8f416-9f1d-461c-95e5-fc13ffebdf81-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:07:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-4c291c6a-5589-4a6b-8377-b06ceb704753 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Lock "13f8f416-9f1d-461c-95e5-fc13ffebdf81-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:07:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-4c291c6a-5589-4a6b-8377-b06ceb704753 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Lock "13f8f416-9f1d-461c-95e5-fc13ffebdf81-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:07:53 user nova-compute[72766]: INFO nova.compute.manager [None req-4c291c6a-5589-4a6b-8377-b06ceb704753 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Terminating instance
Aug 14 23:07:53 user nova-compute[72766]: DEBUG nova.compute.manager [None req-4c291c6a-5589-4a6b-8377-b06ceb704753 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:07:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:53 user nova-compute[72766]: DEBUG nova.compute.manager [req-beacd461-23cf-41a2-af9c-bbe512589931 req-b64e5693-cb5f-46ab-9b44-aa5f8e093977 service nova] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Received event network-vif-unplugged-bfd9d907-21ac-4b49-8467-e281025cdb45 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:07:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-beacd461-23cf-41a2-af9c-bbe512589931 req-b64e5693-cb5f-46ab-9b44-aa5f8e093977 service nova] Acquiring lock "13f8f416-9f1d-461c-95e5-fc13ffebdf81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:07:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-beacd461-23cf-41a2-af9c-bbe512589931 req-b64e5693-cb5f-46ab-9b44-aa5f8e093977 service nova] Lock "13f8f416-9f1d-461c-95e5-fc13ffebdf81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:07:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-beacd461-23cf-41a2-af9c-bbe512589931 req-b64e5693-cb5f-46ab-9b44-aa5f8e093977 service nova] Lock "13f8f416-9f1d-461c-95e5-fc13ffebdf81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:07:53 user nova-compute[72766]: DEBUG nova.compute.manager [req-beacd461-23cf-41a2-af9c-bbe512589931 req-b64e5693-cb5f-46ab-9b44-aa5f8e093977 service nova] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] No waiting events found dispatching network-vif-unplugged-bfd9d907-21ac-4b49-8467-e281025cdb45 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:07:53 user nova-compute[72766]: DEBUG nova.compute.manager [req-beacd461-23cf-41a2-af9c-bbe512589931 req-b64e5693-cb5f-46ab-9b44-aa5f8e093977 service nova] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Received event network-vif-unplugged-bfd9d907-21ac-4b49-8467-e281025cdb45 for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:07:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:53 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Instance destroyed successfully.
Aug 14 23:07:53 user nova-compute[72766]: DEBUG nova.objects.instance [None req-4c291c6a-5589-4a6b-8377-b06ceb704753 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Lazy-loading 'resources' on Instance uuid 13f8f416-9f1d-461c-95e5-fc13ffebdf81 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:07:53 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-4c291c6a-5589-4a6b-8377-b06ceb704753 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:05:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-61243865',display_name='tempest-VolumesActionsTest-instance-61243865',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-61243865',id=25,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:05:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='35e195e30a9642f0b0f2af918f03d0a3',ramdisk_id='',reservation_id='r-l9n3u6pb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-786823184',owner_user_name='tempest-VolumesActionsTest-786823184-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:05:59Z,user_data=None,user_id='d92da0d2b7bc4865b04564b3dda15744',uuid=13f8f416-9f1d-461c-95e5-fc13ffebdf81,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bfd9d907-21ac-4b49-8467-e281025cdb45", "address": "fa:16:3e:7b:7c:59", "network": {"id": "f38afcd2-d9b4-427b-a94f-46f2e935370a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-614672131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e195e30a9642f0b0f2af918f03d0a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfd9d907-21", "ovs_interfaceid": "bfd9d907-21ac-4b49-8467-e281025cdb45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:07:53 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-4c291c6a-5589-4a6b-8377-b06ceb704753 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Converting VIF {"id": "bfd9d907-21ac-4b49-8467-e281025cdb45", "address": "fa:16:3e:7b:7c:59", "network": {"id": "f38afcd2-d9b4-427b-a94f-46f2e935370a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-614672131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35e195e30a9642f0b0f2af918f03d0a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfd9d907-21", "ovs_interfaceid": "bfd9d907-21ac-4b49-8467-e281025cdb45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:07:53 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-4c291c6a-5589-4a6b-8377-b06ceb704753 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:7c:59,bridge_name='br-int',has_traffic_filtering=True,id=bfd9d907-21ac-4b49-8467-e281025cdb45,network=Network(f38afcd2-d9b4-427b-a94f-46f2e935370a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfd9d907-21') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:07:53 user nova-compute[72766]: DEBUG os_vif [None req-4c291c6a-5589-4a6b-8377-b06ceb704753 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:7c:59,bridge_name='br-int',has_traffic_filtering=True,id=bfd9d907-21ac-4b49-8467-e281025cdb45,network=Network(f38afcd2-d9b4-427b-a94f-46f2e935370a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfd9d907-21') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:07:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbfd9d907-21, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:07:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:07:53 user nova-compute[72766]: INFO os_vif [None req-4c291c6a-5589-4a6b-8377-b06ceb704753 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:7c:59,bridge_name='br-int',has_traffic_filtering=True,id=bfd9d907-21ac-4b49-8467-e281025cdb45,network=Network(f38afcd2-d9b4-427b-a94f-46f2e935370a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfd9d907-21')
Aug 14 23:07:53 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-4c291c6a-5589-4a6b-8377-b06ceb704753 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Deleting instance files /opt/stack/data/nova/instances/13f8f416-9f1d-461c-95e5-fc13ffebdf81_del
Aug 14 23:07:53 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-4c291c6a-5589-4a6b-8377-b06ceb704753 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Deletion of /opt/stack/data/nova/instances/13f8f416-9f1d-461c-95e5-fc13ffebdf81_del complete
Aug 14 23:07:53 user nova-compute[72766]: INFO nova.compute.manager [None req-4c291c6a-5589-4a6b-8377-b06ceb704753 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Took 0.69 seconds to destroy the instance on the hypervisor.
Aug 14 23:07:53 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-4c291c6a-5589-4a6b-8377-b06ceb704753 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:07:53 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:07:53 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:07:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:54 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692054459.3327498, 8e358215-4455-4657-8663-1a144f39eb6e => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:07:54 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] VM Stopped (Lifecycle Event)
Aug 14 23:07:54 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:07:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-9c0170a4-4fe7-45db-ad27-f9997bef00ec None None] [instance: 8e358215-4455-4657-8663-1a144f39eb6e] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:07:54 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Took 0.49 seconds to deallocate network for instance.
Aug 14 23:07:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-4c291c6a-5589-4a6b-8377-b06ceb704753 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:07:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-4c291c6a-5589-4a6b-8377-b06ceb704753 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:07:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:07:54 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-4c291c6a-5589-4a6b-8377-b06ceb704753 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:07:54 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-4c291c6a-5589-4a6b-8377-b06ceb704753 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:07:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-4c291c6a-5589-4a6b-8377-b06ceb704753 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.313s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:07:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.116s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:07:54 user nova-compute[72766]: DEBUG nova.objects.instance [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lazy-loading 'pci_requests' on Instance uuid 11e79581-a122-4c0a-8485-a8b6c62e73b8 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:07:54 user nova-compute[72766]: DEBUG nova.objects.instance [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lazy-loading 'numa_topology' on Instance uuid 11e79581-a122-4c0a-8485-a8b6c62e73b8 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:07:54 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-4c291c6a-5589-4a6b-8377-b06ceb704753 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Deleted allocations for instance 13f8f416-9f1d-461c-95e5-fc13ffebdf81
Aug 14 23:07:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 23:07:54 user nova-compute[72766]: INFO nova.compute.claims [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Claim successful on node user
Aug 14 23:07:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-4c291c6a-5589-4a6b-8377-b06ceb704753 tempest-VolumesActionsTest-786823184 tempest-VolumesActionsTest-786823184-project-member] Lock "13f8f416-9f1d-461c-95e5-fc13ffebdf81" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.685s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:07:55 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:07:55 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:07:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.374s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:07:55 user nova-compute[72766]: INFO nova.network.neutron [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Updating port 0add7ef0-687d-4486-842d-2d07c0d26449 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 14 23:07:55 user nova-compute[72766]: DEBUG nova.compute.manager [req-832e7f15-ccc4-4583-935f-162ada199a4e req-257c29c2-be92-47f5-8962-709b17746676 service nova] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Received event network-vif-plugged-bfd9d907-21ac-4b49-8467-e281025cdb45 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:07:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-832e7f15-ccc4-4583-935f-162ada199a4e req-257c29c2-be92-47f5-8962-709b17746676 service nova] Acquiring lock "13f8f416-9f1d-461c-95e5-fc13ffebdf81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:07:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-832e7f15-ccc4-4583-935f-162ada199a4e req-257c29c2-be92-47f5-8962-709b17746676 service nova] Lock "13f8f416-9f1d-461c-95e5-fc13ffebdf81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:07:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-832e7f15-ccc4-4583-935f-162ada199a4e req-257c29c2-be92-47f5-8962-709b17746676 service nova] Lock "13f8f416-9f1d-461c-95e5-fc13ffebdf81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:07:55 user nova-compute[72766]: DEBUG nova.compute.manager [req-832e7f15-ccc4-4583-935f-162ada199a4e req-257c29c2-be92-47f5-8962-709b17746676 service nova] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] No waiting events found dispatching network-vif-plugged-bfd9d907-21ac-4b49-8467-e281025cdb45 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:07:55 user nova-compute[72766]: WARNING nova.compute.manager [req-832e7f15-ccc4-4583-935f-162ada199a4e req-257c29c2-be92-47f5-8962-709b17746676 service nova] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Received unexpected event network-vif-plugged-bfd9d907-21ac-4b49-8467-e281025cdb45 for instance with vm_state deleted and task_state None.
Aug 14 23:07:55 user nova-compute[72766]: DEBUG nova.compute.manager [req-832e7f15-ccc4-4583-935f-162ada199a4e req-257c29c2-be92-47f5-8962-709b17746676 service nova] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Received event network-vif-deleted-bfd9d907-21ac-4b49-8467-e281025cdb45 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:07:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquiring lock "refresh_cache-11e79581-a122-4c0a-8485-a8b6c62e73b8" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:07:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquired lock "refresh_cache-11e79581-a122-4c0a-8485-a8b6c62e73b8" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:07:56 user nova-compute[72766]: DEBUG nova.network.neutron [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:07:56 user nova-compute[72766]: DEBUG nova.network.neutron [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Updating instance_info_cache with network_info: [{"id": "0add7ef0-687d-4486-842d-2d07c0d26449", "address": "fa:16:3e:4a:df:6f", "network": {"id": "ed86b27c-3e64-4c0a-8824-9bf68068058a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-506861998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f36bd126bda43c6971bccdef2b1da91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0add7ef0-68", "ovs_interfaceid": "0add7ef0-687d-4486-842d-2d07c0d26449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:07:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Releasing lock "refresh_cache-11e79581-a122-4c0a-8485-a8b6c62e73b8" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:07:56 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 23:07:56 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Creating image(s)
Aug 14 23:07:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquiring lock "/opt/stack/data/nova/instances/11e79581-a122-4c0a-8485-a8b6c62e73b8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:07:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "/opt/stack/data/nova/instances/11e79581-a122-4c0a-8485-a8b6c62e73b8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:07:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "/opt/stack/data/nova/instances/11e79581-a122-4c0a-8485-a8b6c62e73b8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:07:56 user nova-compute[72766]: DEBUG nova.objects.instance [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lazy-loading 'trusted_certs' on Instance uuid 11e79581-a122-4c0a-8485-a8b6c62e73b8 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:07:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquiring lock "ee793a981ba5b499918b07506c55fad45d583c03" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:07:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "ee793a981ba5b499918b07506c55fad45d583c03" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:07:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee793a981ba5b499918b07506c55fad45d583c03.part --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:57 user nova-compute[72766]: DEBUG nova.compute.manager [req-33b0dc60-4396-4802-a0fa-53cb4cdae818 req-7f74463a-2285-4f68-a0e7-c90ea112574d service nova] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Received event network-changed-0add7ef0-687d-4486-842d-2d07c0d26449 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:07:57 user nova-compute[72766]: DEBUG nova.compute.manager [req-33b0dc60-4396-4802-a0fa-53cb4cdae818 req-7f74463a-2285-4f68-a0e7-c90ea112574d service nova] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Refreshing instance network info cache due to event network-changed-0add7ef0-687d-4486-842d-2d07c0d26449. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:07:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-33b0dc60-4396-4802-a0fa-53cb4cdae818 req-7f74463a-2285-4f68-a0e7-c90ea112574d service nova] Acquiring lock "refresh_cache-11e79581-a122-4c0a-8485-a8b6c62e73b8" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:07:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-33b0dc60-4396-4802-a0fa-53cb4cdae818 req-7f74463a-2285-4f68-a0e7-c90ea112574d service nova] Acquired lock "refresh_cache-11e79581-a122-4c0a-8485-a8b6c62e73b8" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:07:57 user nova-compute[72766]: DEBUG nova.network.neutron [req-33b0dc60-4396-4802-a0fa-53cb4cdae818 req-7f74463a-2285-4f68-a0e7-c90ea112574d service nova] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Refreshing network info cache for port 0add7ef0-687d-4486-842d-2d07c0d26449 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:07:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee793a981ba5b499918b07506c55fad45d583c03.part --force-share --output=json" returned: 0 in 0.181s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:57 user nova-compute[72766]: DEBUG nova.virt.images [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] a2627ebd-1630-4023-a8f3-daf19b0de6c8 was qcow2, converting to raw {{(pid=72766) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 23:07:57 user nova-compute[72766]: DEBUG nova.privsep.utils [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72766) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 23:07:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ee793a981ba5b499918b07506c55fad45d583c03.part /opt/stack/data/nova/instances/_base/ee793a981ba5b499918b07506c55fad45d583c03.converted {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ee793a981ba5b499918b07506c55fad45d583c03.part /opt/stack/data/nova/instances/_base/ee793a981ba5b499918b07506c55fad45d583c03.converted" returned: 0 in 0.386s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee793a981ba5b499918b07506c55fad45d583c03.converted --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:58 user nova-compute[72766]: DEBUG nova.network.neutron [req-33b0dc60-4396-4802-a0fa-53cb4cdae818 req-7f74463a-2285-4f68-a0e7-c90ea112574d service nova] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Updated VIF entry in instance network info cache for port 0add7ef0-687d-4486-842d-2d07c0d26449. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:07:58 user nova-compute[72766]: DEBUG nova.network.neutron [req-33b0dc60-4396-4802-a0fa-53cb4cdae818 req-7f74463a-2285-4f68-a0e7-c90ea112574d service nova] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Updating instance_info_cache with network_info: [{"id": "0add7ef0-687d-4486-842d-2d07c0d26449", "address": "fa:16:3e:4a:df:6f", "network": {"id": "ed86b27c-3e64-4c0a-8824-9bf68068058a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-506861998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f36bd126bda43c6971bccdef2b1da91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0add7ef0-68", "ovs_interfaceid": "0add7ef0-687d-4486-842d-2d07c0d26449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:07:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-33b0dc60-4396-4802-a0fa-53cb4cdae818 req-7f74463a-2285-4f68-a0e7-c90ea112574d service nova] Releasing lock "refresh_cache-11e79581-a122-4c0a-8485-a8b6c62e73b8" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:07:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee793a981ba5b499918b07506c55fad45d583c03.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "ee793a981ba5b499918b07506c55fad45d583c03" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.933s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:07:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee793a981ba5b499918b07506c55fad45d583c03 --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee793a981ba5b499918b07506c55fad45d583c03 --force-share --output=json" returned: 0 in 0.169s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquiring lock "ee793a981ba5b499918b07506c55fad45d583c03" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:07:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "ee793a981ba5b499918b07506c55fad45d583c03" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:07:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee793a981ba5b499918b07506c55fad45d583c03 --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:07:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee793a981ba5b499918b07506c55fad45d583c03 --force-share --output=json" returned: 0 in 0.169s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ee793a981ba5b499918b07506c55fad45d583c03,backing_fmt=raw /opt/stack/data/nova/instances/11e79581-a122-4c0a-8485-a8b6c62e73b8/disk 1073741824 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ee793a981ba5b499918b07506c55fad45d583c03,backing_fmt=raw /opt/stack/data/nova/instances/11e79581-a122-4c0a-8485-a8b6c62e73b8/disk 1073741824" returned: 0 in 0.051s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "ee793a981ba5b499918b07506c55fad45d583c03" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:07:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee793a981ba5b499918b07506c55fad45d583c03 --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee793a981ba5b499918b07506c55fad45d583c03 --force-share --output=json" returned: 0 in 0.168s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:59 user nova-compute[72766]: DEBUG nova.objects.instance [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lazy-loading 'migration_context' on Instance uuid 11e79581-a122-4c0a-8485-a8b6c62e73b8 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:07:59 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Rebasing disk image.
Aug 14 23:07:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:07:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.183s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:07:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb -F raw /opt/stack/data/nova/instances/11e79581-a122-4c0a-8485-a8b6c62e73b8/disk {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb -F raw /opt/stack/data/nova/instances/11e79581-a122-4c0a-8485-a8b6c62e73b8/disk" returned: 0 in 2.022s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Ensure instance console log exists: /opt/stack/data/nova/instances/11e79581-a122-4c0a-8485-a8b6c62e73b8/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Start _get_guest_xml network_info=[{"id": "0add7ef0-687d-4486-842d-2d07c0d26449", "address": "fa:16:3e:4a:df:6f", "network": {"id": "ed86b27c-3e64-4c0a-8824-9bf68068058a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-506861998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f36bd126bda43c6971bccdef2b1da91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0add7ef0-68", "ovs_interfaceid": "0add7ef0-687d-4486-842d-2d07c0d26449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='89122569a1e9f2a6e247d97e3f51cd19',container_format='bare',created_at=2023-08-14T23:05:52Z,direct_url=<?>,disk_format='qcow2',id=a2627ebd-1630-4023-a8f3-daf19b0de6c8,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-584854465-shelved',owner='3f36bd126bda43c6971bccdef2b1da91',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-14T23:05:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd2900d30-2c4c-4d57-9135-d45564c0c596'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '0d7da4b9-9009-41e2-b8ff-6b8ed5654b67', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vJSGAqym', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '11e79581-a122-4c0a-8485-a8b6c62e73b8', 'attached_at': '', 'detached_at': '', 'volume_id': 'a8190fbe-e5c5-4adc-84f5-278ba6384470', 'serial': 'a8190fbe-e5c5-4adc-84f5-278ba6384470'}, 'volume_type': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:08:01 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:08:01 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:08:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='89122569a1e9f2a6e247d97e3f51cd19',container_format='bare',created_at=2023-08-14T23:05:52Z,direct_url=<?>,disk_format='qcow2',id=a2627ebd-1630-4023-a8f3-daf19b0de6c8,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-584854465-shelved',owner='3f36bd126bda43c6971bccdef2b1da91',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-14T23:05:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG nova.objects.instance [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lazy-loading 'vcpu_model' on Instance uuid 11e79581-a122-4c0a-8485-a8b6c62e73b8 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vJSGAqym', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:08:01 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:08:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:08:01 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:08:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:08:01 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 23:08:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67efebc-8037-4ed4-95b6-681bdb2ded5c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 23:08:01 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef625ee-a26a-4cf9-ac20-f4b771a8380d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470] added
Aug 14 23:08:01 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[004ea98c-a0d0-41f0-a1da-24bb5d40f674]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8423993c-f097-4d13-b515-bd98e61ee0e6]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vJSGAqym {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vJSGAqym" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf30ee5-6b9e-4feb-ab22-f02824cb5eab]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vJSGAqym'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[124ca3a4-5522-47d4-9c21-fa08bb415271]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[6141caa7-110d-4289-946b-f5f235ee4217]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:08:01 user nova-compute[72766]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f (non-flash)
Aug 14 23:08:01 user nova-compute[72766]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 (non-flash)
Aug 14 23:08:01 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:08:01 user nova-compute[72766]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f (non-flash)
Aug 14 23:08:01 user nova-compute[72766]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 (non-flash)
Aug 14 23:08:01 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd08435-2cdd-4d16-b395-604776184b3b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470, portal: 172.16.0.220,3260]
Aug 14 23:08:01 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470, portal: 172.16.0.220,3260] successful.
Aug 14 23:08:01 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96f3dbd-4430-4ebe-9e0b-1cdf597c8272]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[037994e7-d7c9-4284-a9fd-e618eb196c78]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:08:01 user nova-compute[72766]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f (non-flash)
Aug 14 23:08:01 user nova-compute[72766]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 (non-flash)
Aug 14 23:08:01 user nova-compute[72766]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 (non-flash)
Aug 14 23:08:01 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:08:01 user nova-compute[72766]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f (non-flash)
Aug 14 23:08:01 user nova-compute[72766]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 (non-flash)
Aug 14 23:08:01 user nova-compute[72766]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 (non-flash)
Aug 14 23:08:01 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.032s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f088267-f996-436f-a07b-0fd1befcaba8]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:01 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: None {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:08:02 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:08:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vJSGAqym', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 23:08:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:08:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23763393862363235', 'path': '/dev/sdd'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:08:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763393862363235', 'path': '/dev/sdd'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 23:08:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T23:03:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-584854465',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-584854465',id=23,image_ref='a2627ebd-1630-4023-a8f3-daf19b0de6c8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1485779782',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:04:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3f36bd126bda43c6971bccdef2b1da91',ramdisk_id='',reservation_id='r-6wg52w6r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1828708750',owner_user_name='tempest-AttachVolumeShelveTestJSON-1828708750-project-member',shelved_at='2023-08-14T23:05:56.310512',shelved_host='user',shelved_image_id='a2627ebd-1630-4023-a8f3-daf19b0de6c8'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:07:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb167893135e4073928a60630ae7720c',uuid=11e79581-a122-4c0a-8485-a8b6c62e73b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0add7ef0-687d-4486-842d-2d07c0d26449", "address": "fa:16:3e:4a:df:6f", "network": {"id": "ed86b27c-3e64-4c0a-8824-9bf68068058a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-506861998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f36bd126bda43c6971bccdef2b1da91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0add7ef0-68", "ovs_interfaceid": "0add7ef0-687d-4486-842d-2d07c0d26449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:08:02 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Converting VIF {"id": "0add7ef0-687d-4486-842d-2d07c0d26449", "address": "fa:16:3e:4a:df:6f", "network": {"id": "ed86b27c-3e64-4c0a-8824-9bf68068058a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-506861998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f36bd126bda43c6971bccdef2b1da91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0add7ef0-68", "ovs_interfaceid": "0add7ef0-687d-4486-842d-2d07c0d26449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:08:02 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:df:6f,bridge_name='br-int',has_traffic_filtering=True,id=0add7ef0-687d-4486-842d-2d07c0d26449,network=Network(ed86b27c-3e64-4c0a-8824-9bf68068058a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0add7ef0-68') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:08:02 user nova-compute[72766]: DEBUG nova.objects.instance [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lazy-loading 'pci_devices' on Instance uuid 11e79581-a122-4c0a-8485-a8b6c62e73b8 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:08:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:08:02 user nova-compute[72766]:   <uuid>11e79581-a122-4c0a-8485-a8b6c62e73b8</uuid>
Aug 14 23:08:02 user nova-compute[72766]:   <name>instance-00000017</name>
Aug 14 23:08:02 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:08:02 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:08:02 user nova-compute[72766]:   <metadata>
Aug 14 23:08:02 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:08:02 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:08:02 user nova-compute[72766]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-584854465</nova:name>
Aug 14 23:08:02 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:08:01</nova:creationTime>
Aug 14 23:08:02 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:08:02 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:08:02 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:08:02 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:08:02 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:08:02 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:08:02 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:08:02 user nova-compute[72766]:       <nova:owner>
Aug 14 23:08:02 user nova-compute[72766]:         <nova:user uuid="fb167893135e4073928a60630ae7720c">tempest-AttachVolumeShelveTestJSON-1828708750-project-member</nova:user>
Aug 14 23:08:02 user nova-compute[72766]:         <nova:project uuid="3f36bd126bda43c6971bccdef2b1da91">tempest-AttachVolumeShelveTestJSON-1828708750</nova:project>
Aug 14 23:08:02 user nova-compute[72766]:       </nova:owner>
Aug 14 23:08:02 user nova-compute[72766]:       <nova:root type="image" uuid="a2627ebd-1630-4023-a8f3-daf19b0de6c8"/>
Aug 14 23:08:02 user nova-compute[72766]:       <nova:ports>
Aug 14 23:08:02 user nova-compute[72766]:         <nova:port uuid="0add7ef0-687d-4486-842d-2d07c0d26449">
Aug 14 23:08:02 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 23:08:02 user nova-compute[72766]:         </nova:port>
Aug 14 23:08:02 user nova-compute[72766]:       </nova:ports>
Aug 14 23:08:02 user nova-compute[72766]:     </nova:instance>
Aug 14 23:08:02 user nova-compute[72766]:   </metadata>
Aug 14 23:08:02 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:08:02 user nova-compute[72766]:     <system>
Aug 14 23:08:02 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:08:02 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:08:02 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:08:02 user nova-compute[72766]:       <entry name="serial">11e79581-a122-4c0a-8485-a8b6c62e73b8</entry>
Aug 14 23:08:02 user nova-compute[72766]:       <entry name="uuid">11e79581-a122-4c0a-8485-a8b6c62e73b8</entry>
Aug 14 23:08:02 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:08:02 user nova-compute[72766]:     </system>
Aug 14 23:08:02 user nova-compute[72766]:   </sysinfo>
Aug 14 23:08:02 user nova-compute[72766]:   <os>
Aug 14 23:08:02 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:08:02 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:08:02 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:08:02 user nova-compute[72766]:   </os>
Aug 14 23:08:02 user nova-compute[72766]:   <features>
Aug 14 23:08:02 user nova-compute[72766]:     <acpi/>
Aug 14 23:08:02 user nova-compute[72766]:     <apic/>
Aug 14 23:08:02 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:08:02 user nova-compute[72766]:   </features>
Aug 14 23:08:02 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:08:02 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:08:02 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:08:02 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:08:02 user nova-compute[72766]:   </clock>
Aug 14 23:08:02 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:08:02 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:08:02 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:08:02 user nova-compute[72766]:   </cpu>
Aug 14 23:08:02 user nova-compute[72766]:   <devices>
Aug 14 23:08:02 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 23:08:02 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 23:08:02 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/11e79581-a122-4c0a-8485-a8b6c62e73b8/disk"/>
Aug 14 23:08:02 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:08:02 user nova-compute[72766]:     </disk>
Aug 14 23:08:02 user nova-compute[72766]:     <disk type="block" device="disk">
Aug 14 23:08:02 user nova-compute[72766]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:08:02 user nova-compute[72766]:       <source dev="/dev/sdd"/>
Aug 14 23:08:02 user nova-compute[72766]:       <target dev="vdc" bus="virtio"/>
Aug 14 23:08:02 user nova-compute[72766]:       <serial>a8190fbe-e5c5-4adc-84f5-278ba6384470</serial>
Aug 14 23:08:02 user nova-compute[72766]:     </disk>
Aug 14 23:08:02 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:08:02 user nova-compute[72766]:       <mac address="fa:16:3e:4a:df:6f"/>
Aug 14 23:08:02 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:08:02 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:08:02 user nova-compute[72766]:       <target dev="tap0add7ef0-68"/>
Aug 14 23:08:02 user nova-compute[72766]:     </interface>
Aug 14 23:08:02 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:08:02 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/11e79581-a122-4c0a-8485-a8b6c62e73b8/console.log" append="off"/>
Aug 14 23:08:02 user nova-compute[72766]:     </serial>
Aug 14 23:08:02 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:08:02 user nova-compute[72766]:     <video>
Aug 14 23:08:02 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:08:02 user nova-compute[72766]:     </video>
Aug 14 23:08:02 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:08:02 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:08:02 user nova-compute[72766]:     </rng>
Aug 14 23:08:02 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:08:02 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:08:02 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:08:02 user nova-compute[72766]:     </memballoon>
Aug 14 23:08:02 user nova-compute[72766]:   </devices>
Aug 14 23:08:02 user nova-compute[72766]: </domain>
Aug 14 23:08:02 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:08:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T23:03:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-584854465',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-584854465',id=23,image_ref='a2627ebd-1630-4023-a8f3-daf19b0de6c8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1485779782',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:04:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3f36bd126bda43c6971bccdef2b1da91',ramdisk_id='',reservation_id='r-6wg52w6r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1828708750',owner_user_name='tempest-AttachVolumeShelveTestJSON-1828708750-project-member',shelved_at='2023-08-14T23:05:56.310512',shelved_host='user',shelved_image_id='a2627ebd-1630-4023-a8f3-daf19b0de6c8'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:07:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb167893135e4073928a60630ae7720c',uuid=11e79581-a122-4c0a-8485-a8b6c62e73b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0add7ef0-687d-4486-842d-2d07c0d26449", "address": "fa:16:3e:4a:df:6f", "network": {"id": "ed86b27c-3e64-4c0a-8824-9bf68068058a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-506861998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f36bd126bda43c6971bccdef2b1da91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0add7ef0-68", "ovs_interfaceid": "0add7ef0-687d-4486-842d-2d07c0d26449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:08:02 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Converting VIF {"id": "0add7ef0-687d-4486-842d-2d07c0d26449", "address": "fa:16:3e:4a:df:6f", "network": {"id": "ed86b27c-3e64-4c0a-8824-9bf68068058a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-506861998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f36bd126bda43c6971bccdef2b1da91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0add7ef0-68", "ovs_interfaceid": "0add7ef0-687d-4486-842d-2d07c0d26449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:08:02 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:df:6f,bridge_name='br-int',has_traffic_filtering=True,id=0add7ef0-687d-4486-842d-2d07c0d26449,network=Network(ed86b27c-3e64-4c0a-8824-9bf68068058a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0add7ef0-68') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:08:02 user nova-compute[72766]: DEBUG os_vif [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:df:6f,bridge_name='br-int',has_traffic_filtering=True,id=0add7ef0-687d-4486-842d-2d07c0d26449,network=Network(ed86b27c-3e64-4c0a-8824-9bf68068058a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0add7ef0-68') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:08:02 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:02 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:08:02 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:08:02 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:02 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0add7ef0-68, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:08:02 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0add7ef0-68, col_values=(('external_ids', {'iface-id': '0add7ef0-687d-4486-842d-2d07c0d26449', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:df:6f', 'vm-uuid': '11e79581-a122-4c0a-8485-a8b6c62e73b8'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:08:02 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:02 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:08:02 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:02 user nova-compute[72766]: INFO os_vif [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:df:6f,bridge_name='br-int',has_traffic_filtering=True,id=0add7ef0-687d-4486-842d-2d07c0d26449,network=Network(ed86b27c-3e64-4c0a-8824-9bf68068058a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0add7ef0-68')
Aug 14 23:08:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:08:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:08:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] No VIF found with MAC fa:16:3e:4a:df:6f, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:08:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:04 user nova-compute[72766]: DEBUG nova.compute.manager [req-6c2a1436-aaf4-4ee5-971c-2e3327e1af3e req-9b43d3d6-cef8-486c-adea-838adace9191 service nova] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Received event network-vif-plugged-0add7ef0-687d-4486-842d-2d07c0d26449 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:08:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-6c2a1436-aaf4-4ee5-971c-2e3327e1af3e req-9b43d3d6-cef8-486c-adea-838adace9191 service nova] Acquiring lock "11e79581-a122-4c0a-8485-a8b6c62e73b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:08:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-6c2a1436-aaf4-4ee5-971c-2e3327e1af3e req-9b43d3d6-cef8-486c-adea-838adace9191 service nova] Lock "11e79581-a122-4c0a-8485-a8b6c62e73b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:08:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-6c2a1436-aaf4-4ee5-971c-2e3327e1af3e req-9b43d3d6-cef8-486c-adea-838adace9191 service nova] Lock "11e79581-a122-4c0a-8485-a8b6c62e73b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:08:04 user nova-compute[72766]: DEBUG nova.compute.manager [req-6c2a1436-aaf4-4ee5-971c-2e3327e1af3e req-9b43d3d6-cef8-486c-adea-838adace9191 service nova] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] No waiting events found dispatching network-vif-plugged-0add7ef0-687d-4486-842d-2d07c0d26449 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:08:04 user nova-compute[72766]: WARNING nova.compute.manager [req-6c2a1436-aaf4-4ee5-971c-2e3327e1af3e req-9b43d3d6-cef8-486c-adea-838adace9191 service nova] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Received unexpected event network-vif-plugged-0add7ef0-687d-4486-842d-2d07c0d26449 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 14 23:08:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:05 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:06 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054486.6280234, 11e79581-a122-4c0a-8485-a8b6c62e73b8 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:08:06 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] VM Resumed (Lifecycle Event)
Aug 14 23:08:06 user nova-compute[72766]: DEBUG nova.compute.manager [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:08:06 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 23:08:06 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Instance spawned successfully.
Aug 14 23:08:06 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:08:06 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:08:06 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:08:06 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054486.6318343, 11e79581-a122-4c0a-8485-a8b6c62e73b8 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:08:06 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] VM Started (Lifecycle Event)
Aug 14 23:08:06 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:08:06 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:08:06 user nova-compute[72766]: DEBUG nova.compute.manager [req-4fb8ba43-3739-4d86-9ebd-cb0e9934bd18 req-9eab2ee6-01f8-4cda-8a89-bbe64f750f3a service nova] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Received event network-vif-plugged-0add7ef0-687d-4486-842d-2d07c0d26449 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:08:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-4fb8ba43-3739-4d86-9ebd-cb0e9934bd18 req-9eab2ee6-01f8-4cda-8a89-bbe64f750f3a service nova] Acquiring lock "11e79581-a122-4c0a-8485-a8b6c62e73b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:08:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-4fb8ba43-3739-4d86-9ebd-cb0e9934bd18 req-9eab2ee6-01f8-4cda-8a89-bbe64f750f3a service nova] Lock "11e79581-a122-4c0a-8485-a8b6c62e73b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:08:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-4fb8ba43-3739-4d86-9ebd-cb0e9934bd18 req-9eab2ee6-01f8-4cda-8a89-bbe64f750f3a service nova] Lock "11e79581-a122-4c0a-8485-a8b6c62e73b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:08:06 user nova-compute[72766]: DEBUG nova.compute.manager [req-4fb8ba43-3739-4d86-9ebd-cb0e9934bd18 req-9eab2ee6-01f8-4cda-8a89-bbe64f750f3a service nova] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] No waiting events found dispatching network-vif-plugged-0add7ef0-687d-4486-842d-2d07c0d26449 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:08:06 user nova-compute[72766]: WARNING nova.compute.manager [req-4fb8ba43-3739-4d86-9ebd-cb0e9934bd18 req-9eab2ee6-01f8-4cda-8a89-bbe64f750f3a service nova] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Received unexpected event network-vif-plugged-0add7ef0-687d-4486-842d-2d07c0d26449 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 14 23:08:06 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:08:06 user nova-compute[72766]: DEBUG nova.compute.manager [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:08:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a0000958-c1aa-475e-808a-957b2ba1da09 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "11e79581-a122-4c0a-8485-a8b6c62e73b8" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 22.505s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:08:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:08 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692054473.7707052, 13f8f416-9f1d-461c-95e5-fc13ffebdf81 => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:08:08 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] VM Stopped (Lifecycle Event)
Aug 14 23:08:08 user nova-compute[72766]: DEBUG nova.compute.manager [None req-ee54b06e-f281-4a63-a3f7-fd88c99b35d1 None None] [instance: 13f8f416-9f1d-461c-95e5-fc13ffebdf81] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:08:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:12 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:17 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:08:17 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:17 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:08:17 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:08:17 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:08:17 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:21 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:08:21 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:08:21 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-cbcf7851-e6f7-4f46-97cc-d773286ccddf" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:08:21 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-cbcf7851-e6f7-4f46-97cc-d773286ccddf" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:08:21 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:08:22 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Updating instance_info_cache with network_info: [{"id": "8f65f8f0-60fe-4fdb-af66-424a85b12caf", "address": "fa:16:3e:70:30:66", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f65f8f0-60", "ovs_interfaceid": "8f65f8f0-60fe-4fdb-af66-424a85b12caf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:08:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-cbcf7851-e6f7-4f46-97cc-d773286ccddf" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:08:22 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:08:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:08:23 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:08:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:24 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:08:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Acquiring lock "78f02883-99a1-493d-b6be-e43500bfba37" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:08:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "78f02883-99a1-493d-b6be-e43500bfba37" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:08:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Acquiring lock "78f02883-99a1-493d-b6be-e43500bfba37-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:08:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "78f02883-99a1-493d-b6be-e43500bfba37-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:08:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "78f02883-99a1-493d-b6be-e43500bfba37-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:08:25 user nova-compute[72766]: INFO nova.compute.manager [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Terminating instance
Aug 14 23:08:25 user nova-compute[72766]: DEBUG nova.compute.manager [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:08:25 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:25 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:25 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:25 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:25 user nova-compute[72766]: DEBUG nova.compute.manager [req-e4a6aa9f-9ee2-460b-bbf3-84fabe884a64 req-a96f538e-b29c-4541-a968-43cc7eac5e73 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Received event network-vif-unplugged-8e7e311b-453d-4e17-9652-45723c7a2944 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:08:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e4a6aa9f-9ee2-460b-bbf3-84fabe884a64 req-a96f538e-b29c-4541-a968-43cc7eac5e73 service nova] Acquiring lock "78f02883-99a1-493d-b6be-e43500bfba37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:08:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e4a6aa9f-9ee2-460b-bbf3-84fabe884a64 req-a96f538e-b29c-4541-a968-43cc7eac5e73 service nova] Lock "78f02883-99a1-493d-b6be-e43500bfba37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:08:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e4a6aa9f-9ee2-460b-bbf3-84fabe884a64 req-a96f538e-b29c-4541-a968-43cc7eac5e73 service nova] Lock "78f02883-99a1-493d-b6be-e43500bfba37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:08:25 user nova-compute[72766]: DEBUG nova.compute.manager [req-e4a6aa9f-9ee2-460b-bbf3-84fabe884a64 req-a96f538e-b29c-4541-a968-43cc7eac5e73 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] No waiting events found dispatching network-vif-unplugged-8e7e311b-453d-4e17-9652-45723c7a2944 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:08:25 user nova-compute[72766]: DEBUG nova.compute.manager [req-e4a6aa9f-9ee2-460b-bbf3-84fabe884a64 req-a96f538e-b29c-4541-a968-43cc7eac5e73 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Received event network-vif-unplugged-8e7e311b-453d-4e17-9652-45723c7a2944 for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:08:25 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:08:25 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Instance destroyed successfully.
Aug 14 23:08:25 user nova-compute[72766]: DEBUG nova.objects.instance [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lazy-loading 'resources' on Instance uuid 78f02883-99a1-493d-b6be-e43500bfba37 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:08:25 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T22:59:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1272916435',display_name='tempest-ServerActionsTestOtherB-server-1272916435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1272916435',id=16,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsHL/Ov683ewfS5a6Ilb918RzZcGPjg2jcHmAa4FSbUUXkwfiZz6KofKWkKrLkhgLEqXzZXHVc5OIPNVj5SeE4gBrIjsJUy7rj9111gEojmIZrrW+x2JI01+TKIPNtdRQ==',key_name='tempest-keypair-2053681781',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:05:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ff897ef00ec45258b22d76ca60447fe',ramdisk_id='',reservation_id='r-vhmch78j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-930559363',owner_user_name='tempest-ServerActionsTestOtherB-930559363-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:05:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7bcae26ae5d406196128c0ce83d3413',uuid=78f02883-99a1-493d-b6be-e43500bfba37,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e7e311b-453d-4e17-9652-45723c7a2944", "address": "fa:16:3e:7e:31:c1", "network": {"id": "c07935db-7a05-49df-a504-682549f30d55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-765423768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ff897ef00ec45258b22d76ca60447fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e7e311b-45", "ovs_interfaceid": "8e7e311b-453d-4e17-9652-45723c7a2944", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:08:25 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Converting VIF {"id": "8e7e311b-453d-4e17-9652-45723c7a2944", "address": "fa:16:3e:7e:31:c1", "network": {"id": "c07935db-7a05-49df-a504-682549f30d55", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-765423768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ff897ef00ec45258b22d76ca60447fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e7e311b-45", "ovs_interfaceid": "8e7e311b-453d-4e17-9652-45723c7a2944", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:08:25 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:31:c1,bridge_name='br-int',has_traffic_filtering=True,id=8e7e311b-453d-4e17-9652-45723c7a2944,network=Network(c07935db-7a05-49df-a504-682549f30d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e7e311b-45') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:08:25 user nova-compute[72766]: DEBUG os_vif [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:31:c1,bridge_name='br-int',has_traffic_filtering=True,id=8e7e311b-453d-4e17-9652-45723c7a2944,network=Network(c07935db-7a05-49df-a504-682549f30d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e7e311b-45') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:08:25 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:25 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e7e311b-45, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:08:25 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:25 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:08:25 user nova-compute[72766]: INFO os_vif [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:31:c1,bridge_name='br-int',has_traffic_filtering=True,id=8e7e311b-453d-4e17-9652-45723c7a2944,network=Network(c07935db-7a05-49df-a504-682549f30d55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e7e311b-45')
Aug 14 23:08:25 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:08:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eRHNEWri', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:08:25 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:08:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:08:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:08:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:08:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:25 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[908fd2d3-4416-4b8e-8941-e5a3c131b46f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:26 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c19cc76-50f5-4637-86f2-ce1dc9632a72]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:08:26 user nova-compute[72766]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f (non-flash)
Aug 14 23:08:26 user nova-compute[72766]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 (non-flash)
Aug 14 23:08:26 user nova-compute[72766]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 (non-flash)
Aug 14 23:08:26 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:08:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:08:26 user nova-compute[72766]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f (non-flash)
Aug 14 23:08:26 user nova-compute[72766]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 (non-flash)
Aug 14 23:08:26 user nova-compute[72766]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 (non-flash)
Aug 14 23:08:26 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:08:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff16c13b7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f'): ({'sdb'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:08:26 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Removing single pathed devices sdb {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:08:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:26 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3edab7e-53f8-4910-a0e2-82040ffc7857]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:26 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[6051a4bc-35b4-44c0-8dbf-ed1c0ccd5a29]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:26 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Flushing IO for device /dev/sdb {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:08:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:26 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[34eab130-f808-48bf-9ae6-b068383e170e]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:26 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:08:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:26 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7dbbda2-a9ea-4053-a04e-3178f6c25f7d]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:26 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:08:26 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] SCSI volumes sdb have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:08:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:08:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:26 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9a54ab-a9da-4c47-af5f-e7788c6baaaa]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:08:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:26 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee24e4d-f419-4b34-9a9c-ffb559935083]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f, portal: 172.16.0.220,3260]
Aug 14 23:08:26 user nova-compute[72766]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f, portal: 172.16.0.220,3260] successful.
Aug 14 23:08:26 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:08:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bd5c9c9-9903-4af6-adf9-ce81d9b3c55f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:26 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[3387791d-83aa-4799-99f0-9df364c296f4]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:08:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:08:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] <== disconnect_volume: return (278ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:08:26 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:08:26 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Deleting instance files /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37_del
Aug 14 23:08:26 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Deletion of /opt/stack/data/nova/instances/78f02883-99a1-493d-b6be-e43500bfba37_del complete
Aug 14 23:08:26 user nova-compute[72766]: INFO nova.compute.manager [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Took 1.23 seconds to destroy the instance on the hypervisor.
Aug 14 23:08:26 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:08:26 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:08:26 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:08:26 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:08:27 user nova-compute[72766]: DEBUG nova.compute.manager [req-b96eeb99-59fa-4369-a4a1-91176588b2d6 req-d0dab2be-546e-45d4-b1ca-80c2d62721b4 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Received event network-vif-plugged-8e7e311b-453d-4e17-9652-45723c7a2944 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:08:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-b96eeb99-59fa-4369-a4a1-91176588b2d6 req-d0dab2be-546e-45d4-b1ca-80c2d62721b4 service nova] Acquiring lock "78f02883-99a1-493d-b6be-e43500bfba37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:08:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-b96eeb99-59fa-4369-a4a1-91176588b2d6 req-d0dab2be-546e-45d4-b1ca-80c2d62721b4 service nova] Lock "78f02883-99a1-493d-b6be-e43500bfba37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:08:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-b96eeb99-59fa-4369-a4a1-91176588b2d6 req-d0dab2be-546e-45d4-b1ca-80c2d62721b4 service nova] Lock "78f02883-99a1-493d-b6be-e43500bfba37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:08:27 user nova-compute[72766]: DEBUG nova.compute.manager [req-b96eeb99-59fa-4369-a4a1-91176588b2d6 req-d0dab2be-546e-45d4-b1ca-80c2d62721b4 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] No waiting events found dispatching network-vif-plugged-8e7e311b-453d-4e17-9652-45723c7a2944 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:08:27 user nova-compute[72766]: WARNING nova.compute.manager [req-b96eeb99-59fa-4369-a4a1-91176588b2d6 req-d0dab2be-546e-45d4-b1ca-80c2d62721b4 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Received unexpected event network-vif-plugged-8e7e311b-453d-4e17-9652-45723c7a2944 for instance with vm_state active and task_state deleting.
Aug 14 23:08:27 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:08:27 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Took 1.24 seconds to deallocate network for instance.
Aug 14 23:08:27 user nova-compute[72766]: DEBUG nova.compute.manager [req-e6b68820-81ee-4f67-910c-8f751e52846e req-b52c2b5c-b387-46da-8b59-d71e960b09d5 service nova] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Received event network-vif-deleted-8e7e311b-453d-4e17-9652-45723c7a2944 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:08:27 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:08:27 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:08:27 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:08:27 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:08:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:08:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:08:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:08:27 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:08:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e79581-a122-4c0a-8485-a8b6c62e73b8/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:28 user nova-compute[72766]: INFO nova.compute.manager [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Took 0.79 seconds to detach 1 volumes for instance.
Aug 14 23:08:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e79581-a122-4c0a-8485-a8b6c62e73b8/disk --force-share --output=json" returned: 0 in 0.560s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e79581-a122-4c0a-8485-a8b6c62e73b8/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:08:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:08:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e79581-a122-4c0a-8485-a8b6c62e73b8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:08:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:08:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:28 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:08:28 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:08:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.282s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:08:28 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Deleted allocations for instance 78f02883-99a1-493d-b6be-e43500bfba37
Aug 14 23:08:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7e87db61-31df-4526-b3a2-bb826133fee3 tempest-ServerActionsTestOtherB-930559363 tempest-ServerActionsTestOtherB-930559363-project-member] Lock "78f02883-99a1-493d-b6be-e43500bfba37" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.776s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:08:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:29 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:08:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:30 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:08:30 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:08:30 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=7986MB free_disk=25.45480728149414GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:08:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:08:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:08:30 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 3ff300ff-34fd-4e94-9d2d-681fb133ba32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:08:30 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance cbcf7851-e6f7-4f46-97cc-d773286ccddf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:08:30 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 66578337-cbff-4613-87a1-85ddabaebb2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:08:30 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 83084ccc-8e55-43dc-9a37-ffcb35a10922 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:08:30 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:08:30 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 11e79581-a122-4c0a-8485-a8b6c62e73b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:08:30 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:08:30 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:08:30 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:08:30 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:08:30 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:08:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.423s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:08:30 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:32 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:08:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:40 user nova-compute[72766]: DEBUG nova.compute.manager [req-d2004c52-3a2c-4803-a9d8-e8c7c01e30ed req-028a3c26-bdc8-4985-a540-6ec71d472be8 service nova] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Received event network-changed-0df45a26-6026-4baa-bdaa-a761d2d3c2a6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:08:40 user nova-compute[72766]: DEBUG nova.compute.manager [req-d2004c52-3a2c-4803-a9d8-e8c7c01e30ed req-028a3c26-bdc8-4985-a540-6ec71d472be8 service nova] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Refreshing instance network info cache due to event network-changed-0df45a26-6026-4baa-bdaa-a761d2d3c2a6. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:08:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d2004c52-3a2c-4803-a9d8-e8c7c01e30ed req-028a3c26-bdc8-4985-a540-6ec71d472be8 service nova] Acquiring lock "refresh_cache-99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:08:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d2004c52-3a2c-4803-a9d8-e8c7c01e30ed req-028a3c26-bdc8-4985-a540-6ec71d472be8 service nova] Acquired lock "refresh_cache-99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:08:40 user nova-compute[72766]: DEBUG nova.network.neutron [req-d2004c52-3a2c-4803-a9d8-e8c7c01e30ed req-028a3c26-bdc8-4985-a540-6ec71d472be8 service nova] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Refreshing network info cache for port 0df45a26-6026-4baa-bdaa-a761d2d3c2a6 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:08:40 user nova-compute[72766]: DEBUG nova.network.neutron [req-d2004c52-3a2c-4803-a9d8-e8c7c01e30ed req-028a3c26-bdc8-4985-a540-6ec71d472be8 service nova] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Updated VIF entry in instance network info cache for port 0df45a26-6026-4baa-bdaa-a761d2d3c2a6. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:08:40 user nova-compute[72766]: DEBUG nova.network.neutron [req-d2004c52-3a2c-4803-a9d8-e8c7c01e30ed req-028a3c26-bdc8-4985-a540-6ec71d472be8 service nova] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Updating instance_info_cache with network_info: [{"id": "0df45a26-6026-4baa-bdaa-a761d2d3c2a6", "address": "fa:16:3e:89:96:a5", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0df45a26-60", "ovs_interfaceid": "0df45a26-6026-4baa-bdaa-a761d2d3c2a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:08:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d2004c52-3a2c-4803-a9d8-e8c7c01e30ed req-028a3c26-bdc8-4985-a540-6ec71d472be8 service nova] Releasing lock "refresh_cache-99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:08:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:08:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:08:40 user nova-compute[72766]: DEBUG nova.objects.instance [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lazy-loading 'flavor' on Instance uuid 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:08:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:08:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:08:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:08:40 user nova-compute[72766]: INFO nova.compute.manager [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Attaching volume ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 to /dev/vdb
Aug 14 23:08:40 user nova-compute[72766]: DEBUG os_brick.utils [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:08:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:40 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a84615-0f93-47c7-9365-9f4e7abd5cff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:40 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[49dfde18-6a68-4bbc-89f1-c7da93cf05a0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:40 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[449003e9-9eed-4fc6-b705-cf34f3dba89e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:40 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[35409cde-80b3-47c8-8d79-ea5dd113cc5b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:08:40 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 23:08:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:08:40 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 23:08:40 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[268cd270-96f2-42ef-9a59-f2dcea85cc80]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:40 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 23:08:40 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 23:08:40 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 23:08:40 user nova-compute[72766]: DEBUG os_brick.utils [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:08:40 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Updating existing volume attachment record: 3d272611-8d4a-4a9d-ae75-0b05abfb4a2a {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 23:08:40 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692054505.9027598, 78f02883-99a1-493d-b6be-e43500bfba37 => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:08:40 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] VM Stopped (Lifecycle Event)
Aug 14 23:08:40 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:41 user nova-compute[72766]: DEBUG nova.compute.manager [None req-dfe06dd0-ee1c-496b-9219-8aba5c6d615c None None] [instance: 78f02883-99a1-493d-b6be-e43500bfba37] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:08:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "71970b47-b09b-4492-9d99-a2be8b3b2042" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:08:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "71970b47-b09b-4492-9d99-a2be8b3b2042" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:08:50 user nova-compute[72766]: DEBUG nova.compute.manager [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 23:08:51 user nova-compute[72766]: INFO nova.compute.claims [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Claim successful on node user
Aug 14 23:08:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UefzbqZF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:08:51 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:08:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:08:51 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:08:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:08:51 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 23:08:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfceb07-5eaf-4a55-afd8-d3d58c7c56f2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 23:08:51 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[7207d81b-bdea-413a-a351-445bd87e6e8a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1] added
Aug 14 23:08:51 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[69290c83-eaab-452e-9c47-82202bf7abd9]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba81b972-0bd1-4043-9a34-bc6019f87971]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UefzbqZF {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UefzbqZF" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1cc63b-1e71-4da6-8cfc-1eeece7f9fad]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UefzbqZF'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45f37d4-b299-42c7-b32f-71b4f5d9a94a]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd992fe-78a0-4051-985e-b5ef5274ce8f]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d9a252-b5d1-49c5-a03e-b826e2cb2a8e (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:08:51 user nova-compute[72766]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 (non-flash)
Aug 14 23:08:51 user nova-compute[72766]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 (non-flash)
Aug 14 23:08:51 user nova-compute[72766]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d9a252-b5d1-49c5-a03e-b826e2cb2a8e (non-flash)
Aug 14 23:08:51 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:08:51 user nova-compute[72766]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 (non-flash)
Aug 14 23:08:51 user nova-compute[72766]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 (non-flash)
Aug 14 23:08:51 user nova-compute[72766]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d9a252-b5d1-49c5-a03e-b826e2cb2a8e (non-flash)
Aug 14 23:08:51 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[492c1096-2d5f-480d-81c8-790c47d4f4c0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1, portal: 172.16.0.220,3260]
Aug 14 23:08:51 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1, portal: 172.16.0.220,3260] successful.
Aug 14 23:08:51 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f8ae33-e70d-408b-9964-9ee0d1f1d4cd]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85e0efa-a6d4-42e2-a61a-1a9e90a2fb7c]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d9a252-b5d1-49c5-a03e-b826e2cb2a8e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:08:51 user nova-compute[72766]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 (non-flash)
Aug 14 23:08:51 user nova-compute[72766]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 (non-flash)
Aug 14 23:08:51 user nova-compute[72766]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d9a252-b5d1-49c5-a03e-b826e2cb2a8e (non-flash)
Aug 14 23:08:51 user nova-compute[72766]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 (non-flash)
Aug 14 23:08:51 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:08:51 user nova-compute[72766]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 (non-flash)
Aug 14 23:08:51 user nova-compute[72766]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 (non-flash)
Aug 14 23:08:51 user nova-compute[72766]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d9a252-b5d1-49c5-a03e-b826e2cb2a8e (non-flash)
Aug 14 23:08:51 user nova-compute[72766]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 (non-flash)
Aug 14 23:08:51 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.399s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG nova.compute.manager [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.026s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c376dd76-6d1a-491e-bd5a-305ee13cd89f]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UefzbqZF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG nova.compute.manager [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG nova.network.neutron [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 23:08:51 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 23:08:51 user nova-compute[72766]: DEBUG nova.compute.manager [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG nova.policy [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '32e61321c50d4af28adeab72811a3f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3725c4b1cd78403f9628c8af9f8e5cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG nova.compute.manager [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 23:08:51 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Creating image(s)
Aug 14 23:08:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "/opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "/opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "/opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:08:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.261s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:08:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:08:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.218s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk 1073741824 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk 1073741824" returned: 0 in 0.056s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:08:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:52 user nova-compute[72766]: DEBUG nova.network.neutron [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Successfully created port: aa623ac3-2e29-46fc-aa95-d6e6e2404758 {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 23:08:52 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:08:52 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '23337363366366665', 'path': '/dev/sde'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:08:52 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337363366366665', 'path': '/dev/sde'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 23:08:52 user nova-compute[72766]: DEBUG nova.objects.instance [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lazy-loading 'flavor' on Instance uuid 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:08:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.188s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:52 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Checking if we can resize image /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk. size=1073741824 {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 23:08:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:52 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 23:08:52 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:08:52 user nova-compute[72766]:   <source dev="/dev/sde"/>
Aug 14 23:08:52 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:08:52 user nova-compute[72766]:   <serial>ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1</serial>
Aug 14 23:08:52 user nova-compute[72766]: </disk>
Aug 14 23:08:52 user nova-compute[72766]:  {{(pid=72766) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 23:08:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:52 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Cannot resize image /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk to a smaller size. {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 23:08:52 user nova-compute[72766]: DEBUG nova.objects.instance [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lazy-loading 'migration_context' on Instance uuid 71970b47-b09b-4492-9d99-a2be8b3b2042 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:08:52 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 23:08:52 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Ensure instance console log exists: /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 23:08:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:08:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:08:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:08:53 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:08:53 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:08:53 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] No VIF found with MAC fa:16:3e:89:96:a5, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:08:53 user nova-compute[72766]: DEBUG nova.network.neutron [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Successfully updated port: aa623ac3-2e29-46fc-aa95-d6e6e2404758 {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 23:08:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "refresh_cache-71970b47-b09b-4492-9d99-a2be8b3b2042" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:08:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquired lock "refresh_cache-71970b47-b09b-4492-9d99-a2be8b3b2042" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:08:53 user nova-compute[72766]: DEBUG nova.network.neutron [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:08:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-210298f2-d424-4d93-b535-8e6064463d4a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.901s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:08:53 user nova-compute[72766]: DEBUG nova.compute.manager [req-b69b4d1b-b3c0-42f8-a04a-f82357ba613d req-b64561c1-63dc-408b-84dc-d439f2cc9fd3 service nova] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Received event network-changed-aa623ac3-2e29-46fc-aa95-d6e6e2404758 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:08:53 user nova-compute[72766]: DEBUG nova.compute.manager [req-b69b4d1b-b3c0-42f8-a04a-f82357ba613d req-b64561c1-63dc-408b-84dc-d439f2cc9fd3 service nova] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Refreshing instance network info cache due to event network-changed-aa623ac3-2e29-46fc-aa95-d6e6e2404758. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:08:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-b69b4d1b-b3c0-42f8-a04a-f82357ba613d req-b64561c1-63dc-408b-84dc-d439f2cc9fd3 service nova] Acquiring lock "refresh_cache-71970b47-b09b-4492-9d99-a2be8b3b2042" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:08:53 user nova-compute[72766]: DEBUG nova.network.neutron [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 23:08:53 user nova-compute[72766]: DEBUG nova.network.neutron [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Updating instance_info_cache with network_info: [{"id": "aa623ac3-2e29-46fc-aa95-d6e6e2404758", "address": "fa:16:3e:3b:e1:a4", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa623ac3-2e", "ovs_interfaceid": "aa623ac3-2e29-46fc-aa95-d6e6e2404758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Releasing lock "refresh_cache-71970b47-b09b-4492-9d99-a2be8b3b2042" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Instance network_info: |[{"id": "aa623ac3-2e29-46fc-aa95-d6e6e2404758", "address": "fa:16:3e:3b:e1:a4", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa623ac3-2e", "ovs_interfaceid": "aa623ac3-2e29-46fc-aa95-d6e6e2404758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-b69b4d1b-b3c0-42f8-a04a-f82357ba613d req-b64561c1-63dc-408b-84dc-d439f2cc9fd3 service nova] Acquired lock "refresh_cache-71970b47-b09b-4492-9d99-a2be8b3b2042" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG nova.network.neutron [req-b69b4d1b-b3c0-42f8-a04a-f82357ba613d req-b64561c1-63dc-408b-84dc-d439f2cc9fd3 service nova] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Refreshing network info cache for port aa623ac3-2e29-46fc-aa95-d6e6e2404758 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Start _get_guest_xml network_info=[{"id": "aa623ac3-2e29-46fc-aa95-d6e6e2404758", "address": "fa:16:3e:3b:e1:a4", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa623ac3-2e", "ovs_interfaceid": "aa623ac3-2e29-46fc-aa95-d6e6e2404758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd2900d30-2c4c-4d57-9135-d45564c0c596'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:08:54 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:08:54 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:08:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:08:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1355436982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1355436982',id=27,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3725c4b1cd78403f9628c8af9f8e5cc5',ramdisk_id='',reservation_id='r-6wxiswgq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-86235447',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:08:52Z,user_data=None,user_id='32e61321c50d4af28adeab72811a3f86',uuid=71970b47-b09b-4492-9d99-a2be8b3b2042,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa623ac3-2e29-46fc-aa95-d6e6e2404758", "address": "fa:16:3e:3b:e1:a4", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa623ac3-2e", "ovs_interfaceid": "aa623ac3-2e29-46fc-aa95-d6e6e2404758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Converting VIF {"id": "aa623ac3-2e29-46fc-aa95-d6e6e2404758", "address": "fa:16:3e:3b:e1:a4", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa623ac3-2e", "ovs_interfaceid": "aa623ac3-2e29-46fc-aa95-d6e6e2404758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:e1:a4,bridge_name='br-int',has_traffic_filtering=True,id=aa623ac3-2e29-46fc-aa95-d6e6e2404758,network=Network(f4efdeee-d89b-45e5-b0d9-b45573564e9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa623ac3-2e') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG nova.objects.instance [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lazy-loading 'pci_devices' on Instance uuid 71970b47-b09b-4492-9d99-a2be8b3b2042 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:08:54 user nova-compute[72766]:   <uuid>71970b47-b09b-4492-9d99-a2be8b3b2042</uuid>
Aug 14 23:08:54 user nova-compute[72766]:   <name>instance-0000001b</name>
Aug 14 23:08:54 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:08:54 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:08:54 user nova-compute[72766]:   <metadata>
Aug 14 23:08:54 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:08:54 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:08:54 user nova-compute[72766]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1355436982</nova:name>
Aug 14 23:08:54 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:08:54</nova:creationTime>
Aug 14 23:08:54 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:08:54 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:08:54 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:08:54 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:08:54 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:08:54 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:08:54 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:08:54 user nova-compute[72766]:       <nova:owner>
Aug 14 23:08:54 user nova-compute[72766]:         <nova:user uuid="32e61321c50d4af28adeab72811a3f86">tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member</nova:user>
Aug 14 23:08:54 user nova-compute[72766]:         <nova:project uuid="3725c4b1cd78403f9628c8af9f8e5cc5">tempest-ServerBootFromVolumeStableRescueTest-86235447</nova:project>
Aug 14 23:08:54 user nova-compute[72766]:       </nova:owner>
Aug 14 23:08:54 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 23:08:54 user nova-compute[72766]:       <nova:ports>
Aug 14 23:08:54 user nova-compute[72766]:         <nova:port uuid="aa623ac3-2e29-46fc-aa95-d6e6e2404758">
Aug 14 23:08:54 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 14 23:08:54 user nova-compute[72766]:         </nova:port>
Aug 14 23:08:54 user nova-compute[72766]:       </nova:ports>
Aug 14 23:08:54 user nova-compute[72766]:     </nova:instance>
Aug 14 23:08:54 user nova-compute[72766]:   </metadata>
Aug 14 23:08:54 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:08:54 user nova-compute[72766]:     <system>
Aug 14 23:08:54 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:08:54 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:08:54 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:08:54 user nova-compute[72766]:       <entry name="serial">71970b47-b09b-4492-9d99-a2be8b3b2042</entry>
Aug 14 23:08:54 user nova-compute[72766]:       <entry name="uuid">71970b47-b09b-4492-9d99-a2be8b3b2042</entry>
Aug 14 23:08:54 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:08:54 user nova-compute[72766]:     </system>
Aug 14 23:08:54 user nova-compute[72766]:   </sysinfo>
Aug 14 23:08:54 user nova-compute[72766]:   <os>
Aug 14 23:08:54 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:08:54 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:08:54 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:08:54 user nova-compute[72766]:   </os>
Aug 14 23:08:54 user nova-compute[72766]:   <features>
Aug 14 23:08:54 user nova-compute[72766]:     <acpi/>
Aug 14 23:08:54 user nova-compute[72766]:     <apic/>
Aug 14 23:08:54 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:08:54 user nova-compute[72766]:   </features>
Aug 14 23:08:54 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:08:54 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:08:54 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:08:54 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:08:54 user nova-compute[72766]:   </clock>
Aug 14 23:08:54 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:08:54 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:08:54 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:08:54 user nova-compute[72766]:   </cpu>
Aug 14 23:08:54 user nova-compute[72766]:   <devices>
Aug 14 23:08:54 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 23:08:54 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 23:08:54 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk"/>
Aug 14 23:08:54 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:08:54 user nova-compute[72766]:     </disk>
Aug 14 23:08:54 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:08:54 user nova-compute[72766]:       <mac address="fa:16:3e:3b:e1:a4"/>
Aug 14 23:08:54 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:08:54 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:08:54 user nova-compute[72766]:       <target dev="tapaa623ac3-2e"/>
Aug 14 23:08:54 user nova-compute[72766]:     </interface>
Aug 14 23:08:54 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:08:54 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/console.log" append="off"/>
Aug 14 23:08:54 user nova-compute[72766]:     </serial>
Aug 14 23:08:54 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:08:54 user nova-compute[72766]:     <video>
Aug 14 23:08:54 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:08:54 user nova-compute[72766]:     </video>
Aug 14 23:08:54 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:08:54 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:08:54 user nova-compute[72766]:     </rng>
Aug 14 23:08:54 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:08:54 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:08:54 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:08:54 user nova-compute[72766]:     </memballoon>
Aug 14 23:08:54 user nova-compute[72766]:   </devices>
Aug 14 23:08:54 user nova-compute[72766]: </domain>
Aug 14 23:08:54 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:08:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1355436982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1355436982',id=27,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3725c4b1cd78403f9628c8af9f8e5cc5',ramdisk_id='',reservation_id='r-6wxiswgq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-86235447',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:08:52Z,user_data=None,user_id='32e61321c50d4af28adeab72811a3f86',uuid=71970b47-b09b-4492-9d99-a2be8b3b2042,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa623ac3-2e29-46fc-aa95-d6e6e2404758", "address": "fa:16:3e:3b:e1:a4", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa623ac3-2e", "ovs_interfaceid": "aa623ac3-2e29-46fc-aa95-d6e6e2404758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Converting VIF {"id": "aa623ac3-2e29-46fc-aa95-d6e6e2404758", "address": "fa:16:3e:3b:e1:a4", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa623ac3-2e", "ovs_interfaceid": "aa623ac3-2e29-46fc-aa95-d6e6e2404758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:e1:a4,bridge_name='br-int',has_traffic_filtering=True,id=aa623ac3-2e29-46fc-aa95-d6e6e2404758,network=Network(f4efdeee-d89b-45e5-b0d9-b45573564e9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa623ac3-2e') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG os_vif [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:e1:a4,bridge_name='br-int',has_traffic_filtering=True,id=aa623ac3-2e29-46fc-aa95-d6e6e2404758,network=Network(f4efdeee-d89b-45e5-b0d9-b45573564e9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa623ac3-2e') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa623ac3-2e, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaa623ac3-2e, col_values=(('external_ids', {'iface-id': 'aa623ac3-2e29-46fc-aa95-d6e6e2404758', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:e1:a4', 'vm-uuid': '71970b47-b09b-4492-9d99-a2be8b3b2042'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:54 user nova-compute[72766]: INFO os_vif [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:e1:a4,bridge_name='br-int',has_traffic_filtering=True,id=aa623ac3-2e29-46fc-aa95-d6e6e2404758,network=Network(f4efdeee-d89b-45e5-b0d9-b45573564e9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa623ac3-2e')
Aug 14 23:08:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] No VIF found with MAC fa:16:3e:3b:e1:a4, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG nova.network.neutron [req-b69b4d1b-b3c0-42f8-a04a-f82357ba613d req-b64561c1-63dc-408b-84dc-d439f2cc9fd3 service nova] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Updated VIF entry in instance network info cache for port aa623ac3-2e29-46fc-aa95-d6e6e2404758. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG nova.network.neutron [req-b69b4d1b-b3c0-42f8-a04a-f82357ba613d req-b64561c1-63dc-408b-84dc-d439f2cc9fd3 service nova] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Updating instance_info_cache with network_info: [{"id": "aa623ac3-2e29-46fc-aa95-d6e6e2404758", "address": "fa:16:3e:3b:e1:a4", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa623ac3-2e", "ovs_interfaceid": "aa623ac3-2e29-46fc-aa95-d6e6e2404758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-b69b4d1b-b3c0-42f8-a04a-f82357ba613d req-b64561c1-63dc-408b-84dc-d439f2cc9fd3 service nova] Releasing lock "refresh_cache-71970b47-b09b-4492-9d99-a2be8b3b2042" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:08:54 user nova-compute[72766]: INFO nova.compute.manager [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Rebuilding instance
Aug 14 23:08:54 user nova-compute[72766]: DEBUG nova.objects.instance [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lazy-loading 'trusted_certs' on Instance uuid 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG nova.objects.instance [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lazy-loading 'pci_requests' on Instance uuid 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG nova.objects.instance [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lazy-loading 'pci_devices' on Instance uuid 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:08:54 user nova-compute[72766]: DEBUG nova.objects.instance [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lazy-loading 'resources' on Instance uuid 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:08:55 user nova-compute[72766]: DEBUG nova.objects.instance [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lazy-loading 'migration_context' on Instance uuid 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:08:55 user nova-compute[72766]: DEBUG nova.objects.instance [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72766) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 14 23:08:55 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:55 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:55 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:55 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:55 user nova-compute[72766]: DEBUG nova.compute.manager [req-8655bfe2-4a7d-486e-96fa-74f706b864fe req-ba00c75d-dc0c-403e-90ac-641f777b6c68 service nova] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Received event network-vif-unplugged-0df45a26-6026-4baa-bdaa-a761d2d3c2a6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:08:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8655bfe2-4a7d-486e-96fa-74f706b864fe req-ba00c75d-dc0c-403e-90ac-641f777b6c68 service nova] Acquiring lock "99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:08:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8655bfe2-4a7d-486e-96fa-74f706b864fe req-ba00c75d-dc0c-403e-90ac-641f777b6c68 service nova] Lock "99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:08:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8655bfe2-4a7d-486e-96fa-74f706b864fe req-ba00c75d-dc0c-403e-90ac-641f777b6c68 service nova] Lock "99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:08:55 user nova-compute[72766]: DEBUG nova.compute.manager [req-8655bfe2-4a7d-486e-96fa-74f706b864fe req-ba00c75d-dc0c-403e-90ac-641f777b6c68 service nova] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] No waiting events found dispatching network-vif-unplugged-0df45a26-6026-4baa-bdaa-a761d2d3c2a6 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:08:55 user nova-compute[72766]: WARNING nova.compute.manager [req-8655bfe2-4a7d-486e-96fa-74f706b864fe req-ba00c75d-dc0c-403e-90ac-641f777b6c68 service nova] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Received unexpected event network-vif-unplugged-0df45a26-6026-4baa-bdaa-a761d2d3c2a6 for instance with vm_state active and task_state rebuilding.
Aug 14 23:08:55 user nova-compute[72766]: DEBUG nova.compute.manager [req-8655bfe2-4a7d-486e-96fa-74f706b864fe req-ba00c75d-dc0c-403e-90ac-641f777b6c68 service nova] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Received event network-vif-plugged-0df45a26-6026-4baa-bdaa-a761d2d3c2a6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:08:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8655bfe2-4a7d-486e-96fa-74f706b864fe req-ba00c75d-dc0c-403e-90ac-641f777b6c68 service nova] Acquiring lock "99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:08:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8655bfe2-4a7d-486e-96fa-74f706b864fe req-ba00c75d-dc0c-403e-90ac-641f777b6c68 service nova] Lock "99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:08:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8655bfe2-4a7d-486e-96fa-74f706b864fe req-ba00c75d-dc0c-403e-90ac-641f777b6c68 service nova] Lock "99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:08:55 user nova-compute[72766]: DEBUG nova.compute.manager [req-8655bfe2-4a7d-486e-96fa-74f706b864fe req-ba00c75d-dc0c-403e-90ac-641f777b6c68 service nova] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] No waiting events found dispatching network-vif-plugged-0df45a26-6026-4baa-bdaa-a761d2d3c2a6 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:08:55 user nova-compute[72766]: WARNING nova.compute.manager [req-8655bfe2-4a7d-486e-96fa-74f706b864fe req-ba00c75d-dc0c-403e-90ac-641f777b6c68 service nova] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Received unexpected event network-vif-plugged-0df45a26-6026-4baa-bdaa-a761d2d3c2a6 for instance with vm_state active and task_state rebuilding.
Aug 14 23:08:55 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:55 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG nova.compute.manager [req-9dc5a276-e559-4ac6-85b8-781aa60e6c70 req-f1403952-36e0-4b16-9cf5-97fbf02080d7 service nova] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Received event network-vif-plugged-aa623ac3-2e29-46fc-aa95-d6e6e2404758 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9dc5a276-e559-4ac6-85b8-781aa60e6c70 req-f1403952-36e0-4b16-9cf5-97fbf02080d7 service nova] Acquiring lock "71970b47-b09b-4492-9d99-a2be8b3b2042-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9dc5a276-e559-4ac6-85b8-781aa60e6c70 req-f1403952-36e0-4b16-9cf5-97fbf02080d7 service nova] Lock "71970b47-b09b-4492-9d99-a2be8b3b2042-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9dc5a276-e559-4ac6-85b8-781aa60e6c70 req-f1403952-36e0-4b16-9cf5-97fbf02080d7 service nova] Lock "71970b47-b09b-4492-9d99-a2be8b3b2042-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG nova.compute.manager [req-9dc5a276-e559-4ac6-85b8-781aa60e6c70 req-f1403952-36e0-4b16-9cf5-97fbf02080d7 service nova] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] No waiting events found dispatching network-vif-plugged-aa623ac3-2e29-46fc-aa95-d6e6e2404758 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:08:56 user nova-compute[72766]: WARNING nova.compute.manager [req-9dc5a276-e559-4ac6-85b8-781aa60e6c70 req-f1403952-36e0-4b16-9cf5-97fbf02080d7 service nova] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Received unexpected event network-vif-plugged-aa623ac3-2e29-46fc-aa95-d6e6e2404758 for instance with vm_state building and task_state spawning.
Aug 14 23:08:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:56 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Instance destroyed successfully.
Aug 14 23:08:56 user nova-compute[72766]: INFO nova.compute.manager [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Detaching volume ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1
Aug 14 23:08:56 user nova-compute[72766]: INFO nova.virt.block_device [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Attempting to driver detach volume ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 from mountpoint /dev/vdb
Aug 14 23:08:56 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Attempting to detach device vdb from instance 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef from the persistent domain config. {{(pid=72766) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 23:08:56 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:08:56 user nova-compute[72766]:   <source dev="/dev/sde"/>
Aug 14 23:08:56 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:08:56 user nova-compute[72766]:   <serial>ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1</serial>
Aug 14 23:08:56 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 23:08:56 user nova-compute[72766]: </disk>
Aug 14 23:08:56 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:56 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Successfully detached device vdb from instance 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef from the persistent domain config.
Aug 14 23:08:56 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UefzbqZF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:08:56 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 23:08:56 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[457162e9-cfb9-4fbd-8500-08f372ed33a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2d9a252-b5d1-49c5-a03e-b826e2cb2a8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b068271e-d46f-4505-80d5-150c8e6991e4]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d9a252-b5d1-49c5-a03e-b826e2cb2a8e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:08:56 user nova-compute[72766]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 (non-flash)
Aug 14 23:08:56 user nova-compute[72766]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 (non-flash)
Aug 14 23:08:56 user nova-compute[72766]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d9a252-b5d1-49c5-a03e-b826e2cb2a8e (non-flash)
Aug 14 23:08:56 user nova-compute[72766]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 (non-flash)
Aug 14 23:08:56 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:08:56 user nova-compute[72766]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 (non-flash)
Aug 14 23:08:56 user nova-compute[72766]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 (non-flash)
Aug 14 23:08:56 user nova-compute[72766]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d9a252-b5d1-49c5-a03e-b826e2cb2a8e (non-flash)
Aug 14 23:08:56 user nova-compute[72766]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 (non-flash)
Aug 14 23:08:56 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff1544428c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1'): ({'sde'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Removing single pathed devices sde {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[722cd728-eb12-43ea-892d-a6cddfc466d6]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16c1c60-0f69-44da-a2f0-58e43f72255d]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Flushing IO for device /dev/sde {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[f438a2b1-59af-47b0-890e-47f2865f5eb7]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.064s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d198a82-8d50-4c3e-9a33-ad3bfcb376a4]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] SCSI volumes sde have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[06eb6023-421e-4298-8193-15d92190f001]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[48aec062-304f-4119-8d9e-d07927ef5719]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1, portal: 172.16.0.220,3260]
Aug 14 23:08:56 user nova-compute[72766]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1, portal: 172.16.0.220,3260] successful.
Aug 14 23:08:56 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab51ab4b-5fff-4b3e-b818-4bbefa660630]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] <== disconnect_volume: return (360ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:08:56 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:08:57 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Instance destroyed successfully.
Aug 14 23:08:57 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:06:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-150191314',display_name='tempest-ServerActionsTestOtherA-server-862754926',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-150191314',id=26,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhBKWAdQDYNegvQl/mV+51njSAEVUmutFEgZbA9nGUhkxXmc3MlsVdSjdWdHEupxDpXGsOvLx4E4h8d+jhKDRG+ZGsHr6pYyGyF87J32gsCcwif1sgiUwbddldcHNR0PA==',key_name='tempest-keypair-293995822',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:06:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7b0d4f038dbd47b1aad9829f19cb4896',ramdisk_id='',reservation_id='r-uuuhfmg4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-242565278',owner_user_name='tempest-ServerActionsTestOtherA-242565278-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:08:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11bf21631dd0447f8f1a3f2b012ec43a',uuid=99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0df45a26-6026-4baa-bdaa-a761d2d3c2a6", "address": "fa:16:3e:89:96:a5", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0df45a26-60", "ovs_interfaceid": "0df45a26-6026-4baa-bdaa-a761d2d3c2a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:08:57 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Converting VIF {"id": "0df45a26-6026-4baa-bdaa-a761d2d3c2a6", "address": "fa:16:3e:89:96:a5", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0df45a26-60", "ovs_interfaceid": "0df45a26-6026-4baa-bdaa-a761d2d3c2a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:08:57 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:96:a5,bridge_name='br-int',has_traffic_filtering=True,id=0df45a26-6026-4baa-bdaa-a761d2d3c2a6,network=Network(e0bbc182-f700-4a82-84ae-7cbcb2e517c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0df45a26-60') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:08:57 user nova-compute[72766]: DEBUG os_vif [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:96:a5,bridge_name='br-int',has_traffic_filtering=True,id=0df45a26-6026-4baa-bdaa-a761d2d3c2a6,network=Network(e0bbc182-f700-4a82-84ae-7cbcb2e517c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0df45a26-60') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:08:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0df45a26-60, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:08:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:08:57 user nova-compute[72766]: INFO os_vif [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:96:a5,bridge_name='br-int',has_traffic_filtering=True,id=0df45a26-6026-4baa-bdaa-a761d2d3c2a6,network=Network(e0bbc182-f700-4a82-84ae-7cbcb2e517c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0df45a26-60')
Aug 14 23:08:57 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:08:57 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UefzbqZF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:08:57 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 23:08:57 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:08:57 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:08:57 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:08:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:57 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db5a230-5937-4106-b610-2765667a7f84]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2d9a252-b5d1-49c5-a03e-b826e2cb2a8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:57 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31ffb20-f0a2-4b34-9e01-575a0573dfa1]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d9a252-b5d1-49c5-a03e-b826e2cb2a8e (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:57 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:08:57 user nova-compute[72766]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 (non-flash)
Aug 14 23:08:57 user nova-compute[72766]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 (non-flash)
Aug 14 23:08:57 user nova-compute[72766]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d9a252-b5d1-49c5-a03e-b826e2cb2a8e (non-flash)
Aug 14 23:08:57 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:08:57 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:08:57 user nova-compute[72766]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 (non-flash)
Aug 14 23:08:57 user nova-compute[72766]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 (non-flash)
Aug 14 23:08:57 user nova-compute[72766]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d9a252-b5d1-49c5-a03e-b826e2cb2a8e (non-flash)
Aug 14 23:08:57 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:08:57 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff1543dedd0>, {}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:08:57 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Disconnecting from: [] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:08:57 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.051s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:08:57 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] <== disconnect_volume: return (52ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:08:57 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:08:57 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Deleting instance files /opt/stack/data/nova/instances/99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef_del
Aug 14 23:08:57 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Deletion of /opt/stack/data/nova/instances/99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef_del complete
Aug 14 23:08:58 user nova-compute[72766]: INFO nova.virt.block_device [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Booting with volume ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 at /dev/vdb
Aug 14 23:08:58 user nova-compute[72766]: DEBUG os_brick.utils [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:08:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:58 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4791f8b8-c0cd-4f40-898c-a48d742a88a2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:58 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0c2884-5238-4e2d-bc06-a54e08b4d43e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:58 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054538.2679281, 71970b47-b09b-4492-9d99-a2be8b3b2042 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:08:58 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] VM Resumed (Lifecycle Event)
Aug 14 23:08:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:08:58 user nova-compute[72766]: DEBUG nova.compute.manager [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:08:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 23:08:58 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed47eb6b-8f5f-4067-b708-829aab9072d1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:58 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c0e89e-53fd-4e8c-86b3-997880d0e159]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:08:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 23:08:58 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:08:58 user nova-compute[72766]: DEBUG nova.compute.manager [req-c0144830-05ca-4021-8aaa-4779e1746cab req-f787fd27-c66f-4ce5-8c8a-f6304c647485 service nova] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Received event network-vif-plugged-aa623ac3-2e29-46fc-aa95-d6e6e2404758 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:08:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-c0144830-05ca-4021-8aaa-4779e1746cab req-f787fd27-c66f-4ce5-8c8a-f6304c647485 service nova] Acquiring lock "71970b47-b09b-4492-9d99-a2be8b3b2042-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:08:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-c0144830-05ca-4021-8aaa-4779e1746cab req-f787fd27-c66f-4ce5-8c8a-f6304c647485 service nova] Lock "71970b47-b09b-4492-9d99-a2be8b3b2042-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:08:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-c0144830-05ca-4021-8aaa-4779e1746cab req-f787fd27-c66f-4ce5-8c8a-f6304c647485 service nova] Lock "71970b47-b09b-4492-9d99-a2be8b3b2042-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:08:58 user nova-compute[72766]: DEBUG nova.compute.manager [req-c0144830-05ca-4021-8aaa-4779e1746cab req-f787fd27-c66f-4ce5-8c8a-f6304c647485 service nova] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] No waiting events found dispatching network-vif-plugged-aa623ac3-2e29-46fc-aa95-d6e6e2404758 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:08:58 user nova-compute[72766]: WARNING nova.compute.manager [req-c0144830-05ca-4021-8aaa-4779e1746cab req-f787fd27-c66f-4ce5-8c8a-f6304c647485 service nova] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Received unexpected event network-vif-plugged-aa623ac3-2e29-46fc-aa95-d6e6e2404758 for instance with vm_state building and task_state spawning.
Aug 14 23:08:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:08:58 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Instance spawned successfully.
Aug 14 23:08:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 23:08:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:08:58 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 23:08:58 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b858dac-27c9-43b9-a6c8-47e00599e7d8]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:08:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 23:08:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 23:08:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 23:08:58 user nova-compute[72766]: DEBUG os_brick.utils [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:08:58 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Updating existing volume attachment record: 6265f5f3-0299-4035-b8df-895f714c94ea {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 23:08:58 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:08:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:08:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:08:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:08:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:08:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:08:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:08:58 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:08:58 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054538.2696233, 71970b47-b09b-4492-9d99-a2be8b3b2042 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:08:58 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] VM Started (Lifecycle Event)
Aug 14 23:08:58 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:08:58 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:08:58 user nova-compute[72766]: INFO nova.compute.manager [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Took 6.49 seconds to spawn the instance on the hypervisor.
Aug 14 23:08:58 user nova-compute[72766]: DEBUG nova.compute.manager [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:08:58 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:08:58 user nova-compute[72766]: INFO nova.compute.manager [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Took 7.30 seconds to build instance.
Aug 14 23:08:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a2a8622e-9c92-48ff-b850-e0ebfe30e00d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "71970b47-b09b-4492-9d99-a2be8b3b2042" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.800s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:08:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:09:02 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:09:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5c406cd7-410d-40f8-ba1c-7ba982e9ea43 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquiring lock "66578337-cbff-4613-87a1-85ddabaebb2d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:09:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5c406cd7-410d-40f8-ba1c-7ba982e9ea43 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "66578337-cbff-4613-87a1-85ddabaebb2d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:09:06 user nova-compute[72766]: INFO nova.compute.manager [None req-5c406cd7-410d-40f8-ba1c-7ba982e9ea43 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Detaching volume 07f50970-07ad-4c8a-be6f-d49e78dbac93
Aug 14 23:09:06 user nova-compute[72766]: INFO nova.virt.block_device [None req-5c406cd7-410d-40f8-ba1c-7ba982e9ea43 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Attempting to driver detach volume 07f50970-07ad-4c8a-be6f-d49e78dbac93 from mountpoint /dev/vdb
Aug 14 23:09:06 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-5c406cd7-410d-40f8-ba1c-7ba982e9ea43 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Attempting to detach device vdb from instance 66578337-cbff-4613-87a1-85ddabaebb2d from the persistent domain config. {{(pid=72766) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 23:09:06 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-5c406cd7-410d-40f8-ba1c-7ba982e9ea43 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 23:09:06 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:09:06 user nova-compute[72766]:   <source dev="/dev/sdc"/>
Aug 14 23:09:06 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:09:06 user nova-compute[72766]:   <serial>07f50970-07ad-4c8a-be6f-d49e78dbac93</serial>
Aug 14 23:09:06 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 23:09:06 user nova-compute[72766]: </disk>
Aug 14 23:09:06 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 23:09:06 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-5c406cd7-410d-40f8-ba1c-7ba982e9ea43 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Successfully detached device vdb from instance 66578337-cbff-4613-87a1-85ddabaebb2d from the persistent domain config.
Aug 14 23:09:06 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-5c406cd7-410d-40f8-ba1c-7ba982e9ea43 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 66578337-cbff-4613-87a1-85ddabaebb2d from the live domain config. {{(pid=72766) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 23:09:06 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-5c406cd7-410d-40f8-ba1c-7ba982e9ea43 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 23:09:06 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:09:06 user nova-compute[72766]:   <source dev="/dev/sdc"/>
Aug 14 23:09:06 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:09:06 user nova-compute[72766]:   <serial>07f50970-07ad-4c8a-be6f-d49e78dbac93</serial>
Aug 14 23:09:06 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 23:09:06 user nova-compute[72766]: </disk>
Aug 14 23:09:06 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Received event <DeviceRemovedEvent: 1692054547.3216205, 66578337-cbff-4613-87a1-85ddabaebb2d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72766) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-5c406cd7-410d-40f8-ba1c-7ba982e9ea43 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 66578337-cbff-4613-87a1-85ddabaebb2d {{(pid=72766) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 23:09:07 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-5c406cd7-410d-40f8-ba1c-7ba982e9ea43 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Successfully detached device vdb from instance 66578337-cbff-4613-87a1-85ddabaebb2d from the live domain config.
Aug 14 23:09:07 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c406cd7-410d-40f8-ba1c-7ba982e9ea43 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c406cd7-410d-40f8-ba1c-7ba982e9ea43 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'novNFwxY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:09:07 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-5c406cd7-410d-40f8-ba1c-7ba982e9ea43 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:09:07 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-5c406cd7-410d-40f8-ba1c-7ba982e9ea43 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-5c406cd7-410d-40f8-ba1c-7ba982e9ea43 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c406cd7-410d-40f8-ba1c-7ba982e9ea43 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f889f3a-ce9a-47c1-8e7c-e5bd47910841]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[894c7df7-6876-44c0-9825-90144f526cd5]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c406cd7-410d-40f8-ba1c-7ba982e9ea43 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:09:07 user nova-compute[72766]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 (non-flash)
Aug 14 23:09:07 user nova-compute[72766]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 (non-flash)
Aug 14 23:09:07 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c406cd7-410d-40f8-ba1c-7ba982e9ea43 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:09:07 user nova-compute[72766]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 (non-flash)
Aug 14 23:09:07 user nova-compute[72766]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 (non-flash)
Aug 14 23:09:07 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c406cd7-410d-40f8-ba1c-7ba982e9ea43 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff16c139a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93'): ({'sdc'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-5c406cd7-410d-40f8-ba1c-7ba982e9ea43 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Removing single pathed devices sdc {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3adb3b-b910-4b81-b293-f0d4a285a65c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[201fb706-69f9-4bd2-b04a-2e7315a7e9a0]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-5c406cd7-410d-40f8-ba1c-7ba982e9ea43 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Flushing IO for device /dev/sdc {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e283f6b-9944-4a2b-a246-3c09e61857f5]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-5c406cd7-410d-40f8-ba1c-7ba982e9ea43 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2cfc9a6-92b1-4d8f-b66f-9f0a59748abc]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-5c406cd7-410d-40f8-ba1c-7ba982e9ea43 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-5c406cd7-410d-40f8-ba1c-7ba982e9ea43 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] SCSI volumes sdc have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c406cd7-410d-40f8-ba1c-7ba982e9ea43 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a813a859-15f4-4216-b89a-cc9b31cbb131]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c406cd7-410d-40f8-ba1c-7ba982e9ea43 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb484b32-af8a-4a2f-982b-9aea900bbf55]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c406cd7-410d-40f8-ba1c-7ba982e9ea43 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93, portal: 172.16.0.220,3260]
Aug 14 23:09:07 user nova-compute[72766]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93, portal: 172.16.0.220,3260] successful.
Aug 14 23:09:07 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07f50970-07ad-4c8a-be6f-d49e78dbac93 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d5af8b-cb20-4f1f-87be-9823dc7c77fd]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c406cd7-410d-40f8-ba1c-7ba982e9ea43 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-5c406cd7-410d-40f8-ba1c-7ba982e9ea43 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c406cd7-410d-40f8-ba1c-7ba982e9ea43 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] <== disconnect_volume: return (293ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c406cd7-410d-40f8-ba1c-7ba982e9ea43 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:09:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:09:08 user nova-compute[72766]: DEBUG nova.objects.instance [None req-5c406cd7-410d-40f8-ba1c-7ba982e9ea43 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lazy-loading 'flavor' on Instance uuid 66578337-cbff-4613-87a1-85ddabaebb2d {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:09:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5c406cd7-410d-40f8-ba1c-7ba982e9ea43 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "66578337-cbff-4613-87a1-85ddabaebb2d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.928s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.volume.cinder [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Update attachment failed for attachment 6265f5f3-0299-4035-b8df-895f714c94ea. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create user UefzbqZF for target iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 because of JDSS internal system error 1:Scstadmin Error:
Aug 14 23:09:08 user nova-compute[72766]: Collecting current configuration:
Aug 14 23:09:08 user nova-compute[72766]: FATAL: Received the following error:
Aug 14 23:09:08 user nova-compute[72766]:         handlerAttributes(): Unable to read handler attribute '5e47c069b232f1a6': No such file or directory
Aug 14 23:09:08 user nova-compute[72766]: :/var/nasexe/SCST/scstadmin -set_tgt_attr iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 -driver iscsi -attributes IncomingUser=UefzbqZF DSZJAV8vWzncxO -noprompt..).). (HTTP 500) (Request-ID: req-7bc714ec-249f-4b0d-bbb7-8ec56fe3a1a8) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create user UefzbqZF for target iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 because of JDSS internal system error 1:Scstadmin Error: 
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create user UefzbqZF for target iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 because of JDSS internal system error 1:Scstadmin Error:
Aug 14 23:09:08 user nova-compute[72766]: Collecting current configuration:
Aug 14 23:09:08 user nova-compute[72766]: FATAL: Received the following error:
Aug 14 23:09:08 user nova-compute[72766]:         handlerAttributes(): Unable to read handler attribute '5e47c069b232f1a6': No such file or directory
Aug 14 23:09:08 user nova-compute[72766]: :/var/nasexe/SCST/scstadmin -set_tgt_attr iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 -driver iscsi -attributes IncomingUser=UefzbqZF DSZJAV8vWzncxO -noprompt..).). (HTTP 500) (Request-ID: req-7bc714ec-249f-4b0d-bbb7-8ec56fe3a1a8)
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Traceback (most recent call last):
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/nova/nova/compute/manager.py", line 4115, in _do_rebuild_instance
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     self.driver.rebuild(**kwargs)
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/nova/nova/virt/driver.py", line 378, in rebuild
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     raise NotImplementedError()
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] NotImplementedError
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] 
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] During handling of the above exception, another exception occurred:
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] 
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Traceback (most recent call last):
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/nova/nova/compute/manager.py", line 2174, in _prep_block_device
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     driver_block_device.attach_block_devices(
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     _log_and_attach(device)
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     bdm.attach(*attach_args, **attach_kwargs)
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     ret_val = method(obj, context, *args, **kwargs)
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     self._do_attach(context, instance, volume, volume_api,
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     self._volume_attach(context, volume, connector, instance,
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     connection_info = volume_api.attachment_update(
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     res = method(self, ctx, *args, **kwargs)
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     with excutils.save_and_reraise_exception():
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     self.force_reraise()
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     raise self.value
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     context, '3.44', skip_version_check=True).attachments.update(
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     return method.func(obj, *args, **kwargs)
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     resp = self._update('/attachments/%s' % id, body)
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     return self._cs_request(url, 'PUT', **kwargs)
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     return self.request(url, method, **kwargs)
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     raise exceptions.from_response(resp, body)
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create user UefzbqZF for target iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 because of JDSS internal system error 1:Scstadmin Error:
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Collecting current configuration:
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] 
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] FATAL: Received the following error:
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] 
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]         handlerAttributes(): Unable to read handler attribute '5e47c069b232f1a6': No such file or directory
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] 
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] :/var/nasexe/SCST/scstadmin -set_tgt_attr iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 -driver iscsi -attributes IncomingUser=UefzbqZF DSZJAV8vWzncxO -noprompt..).). (HTTP 500) (Request-ID: req-7bc714ec-249f-4b0d-bbb7-8ec56fe3a1a8)
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] 
Aug 14 23:09:08 user nova-compute[72766]: DEBUG nova.compute.utils [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create user UefzbqZF for target iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 because of JDSS internal {{(pid=72766) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Setting instance vm_state to ERROR: nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create user UefzbqZF for target iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 because of JDSS internal system error 1:Scstadmin Error:
Aug 14 23:09:08 user nova-compute[72766]: Collecting current configuration:
Aug 14 23:09:08 user nova-compute[72766]: FATAL: Received the following error:
Aug 14 23:09:08 user nova-compute[72766]:         handlerAttributes(): Unable to read handler attribute '5e47c069b232f1a6': No such file or directory
Aug 14 23:09:08 user nova-compute[72766]: :/var/nasexe/SCST/scstadmin -set_tgt_attr iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 -driver iscsi -attributes IncomingUser=UefzbqZF DSZJAV8vWzncxO -noprompt..).). (HTTP 500) (Request-ID: req-7bc714ec-249f-4b0d-bbb7-8ec56fe3a1a8)
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Traceback (most recent call last):
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/nova/nova/compute/manager.py", line 4115, in _do_rebuild_instance
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     self.driver.rebuild(**kwargs)
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/nova/nova/virt/driver.py", line 378, in rebuild
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     raise NotImplementedError()
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] NotImplementedError
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] 
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] During handling of the above exception, another exception occurred:
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] 
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Traceback (most recent call last):
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/nova/nova/compute/manager.py", line 2174, in _prep_block_device
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     driver_block_device.attach_block_devices(
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     _log_and_attach(device)
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     bdm.attach(*attach_args, **attach_kwargs)
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     ret_val = method(obj, context, *args, **kwargs)
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     self._do_attach(context, instance, volume, volume_api,
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     self._volume_attach(context, volume, connector, instance,
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     connection_info = volume_api.attachment_update(
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     res = method(self, ctx, *args, **kwargs)
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     with excutils.save_and_reraise_exception():
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     self.force_reraise()
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     raise self.value
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     context, '3.44', skip_version_check=True).attachments.update(
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     return method.func(obj, *args, **kwargs)
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     resp = self._update('/attachments/%s' % id, body)
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     return self._cs_request(url, 'PUT', **kwargs)
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     return self.request(url, method, **kwargs)
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     raise exceptions.from_response(resp, body)
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create user UefzbqZF for target iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 because of JDSS internal system error 1:Scstadmin Error:
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Collecting current configuration:
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] 
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] FATAL: Received the following error:
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] 
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]         handlerAttributes(): Unable to read handler attribute '5e47c069b232f1a6': No such file or directory
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] 
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] :/var/nasexe/SCST/scstadmin -set_tgt_attr iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 -driver iscsi -attributes IncomingUser=UefzbqZF DSZJAV8vWzncxO -noprompt..).). (HTTP 500) (Request-ID: req-7bc714ec-249f-4b0d-bbb7-8ec56fe3a1a8)
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] 
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] During handling of the above exception, another exception occurred:
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] 
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Traceback (most recent call last):
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/nova/nova/compute/manager.py", line 10766, in _error_out_instance_on_exception
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     yield
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/nova/nova/compute/manager.py", line 3841, in rebuild_instance
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     self._do_rebuild_instance_with_claim(
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/nova/nova/compute/manager.py", line 3927, in _do_rebuild_instance_with_claim
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     self._do_rebuild_instance(
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/nova/nova/compute/manager.py", line 4119, in _do_rebuild_instance
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     self._rebuild_default_impl(**kwargs)
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/nova/nova/compute/manager.py", line 3703, in _rebuild_default_impl
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     new_block_device_info = attach_block_devices(context, instance, bdms)
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]   File "/opt/stack/nova/nova/compute/manager.py", line 2193, in _prep_block_device
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]     raise exception.InvalidBDM(str(ex))
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create user UefzbqZF for target iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 because of JDSS internal system error 1:Scstadmin Error:
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Collecting current configuration:
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] 
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] FATAL: Received the following error:
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] 
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef]         handlerAttributes(): Unable to read handler attribute '5e47c069b232f1a6': No such file or directory
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] 
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] :/var/nasexe/SCST/scstadmin -set_tgt_attr iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 -driver iscsi -attributes IncomingUser=UefzbqZF DSZJAV8vWzncxO -noprompt..).). (HTTP 500) (Request-ID: req-7bc714ec-249f-4b0d-bbb7-8ec56fe3a1a8)
Aug 14 23:09:08 user nova-compute[72766]: ERROR nova.compute.manager [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] 
Aug 14 23:09:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:09:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-0b17a521-2ec6-4e03-bb66-18a2b03e3fec tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquiring lock "66578337-cbff-4613-87a1-85ddabaebb2d" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:09:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-0b17a521-2ec6-4e03-bb66-18a2b03e3fec tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "66578337-cbff-4613-87a1-85ddabaebb2d" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:09:09 user nova-compute[72766]: DEBUG nova.compute.manager [None req-0b17a521-2ec6-4e03-bb66-18a2b03e3fec tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:09:09 user nova-compute[72766]: DEBUG nova.compute.manager [None req-0b17a521-2ec6-4e03-bb66-18a2b03e3fec tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72766) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 14 23:09:09 user nova-compute[72766]: DEBUG nova.objects.instance [None req-0b17a521-2ec6-4e03-bb66-18a2b03e3fec tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lazy-loading 'flavor' on Instance uuid 66578337-cbff-4613-87a1-85ddabaebb2d {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:09:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:09:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:09:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:09:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:09:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:09:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:09:09 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:09:09 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:09:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.338s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:09:09 user nova-compute[72766]: INFO nova.compute.manager [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Successfully reverted task state from rebuild_block_device_mapping on failure for instance.
Aug 14 23:09:09 user nova-compute[72766]: DEBUG nova.compute.manager [req-57113201-7e35-4c78-b2ed-0f049264b1fc req-6800b2d5-be39-47ea-bba0-5ad0c208adc1 service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Received event network-vif-unplugged-ffc1761b-5d95-4c58-9b92-b6b43b4823a6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:09:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-57113201-7e35-4c78-b2ed-0f049264b1fc req-6800b2d5-be39-47ea-bba0-5ad0c208adc1 service nova] Acquiring lock "66578337-cbff-4613-87a1-85ddabaebb2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:09:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-57113201-7e35-4c78-b2ed-0f049264b1fc req-6800b2d5-be39-47ea-bba0-5ad0c208adc1 service nova] Lock "66578337-cbff-4613-87a1-85ddabaebb2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:09:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-57113201-7e35-4c78-b2ed-0f049264b1fc req-6800b2d5-be39-47ea-bba0-5ad0c208adc1 service nova] Lock "66578337-cbff-4613-87a1-85ddabaebb2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:09:09 user nova-compute[72766]: DEBUG nova.compute.manager [req-57113201-7e35-4c78-b2ed-0f049264b1fc req-6800b2d5-be39-47ea-bba0-5ad0c208adc1 service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] No waiting events found dispatching network-vif-unplugged-ffc1761b-5d95-4c58-9b92-b6b43b4823a6 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:09:09 user nova-compute[72766]: WARNING nova.compute.manager [req-57113201-7e35-4c78-b2ed-0f049264b1fc req-6800b2d5-be39-47ea-bba0-5ad0c208adc1 service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Received unexpected event network-vif-unplugged-ffc1761b-5d95-4c58-9b92-b6b43b4823a6 for instance with vm_state active and task_state powering-off.
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server [None req-1cf1c917-d09a-4cb2-b8bf-b511131de763 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Exception during message handling: nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create user UefzbqZF for target iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 because of JDSS internal system error 1:Scstadmin Error:
Aug 14 23:09:09 user nova-compute[72766]: Collecting current configuration:
Aug 14 23:09:09 user nova-compute[72766]: FATAL: Received the following error:
Aug 14 23:09:09 user nova-compute[72766]:         handlerAttributes(): Unable to read handler attribute '5e47c069b232f1a6': No such file or directory
Aug 14 23:09:09 user nova-compute[72766]: :/var/nasexe/SCST/scstadmin -set_tgt_attr iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 -driver iscsi -attributes IncomingUser=UefzbqZF DSZJAV8vWzncxO -noprompt..).). (HTTP 500) (Request-ID: req-7bc714ec-249f-4b0d-bbb7-8ec56fe3a1a8)
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4115, in _do_rebuild_instance
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     self.driver.rebuild(**kwargs)
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/driver.py", line 378, in rebuild
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     raise NotImplementedError()
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server NotImplementedError
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server 
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server 
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 2174, in _prep_block_device
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     driver_block_device.attach_block_devices(
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     _log_and_attach(device)
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     bdm.attach(*attach_args, **attach_kwargs)
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create user UefzbqZF for target iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 because of JDSS internal system error 1:Scstadmin Error:
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server Collecting current configuration:
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server 
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server FATAL: Received the following error:
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server 
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server         handlerAttributes(): Unable to read handler attribute '5e47c069b232f1a6': No such file or directory
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server 
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server :/var/nasexe/SCST/scstadmin -set_tgt_attr iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 -driver iscsi -attributes IncomingUser=UefzbqZF DSZJAV8vWzncxO -noprompt..).). (HTTP 500) (Request-ID: req-7bc714ec-249f-4b0d-bbb7-8ec56fe3a1a8)
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server 
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server 
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3841, in rebuild_instance
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance_with_claim(
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3927, in _do_rebuild_instance_with_claim
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance(
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4119, in _do_rebuild_instance
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     self._rebuild_default_impl(**kwargs)
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3703, in _rebuild_default_impl
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     new_block_device_info = attach_block_devices(context, instance, bdms)
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 2193, in _prep_block_device
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server     raise exception.InvalidBDM(str(ex))
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create user UefzbqZF for target iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 because of JDSS internal system error 1:Scstadmin Error:
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server Collecting current configuration:
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server 
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server FATAL: Received the following error:
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server 
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server         handlerAttributes(): Unable to read handler attribute '5e47c069b232f1a6': No such file or directory
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server 
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server :/var/nasexe/SCST/scstadmin -set_tgt_attr iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1 -driver iscsi -attributes IncomingUser=UefzbqZF DSZJAV8vWzncxO -noprompt..).). (HTTP 500) (Request-ID: req-7bc714ec-249f-4b0d-bbb7-8ec56fe3a1a8)
Aug 14 23:09:09 user nova-compute[72766]: ERROR oslo_messaging.rpc.server 
Aug 14 23:09:09 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Instance destroyed successfully.
Aug 14 23:09:09 user nova-compute[72766]: DEBUG nova.compute.manager [None req-0b17a521-2ec6-4e03-bb66-18a2b03e3fec tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:09:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-0b17a521-2ec6-4e03-bb66-18a2b03e3fec tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "66578337-cbff-4613-87a1-85ddabaebb2d" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.890s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:09:11 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692054536.340418, 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:09:11 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] VM Stopped (Lifecycle Event)
Aug 14 23:09:11 user nova-compute[72766]: DEBUG nova.compute.manager [None req-b5a61b06-7070-40c4-8525-c6f03961a673 None None] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:09:11 user nova-compute[72766]: DEBUG nova.compute.manager [req-9d67bac6-1275-4462-ace4-32b585c52ad4 req-5b6ea9da-f9b4-4e5b-9ef2-e6a9b9b2a912 service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Received event network-vif-plugged-ffc1761b-5d95-4c58-9b92-b6b43b4823a6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:09:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9d67bac6-1275-4462-ace4-32b585c52ad4 req-5b6ea9da-f9b4-4e5b-9ef2-e6a9b9b2a912 service nova] Acquiring lock "66578337-cbff-4613-87a1-85ddabaebb2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:09:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9d67bac6-1275-4462-ace4-32b585c52ad4 req-5b6ea9da-f9b4-4e5b-9ef2-e6a9b9b2a912 service nova] Lock "66578337-cbff-4613-87a1-85ddabaebb2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:09:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9d67bac6-1275-4462-ace4-32b585c52ad4 req-5b6ea9da-f9b4-4e5b-9ef2-e6a9b9b2a912 service nova] Lock "66578337-cbff-4613-87a1-85ddabaebb2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:09:11 user nova-compute[72766]: DEBUG nova.compute.manager [req-9d67bac6-1275-4462-ace4-32b585c52ad4 req-5b6ea9da-f9b4-4e5b-9ef2-e6a9b9b2a912 service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] No waiting events found dispatching network-vif-plugged-ffc1761b-5d95-4c58-9b92-b6b43b4823a6 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:09:11 user nova-compute[72766]: WARNING nova.compute.manager [req-9d67bac6-1275-4462-ace4-32b585c52ad4 req-5b6ea9da-f9b4-4e5b-9ef2-e6a9b9b2a912 service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Received unexpected event network-vif-plugged-ffc1761b-5d95-4c58-9b92-b6b43b4823a6 for instance with vm_state stopped and task_state None.
Aug 14 23:09:12 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:09:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:09:15 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:09:17 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:09:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:09:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:09:23 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:09:23 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:09:23 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-66578337-cbff-4613-87a1-85ddabaebb2d" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:09:23 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-66578337-cbff-4613-87a1-85ddabaebb2d" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:09:23 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:09:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:09:24 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692054549.839241, 66578337-cbff-4613-87a1-85ddabaebb2d => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:09:24 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] VM Stopped (Lifecycle Event)
Aug 14 23:09:24 user nova-compute[72766]: DEBUG nova.compute.manager [None req-cf0319c9-af85-4ddb-8cd1-023bf8df91ff None None] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:09:24 user nova-compute[72766]: DEBUG nova.compute.manager [None req-cf0319c9-af85-4ddb-8cd1-023bf8df91ff None None] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:09:25 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Updating instance_info_cache with network_info: [{"id": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "address": "fa:16:3e:e2:97:1e", "network": {"id": "b375da9b-b613-4a88-a262-962f959597b9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-462508113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1dd09415664f1aa0b0dbdeeb4b8d32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffc1761b-5d", "ovs_interfaceid": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:09:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-66578337-cbff-4613-87a1-85ddabaebb2d" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:09:25 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:09:25 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:09:26 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:09:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:09:27 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:09:27 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:09:27 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:09:27 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:09:27 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:09:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:09:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:09:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:09:27 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:09:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e79581-a122-4c0a-8485-a8b6c62e73b8/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:09:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:09:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e79581-a122-4c0a-8485-a8b6c62e73b8/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:09:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e79581-a122-4c0a-8485-a8b6c62e73b8/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:09:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11e79581-a122-4c0a-8485-a8b6c62e73b8/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:09:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:09:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:09:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:09:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:09:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:09:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:09:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:09:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:09:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:09:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:09:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:09:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:09:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:09:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:09:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:09:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:09:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:09:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:09:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:09:30 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:09:30 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:09:30 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=8196MB free_disk=25.4498291015625GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:09:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:09:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:09:30 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 3ff300ff-34fd-4e94-9d2d-681fb133ba32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:09:30 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance cbcf7851-e6f7-4f46-97cc-d773286ccddf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:09:30 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 66578337-cbff-4613-87a1-85ddabaebb2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:09:30 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 83084ccc-8e55-43dc-9a37-ffcb35a10922 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:09:30 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 11e79581-a122-4c0a-8485-a8b6c62e73b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:09:30 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 71970b47-b09b-4492-9d99-a2be8b3b2042 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:09:30 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:09:30 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:09:30 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:09:30 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:09:30 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:09:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.376s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:09:32 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:09:32 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:09:32 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:09:32 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:09:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-052426c3-fb42-44f0-a095-a191ef159894 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquiring lock "11e79581-a122-4c0a-8485-a8b6c62e73b8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:09:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-052426c3-fb42-44f0-a095-a191ef159894 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "11e79581-a122-4c0a-8485-a8b6c62e73b8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:09:34 user nova-compute[72766]: INFO nova.compute.manager [None req-052426c3-fb42-44f0-a095-a191ef159894 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Detaching volume a8190fbe-e5c5-4adc-84f5-278ba6384470
Aug 14 23:09:34 user nova-compute[72766]: INFO nova.virt.block_device [None req-052426c3-fb42-44f0-a095-a191ef159894 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Attempting to driver detach volume a8190fbe-e5c5-4adc-84f5-278ba6384470 from mountpoint /dev/vdc
Aug 14 23:09:34 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-052426c3-fb42-44f0-a095-a191ef159894 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Attempting to detach device vdc from instance 11e79581-a122-4c0a-8485-a8b6c62e73b8 from the persistent domain config. {{(pid=72766) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 23:09:34 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-052426c3-fb42-44f0-a095-a191ef159894 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 23:09:34 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:09:34 user nova-compute[72766]:   <source dev="/dev/sdd"/>
Aug 14 23:09:34 user nova-compute[72766]:   <target dev="vdc" bus="virtio"/>
Aug 14 23:09:34 user nova-compute[72766]:   <serial>a8190fbe-e5c5-4adc-84f5-278ba6384470</serial>
Aug 14 23:09:34 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 23:09:34 user nova-compute[72766]: </disk>
Aug 14 23:09:34 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 23:09:34 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-052426c3-fb42-44f0-a095-a191ef159894 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Successfully detached device vdc from instance 11e79581-a122-4c0a-8485-a8b6c62e73b8 from the persistent domain config.
Aug 14 23:09:34 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-052426c3-fb42-44f0-a095-a191ef159894 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 11e79581-a122-4c0a-8485-a8b6c62e73b8 from the live domain config. {{(pid=72766) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 23:09:34 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-052426c3-fb42-44f0-a095-a191ef159894 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 23:09:34 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:09:34 user nova-compute[72766]:   <source dev="/dev/sdd"/>
Aug 14 23:09:34 user nova-compute[72766]:   <target dev="vdc" bus="virtio"/>
Aug 14 23:09:34 user nova-compute[72766]:   <serial>a8190fbe-e5c5-4adc-84f5-278ba6384470</serial>
Aug 14 23:09:34 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 23:09:34 user nova-compute[72766]: </disk>
Aug 14 23:09:34 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Received event <DeviceRemovedEvent: 1692054575.4762976, 11e79581-a122-4c0a-8485-a8b6c62e73b8 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72766) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-052426c3-fb42-44f0-a095-a191ef159894 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 11e79581-a122-4c0a-8485-a8b6c62e73b8 {{(pid=72766) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 23:09:35 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-052426c3-fb42-44f0-a095-a191ef159894 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Successfully detached device vdc from instance 11e79581-a122-4c0a-8485-a8b6c62e73b8 from the live domain config.
Aug 14 23:09:35 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-052426c3-fb42-44f0-a095-a191ef159894 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-052426c3-fb42-44f0-a095-a191ef159894 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vJSGAqym', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:09:35 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-052426c3-fb42-44f0-a095-a191ef159894 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:09:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-052426c3-fb42-44f0-a095-a191ef159894 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-052426c3-fb42-44f0-a095-a191ef159894 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-052426c3-fb42-44f0-a095-a191ef159894 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[89166b5b-85e6-4d2a-af92-59690087f648]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f265bf8-2c53-4b65-bcee-91a6c0067045]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-052426c3-fb42-44f0-a095-a191ef159894 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:09:35 user nova-compute[72766]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 (non-flash)
Aug 14 23:09:35 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-052426c3-fb42-44f0-a095-a191ef159894 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:09:35 user nova-compute[72766]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 (non-flash)
Aug 14 23:09:35 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-052426c3-fb42-44f0-a095-a191ef159894 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff16c365ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470'): ({'sdd'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-052426c3-fb42-44f0-a095-a191ef159894 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Removing single pathed devices sdd {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc693a55-04fc-4f13-b690-5b4b480c80b7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f62828e-ba89-4624-967e-16b561bb556b]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-052426c3-fb42-44f0-a095-a191ef159894 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Flushing IO for device /dev/sdd {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d56102-6ed9-4de5-9900-1d4eec4de3d0]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-052426c3-fb42-44f0-a095-a191ef159894 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5d6ba7-f9cd-4712-a8e4-63c0949353e6]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-052426c3-fb42-44f0-a095-a191ef159894 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-052426c3-fb42-44f0-a095-a191ef159894 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] SCSI volumes sdd have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-052426c3-fb42-44f0-a095-a191ef159894 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[5588693f-abdc-49dc-9cf4-a3e68ffcd194]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-052426c3-fb42-44f0-a095-a191ef159894 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f982764-c8fe-49bd-b127-4eaa4b635e56]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-052426c3-fb42-44f0-a095-a191ef159894 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470, portal: 172.16.0.220,3260]
Aug 14 23:09:35 user nova-compute[72766]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470, portal: 172.16.0.220,3260] successful.
Aug 14 23:09:35 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8190fbe-e5c5-4adc-84f5-278ba6384470 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1334a3-edc3-4dc0-87d0-0f7e7c6a8c71]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-052426c3-fb42-44f0-a095-a191ef159894 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-052426c3-fb42-44f0-a095-a191ef159894 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-052426c3-fb42-44f0-a095-a191ef159894 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] <== disconnect_volume: return (278ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:09:35 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-052426c3-fb42-44f0-a095-a191ef159894 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:09:36 user nova-compute[72766]: DEBUG nova.objects.instance [None req-052426c3-fb42-44f0-a095-a191ef159894 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lazy-loading 'flavor' on Instance uuid 11e79581-a122-4c0a-8485-a8b6c62e73b8 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:09:36 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-052426c3-fb42-44f0-a095-a191ef159894 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "11e79581-a122-4c0a-8485-a8b6c62e73b8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.778s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:09:37 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:09:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:09:40 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:09:42 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:09:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:09:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:09:47 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:09:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:09:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:09:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:09:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:09:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:09:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:09:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:00 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:02 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:12 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:17 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:20 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-76698fe6-15f8-477a-bb0d-ec6efcad4603 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquiring lock "11e79581-a122-4c0a-8485-a8b6c62e73b8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:10:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-76698fe6-15f8-477a-bb0d-ec6efcad4603 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "11e79581-a122-4c0a-8485-a8b6c62e73b8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:10:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-76698fe6-15f8-477a-bb0d-ec6efcad4603 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquiring lock "11e79581-a122-4c0a-8485-a8b6c62e73b8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:10:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-76698fe6-15f8-477a-bb0d-ec6efcad4603 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "11e79581-a122-4c0a-8485-a8b6c62e73b8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:10:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-76698fe6-15f8-477a-bb0d-ec6efcad4603 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "11e79581-a122-4c0a-8485-a8b6c62e73b8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:10:25 user nova-compute[72766]: INFO nova.compute.manager [None req-76698fe6-15f8-477a-bb0d-ec6efcad4603 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Terminating instance
Aug 14 23:10:25 user nova-compute[72766]: DEBUG nova.compute.manager [None req-76698fe6-15f8-477a-bb0d-ec6efcad4603 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:10:25 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:25 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:25 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:25 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:25 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:25 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:10:25 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:10:25 user nova-compute[72766]: DEBUG nova.compute.manager [req-01f89daf-3e43-4cd4-9a46-3423251cbe4a req-ef8a8d28-db83-4b4e-9d01-234935654955 service nova] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Received event network-vif-unplugged-0add7ef0-687d-4486-842d-2d07c0d26449 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:10:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-01f89daf-3e43-4cd4-9a46-3423251cbe4a req-ef8a8d28-db83-4b4e-9d01-234935654955 service nova] Acquiring lock "11e79581-a122-4c0a-8485-a8b6c62e73b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:10:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-01f89daf-3e43-4cd4-9a46-3423251cbe4a req-ef8a8d28-db83-4b4e-9d01-234935654955 service nova] Lock "11e79581-a122-4c0a-8485-a8b6c62e73b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:10:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-01f89daf-3e43-4cd4-9a46-3423251cbe4a req-ef8a8d28-db83-4b4e-9d01-234935654955 service nova] Lock "11e79581-a122-4c0a-8485-a8b6c62e73b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:10:25 user nova-compute[72766]: DEBUG nova.compute.manager [req-01f89daf-3e43-4cd4-9a46-3423251cbe4a req-ef8a8d28-db83-4b4e-9d01-234935654955 service nova] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] No waiting events found dispatching network-vif-unplugged-0add7ef0-687d-4486-842d-2d07c0d26449 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:10:25 user nova-compute[72766]: DEBUG nova.compute.manager [req-01f89daf-3e43-4cd4-9a46-3423251cbe4a req-ef8a8d28-db83-4b4e-9d01-234935654955 service nova] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Received event network-vif-unplugged-0add7ef0-687d-4486-842d-2d07c0d26449 for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:10:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-83084ccc-8e55-43dc-9a37-ffcb35a10922" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:10:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-83084ccc-8e55-43dc-9a37-ffcb35a10922" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:10:25 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:10:26 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Instance destroyed successfully.
Aug 14 23:10:26 user nova-compute[72766]: DEBUG nova.objects.instance [None req-76698fe6-15f8-477a-bb0d-ec6efcad4603 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lazy-loading 'resources' on Instance uuid 11e79581-a122-4c0a-8485-a8b6c62e73b8 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:10:26 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-76698fe6-15f8-477a-bb0d-ec6efcad4603 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T23:03:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-584854465',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-584854465',id=23,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ44/tjV8BW1ypYMZmiG7D1vfWXeB7Xr0eiDzs39QKWPjJ4VdMwqyWoKm6vbKzV3JsMUSI4O8FCswMnuL0W/+R28XJlRiL9zGXvdMjiPnmfiDPuJEi6nWJYbgddxoV1TcA==',key_name='tempest-keypair-1485779782',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:08:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3f36bd126bda43c6971bccdef2b1da91',ramdisk_id='',reservation_id='r-6wg52w6r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1828708750',owner_user_name='tempest-AttachVolumeShelveTestJSON-1828708750-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:08:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb167893135e4073928a60630ae7720c',uuid=11e79581-a122-4c0a-8485-a8b6c62e73b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0add7ef0-687d-4486-842d-2d07c0d26449", "address": "fa:16:3e:4a:df:6f", "network": {"id": "ed86b27c-3e64-4c0a-8824-9bf68068058a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-506861998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f36bd126bda43c6971bccdef2b1da91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0add7ef0-68", "ovs_interfaceid": "0add7ef0-687d-4486-842d-2d07c0d26449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:10:26 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-76698fe6-15f8-477a-bb0d-ec6efcad4603 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Converting VIF {"id": "0add7ef0-687d-4486-842d-2d07c0d26449", "address": "fa:16:3e:4a:df:6f", "network": {"id": "ed86b27c-3e64-4c0a-8824-9bf68068058a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-506861998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f36bd126bda43c6971bccdef2b1da91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0add7ef0-68", "ovs_interfaceid": "0add7ef0-687d-4486-842d-2d07c0d26449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:10:26 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-76698fe6-15f8-477a-bb0d-ec6efcad4603 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:df:6f,bridge_name='br-int',has_traffic_filtering=True,id=0add7ef0-687d-4486-842d-2d07c0d26449,network=Network(ed86b27c-3e64-4c0a-8824-9bf68068058a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0add7ef0-68') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:10:26 user nova-compute[72766]: DEBUG os_vif [None req-76698fe6-15f8-477a-bb0d-ec6efcad4603 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:df:6f,bridge_name='br-int',has_traffic_filtering=True,id=0add7ef0-687d-4486-842d-2d07c0d26449,network=Network(ed86b27c-3e64-4c0a-8824-9bf68068058a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0add7ef0-68') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:10:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0add7ef0-68, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:10:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:10:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:26 user nova-compute[72766]: INFO os_vif [None req-76698fe6-15f8-477a-bb0d-ec6efcad4603 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:df:6f,bridge_name='br-int',has_traffic_filtering=True,id=0add7ef0-687d-4486-842d-2d07c0d26449,network=Network(ed86b27c-3e64-4c0a-8824-9bf68068058a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0add7ef0-68')
Aug 14 23:10:26 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-76698fe6-15f8-477a-bb0d-ec6efcad4603 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Deleting instance files /opt/stack/data/nova/instances/11e79581-a122-4c0a-8485-a8b6c62e73b8_del
Aug 14 23:10:26 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-76698fe6-15f8-477a-bb0d-ec6efcad4603 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Deletion of /opt/stack/data/nova/instances/11e79581-a122-4c0a-8485-a8b6c62e73b8_del complete
Aug 14 23:10:26 user nova-compute[72766]: INFO nova.compute.manager [None req-76698fe6-15f8-477a-bb0d-ec6efcad4603 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 14 23:10:26 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-76698fe6-15f8-477a-bb0d-ec6efcad4603 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:10:26 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:10:26 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:10:26 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Updating instance_info_cache with network_info: [{"id": "cbbf0086-17e4-41a5-8893-cf8657faf6e5", "address": "fa:16:3e:22:4b:22", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbbf0086-17", "ovs_interfaceid": "cbbf0086-17e4-41a5-8893-cf8657faf6e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:10:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-83084ccc-8e55-43dc-9a37-ffcb35a10922" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:10:26 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:10:26 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:10:26 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:10:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:27 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:10:27 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Took 1.21 seconds to deallocate network for instance.
Aug 14 23:10:27 user nova-compute[72766]: DEBUG nova.compute.manager [req-5d73d949-2ede-42fb-ad5a-be45ad3c6c0d req-b70f5275-26c1-4a5a-8d2d-337f7430fdf3 service nova] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Received event network-vif-deleted-0add7ef0-687d-4486-842d-2d07c0d26449 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:10:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-76698fe6-15f8-477a-bb0d-ec6efcad4603 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:10:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-76698fe6-15f8-477a-bb0d-ec6efcad4603 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:10:27 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-76698fe6-15f8-477a-bb0d-ec6efcad4603 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:10:27 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-76698fe6-15f8-477a-bb0d-ec6efcad4603 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:10:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-76698fe6-15f8-477a-bb0d-ec6efcad4603 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.225s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:10:27 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-76698fe6-15f8-477a-bb0d-ec6efcad4603 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Deleted allocations for instance 11e79581-a122-4c0a-8485-a8b6c62e73b8
Aug 14 23:10:27 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:10:27 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:10:27 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:10:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-76698fe6-15f8-477a-bb0d-ec6efcad4603 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "11e79581-a122-4c0a-8485-a8b6c62e73b8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.511s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:10:27 user nova-compute[72766]: DEBUG nova.compute.manager [req-8cb7ab62-e786-40b3-a36f-55a5b9f26469 req-eea94c16-0300-4169-82a8-7c5d9ace00af service nova] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Received event network-vif-plugged-0add7ef0-687d-4486-842d-2d07c0d26449 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:10:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8cb7ab62-e786-40b3-a36f-55a5b9f26469 req-eea94c16-0300-4169-82a8-7c5d9ace00af service nova] Acquiring lock "11e79581-a122-4c0a-8485-a8b6c62e73b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:10:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8cb7ab62-e786-40b3-a36f-55a5b9f26469 req-eea94c16-0300-4169-82a8-7c5d9ace00af service nova] Lock "11e79581-a122-4c0a-8485-a8b6c62e73b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:10:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8cb7ab62-e786-40b3-a36f-55a5b9f26469 req-eea94c16-0300-4169-82a8-7c5d9ace00af service nova] Lock "11e79581-a122-4c0a-8485-a8b6c62e73b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:10:27 user nova-compute[72766]: DEBUG nova.compute.manager [req-8cb7ab62-e786-40b3-a36f-55a5b9f26469 req-eea94c16-0300-4169-82a8-7c5d9ace00af service nova] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] No waiting events found dispatching network-vif-plugged-0add7ef0-687d-4486-842d-2d07c0d26449 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:10:27 user nova-compute[72766]: WARNING nova.compute.manager [req-8cb7ab62-e786-40b3-a36f-55a5b9f26469 req-eea94c16-0300-4169-82a8-7c5d9ace00af service nova] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Received unexpected event network-vif-plugged-0add7ef0-687d-4486-842d-2d07c0d26449 for instance with vm_state deleted and task_state None.
Aug 14 23:10:28 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:10:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:10:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:10:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:10:28 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:10:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:10:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:10:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:10:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:10:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:10:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:10:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:10:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:10:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:10:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:10:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:10:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:10:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:10:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:10:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:10:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:10:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Acquiring lock "9ec72ed8-0c33-4e70-ae88-d7571c84de2a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:10:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "9ec72ed8-0c33-4e70-ae88-d7571c84de2a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:10:30 user nova-compute[72766]: DEBUG nova.compute.manager [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 23:10:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:10:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:10:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:10:30 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 23:10:30 user nova-compute[72766]: INFO nova.compute.claims [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Claim successful on node user
Aug 14 23:10:30 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:10:30 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:10:30 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=8400MB free_disk=25.464488983154297GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:10:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:10:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:31 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:10:31 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:10:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.769s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:10:31 user nova-compute[72766]: DEBUG nova.compute.manager [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 23:10:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.333s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:10:31 user nova-compute[72766]: DEBUG nova.compute.manager [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 23:10:31 user nova-compute[72766]: DEBUG nova.network.neutron [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 23:10:31 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 23:10:31 user nova-compute[72766]: DEBUG nova.compute.manager [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 23:10:31 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 3ff300ff-34fd-4e94-9d2d-681fb133ba32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:10:31 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance cbcf7851-e6f7-4f46-97cc-d773286ccddf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:10:31 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 66578337-cbff-4613-87a1-85ddabaebb2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:10:31 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 83084ccc-8e55-43dc-9a37-ffcb35a10922 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:10:31 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 71970b47-b09b-4492-9d99-a2be8b3b2042 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:10:31 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 9ec72ed8-0c33-4e70-ae88-d7571c84de2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:10:31 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:10:31 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:10:31 user nova-compute[72766]: DEBUG nova.policy [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fff2f6e64733493f905c23b2e15d4161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2329e260514d818d5af10aeeda498d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 23:10:31 user nova-compute[72766]: DEBUG nova.compute.manager [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 23:10:31 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 23:10:31 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Creating image(s)
Aug 14 23:10:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:10:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "/opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:10:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "/opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:10:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:10:31 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:10:31 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:10:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.193s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:10:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Acquiring lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:10:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:10:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:10:31 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:10:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.515s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:10:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.184s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:10:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a/disk 1073741824 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:10:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a/disk 1073741824" returned: 0 in 0.053s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:10:32 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:10:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:10:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.187s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:10:32 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a/disk. size=1073741824 {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 23:10:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:10:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:10:32 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Cannot resize image /opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a/disk to a smaller size. {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 23:10:32 user nova-compute[72766]: DEBUG nova.objects.instance [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lazy-loading 'migration_context' on Instance uuid 9ec72ed8-0c33-4e70-ae88-d7571c84de2a {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:10:32 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 23:10:32 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Ensure instance console log exists: /opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 23:10:32 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:10:32 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:10:32 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:10:32 user nova-compute[72766]: DEBUG nova.network.neutron [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Successfully created port: 53e31c0d-29ff-4d0d-8f3a-6a08a69c927e {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 23:10:32 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:10:32 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:10:32 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG nova.network.neutron [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Successfully updated port: 53e31c0d-29ff-4d0d-8f3a-6a08a69c927e {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Acquiring lock "refresh_cache-9ec72ed8-0c33-4e70-ae88-d7571c84de2a" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Acquired lock "refresh_cache-9ec72ed8-0c33-4e70-ae88-d7571c84de2a" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG nova.network.neutron [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-41bd093a-5ba7-4c4f-a85f-7e5d0bdbbed5 req-c5bd6441-90dd-4bbb-8932-6982540f4566 service nova] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Received event network-changed-53e31c0d-29ff-4d0d-8f3a-6a08a69c927e {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-41bd093a-5ba7-4c4f-a85f-7e5d0bdbbed5 req-c5bd6441-90dd-4bbb-8932-6982540f4566 service nova] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Refreshing instance network info cache due to event network-changed-53e31c0d-29ff-4d0d-8f3a-6a08a69c927e. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-41bd093a-5ba7-4c4f-a85f-7e5d0bdbbed5 req-c5bd6441-90dd-4bbb-8932-6982540f4566 service nova] Acquiring lock "refresh_cache-9ec72ed8-0c33-4e70-ae88-d7571c84de2a" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG nova.network.neutron [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG nova.network.neutron [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Updating instance_info_cache with network_info: [{"id": "53e31c0d-29ff-4d0d-8f3a-6a08a69c927e", "address": "fa:16:3e:ba:ba:ec", "network": {"id": "52ed808b-c840-47a7-aa8f-8055fd7bd1ef", "bridge": "br-int", "label": "tempest-TestStampPattern-1964150399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2329e260514d818d5af10aeeda498d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e31c0d-29", "ovs_interfaceid": "53e31c0d-29ff-4d0d-8f3a-6a08a69c927e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Releasing lock "refresh_cache-9ec72ed8-0c33-4e70-ae88-d7571c84de2a" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG nova.compute.manager [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Instance network_info: |[{"id": "53e31c0d-29ff-4d0d-8f3a-6a08a69c927e", "address": "fa:16:3e:ba:ba:ec", "network": {"id": "52ed808b-c840-47a7-aa8f-8055fd7bd1ef", "bridge": "br-int", "label": "tempest-TestStampPattern-1964150399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2329e260514d818d5af10aeeda498d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e31c0d-29", "ovs_interfaceid": "53e31c0d-29ff-4d0d-8f3a-6a08a69c927e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-41bd093a-5ba7-4c4f-a85f-7e5d0bdbbed5 req-c5bd6441-90dd-4bbb-8932-6982540f4566 service nova] Acquired lock "refresh_cache-9ec72ed8-0c33-4e70-ae88-d7571c84de2a" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG nova.network.neutron [req-41bd093a-5ba7-4c4f-a85f-7e5d0bdbbed5 req-c5bd6441-90dd-4bbb-8932-6982540f4566 service nova] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Refreshing network info cache for port 53e31c0d-29ff-4d0d-8f3a-6a08a69c927e {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Start _get_guest_xml network_info=[{"id": "53e31c0d-29ff-4d0d-8f3a-6a08a69c927e", "address": "fa:16:3e:ba:ba:ec", "network": {"id": "52ed808b-c840-47a7-aa8f-8055fd7bd1ef", "bridge": "br-int", "label": "tempest-TestStampPattern-1964150399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2329e260514d818d5af10aeeda498d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e31c0d-29", "ovs_interfaceid": "53e31c0d-29ff-4d0d-8f3a-6a08a69c927e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd2900d30-2c4c-4d57-9135-d45564c0c596'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:10:33 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:10:33 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:10:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:10:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1286106876',display_name='tempest-TestStampPattern-server-1286106876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1286106876',id=28,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpGwryUjtUrIoGUKk7UpA8gUykO9BhQbyJGpTNe51F8rSj8f9y24+iZRMzUrsprfERcHUFXZuW+wemEEJyvytSmT2p4zUjOXLeubfjibHmStVi+yhSgVVjf4UvXDmxC4g==',key_name='tempest-TestStampPattern-979334588',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc2329e260514d818d5af10aeeda498d',ramdisk_id='',reservation_id='r-33610i25',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1250368372',owner_user_name='tempest-TestStampPattern-1250368372-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:10:31Z,user_data=None,user_id='fff2f6e64733493f905c23b2e15d4161',uuid=9ec72ed8-0c33-4e70-ae88-d7571c84de2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53e31c0d-29ff-4d0d-8f3a-6a08a69c927e", "address": "fa:16:3e:ba:ba:ec", "network": {"id": "52ed808b-c840-47a7-aa8f-8055fd7bd1ef", "bridge": "br-int", "label": "tempest-TestStampPattern-1964150399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2329e260514d818d5af10aeeda498d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e31c0d-29", "ovs_interfaceid": "53e31c0d-29ff-4d0d-8f3a-6a08a69c927e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Converting VIF {"id": "53e31c0d-29ff-4d0d-8f3a-6a08a69c927e", "address": "fa:16:3e:ba:ba:ec", "network": {"id": "52ed808b-c840-47a7-aa8f-8055fd7bd1ef", "bridge": "br-int", "label": "tempest-TestStampPattern-1964150399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2329e260514d818d5af10aeeda498d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e31c0d-29", "ovs_interfaceid": "53e31c0d-29ff-4d0d-8f3a-6a08a69c927e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:ba:ec,bridge_name='br-int',has_traffic_filtering=True,id=53e31c0d-29ff-4d0d-8f3a-6a08a69c927e,network=Network(52ed808b-c840-47a7-aa8f-8055fd7bd1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53e31c0d-29') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG nova.objects.instance [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ec72ed8-0c33-4e70-ae88-d7571c84de2a {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:10:33 user nova-compute[72766]:   <uuid>9ec72ed8-0c33-4e70-ae88-d7571c84de2a</uuid>
Aug 14 23:10:33 user nova-compute[72766]:   <name>instance-0000001c</name>
Aug 14 23:10:33 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:10:33 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:10:33 user nova-compute[72766]:   <metadata>
Aug 14 23:10:33 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:10:33 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:10:33 user nova-compute[72766]:       <nova:name>tempest-TestStampPattern-server-1286106876</nova:name>
Aug 14 23:10:33 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:10:33</nova:creationTime>
Aug 14 23:10:33 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:10:33 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:10:33 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:10:33 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:10:33 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:10:33 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:10:33 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:10:33 user nova-compute[72766]:       <nova:owner>
Aug 14 23:10:33 user nova-compute[72766]:         <nova:user uuid="fff2f6e64733493f905c23b2e15d4161">tempest-TestStampPattern-1250368372-project-member</nova:user>
Aug 14 23:10:33 user nova-compute[72766]:         <nova:project uuid="bc2329e260514d818d5af10aeeda498d">tempest-TestStampPattern-1250368372</nova:project>
Aug 14 23:10:33 user nova-compute[72766]:       </nova:owner>
Aug 14 23:10:33 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 23:10:33 user nova-compute[72766]:       <nova:ports>
Aug 14 23:10:33 user nova-compute[72766]:         <nova:port uuid="53e31c0d-29ff-4d0d-8f3a-6a08a69c927e">
Aug 14 23:10:33 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 23:10:33 user nova-compute[72766]:         </nova:port>
Aug 14 23:10:33 user nova-compute[72766]:       </nova:ports>
Aug 14 23:10:33 user nova-compute[72766]:     </nova:instance>
Aug 14 23:10:33 user nova-compute[72766]:   </metadata>
Aug 14 23:10:33 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:10:33 user nova-compute[72766]:     <system>
Aug 14 23:10:33 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:10:33 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:10:33 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:10:33 user nova-compute[72766]:       <entry name="serial">9ec72ed8-0c33-4e70-ae88-d7571c84de2a</entry>
Aug 14 23:10:33 user nova-compute[72766]:       <entry name="uuid">9ec72ed8-0c33-4e70-ae88-d7571c84de2a</entry>
Aug 14 23:10:33 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:10:33 user nova-compute[72766]:     </system>
Aug 14 23:10:33 user nova-compute[72766]:   </sysinfo>
Aug 14 23:10:33 user nova-compute[72766]:   <os>
Aug 14 23:10:33 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:10:33 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:10:33 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:10:33 user nova-compute[72766]:   </os>
Aug 14 23:10:33 user nova-compute[72766]:   <features>
Aug 14 23:10:33 user nova-compute[72766]:     <acpi/>
Aug 14 23:10:33 user nova-compute[72766]:     <apic/>
Aug 14 23:10:33 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:10:33 user nova-compute[72766]:   </features>
Aug 14 23:10:33 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:10:33 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:10:33 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:10:33 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:10:33 user nova-compute[72766]:   </clock>
Aug 14 23:10:33 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:10:33 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:10:33 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:10:33 user nova-compute[72766]:   </cpu>
Aug 14 23:10:33 user nova-compute[72766]:   <devices>
Aug 14 23:10:33 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 23:10:33 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 23:10:33 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a/disk"/>
Aug 14 23:10:33 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:10:33 user nova-compute[72766]:     </disk>
Aug 14 23:10:33 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:10:33 user nova-compute[72766]:       <mac address="fa:16:3e:ba:ba:ec"/>
Aug 14 23:10:33 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:10:33 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:10:33 user nova-compute[72766]:       <target dev="tap53e31c0d-29"/>
Aug 14 23:10:33 user nova-compute[72766]:     </interface>
Aug 14 23:10:33 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:10:33 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a/console.log" append="off"/>
Aug 14 23:10:33 user nova-compute[72766]:     </serial>
Aug 14 23:10:33 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:10:33 user nova-compute[72766]:     <video>
Aug 14 23:10:33 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:10:33 user nova-compute[72766]:     </video>
Aug 14 23:10:33 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:10:33 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:10:33 user nova-compute[72766]:     </rng>
Aug 14 23:10:33 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:10:33 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:10:33 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:10:33 user nova-compute[72766]:     </memballoon>
Aug 14 23:10:33 user nova-compute[72766]:   </devices>
Aug 14 23:10:33 user nova-compute[72766]: </domain>
Aug 14 23:10:33 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:10:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1286106876',display_name='tempest-TestStampPattern-server-1286106876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1286106876',id=28,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpGwryUjtUrIoGUKk7UpA8gUykO9BhQbyJGpTNe51F8rSj8f9y24+iZRMzUrsprfERcHUFXZuW+wemEEJyvytSmT2p4zUjOXLeubfjibHmStVi+yhSgVVjf4UvXDmxC4g==',key_name='tempest-TestStampPattern-979334588',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc2329e260514d818d5af10aeeda498d',ramdisk_id='',reservation_id='r-33610i25',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1250368372',owner_user_name='tempest-TestStampPattern-1250368372-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:10:31Z,user_data=None,user_id='fff2f6e64733493f905c23b2e15d4161',uuid=9ec72ed8-0c33-4e70-ae88-d7571c84de2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53e31c0d-29ff-4d0d-8f3a-6a08a69c927e", "address": "fa:16:3e:ba:ba:ec", "network": {"id": "52ed808b-c840-47a7-aa8f-8055fd7bd1ef", "bridge": "br-int", "label": "tempest-TestStampPattern-1964150399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2329e260514d818d5af10aeeda498d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e31c0d-29", "ovs_interfaceid": "53e31c0d-29ff-4d0d-8f3a-6a08a69c927e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Converting VIF {"id": "53e31c0d-29ff-4d0d-8f3a-6a08a69c927e", "address": "fa:16:3e:ba:ba:ec", "network": {"id": "52ed808b-c840-47a7-aa8f-8055fd7bd1ef", "bridge": "br-int", "label": "tempest-TestStampPattern-1964150399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2329e260514d818d5af10aeeda498d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e31c0d-29", "ovs_interfaceid": "53e31c0d-29ff-4d0d-8f3a-6a08a69c927e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:ba:ec,bridge_name='br-int',has_traffic_filtering=True,id=53e31c0d-29ff-4d0d-8f3a-6a08a69c927e,network=Network(52ed808b-c840-47a7-aa8f-8055fd7bd1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53e31c0d-29') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG os_vif [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:ba:ec,bridge_name='br-int',has_traffic_filtering=True,id=53e31c0d-29ff-4d0d-8f3a-6a08a69c927e,network=Network(52ed808b-c840-47a7-aa8f-8055fd7bd1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53e31c0d-29') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53e31c0d-29, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap53e31c0d-29, col_values=(('external_ids', {'iface-id': '53e31c0d-29ff-4d0d-8f3a-6a08a69c927e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:ba:ec', 'vm-uuid': '9ec72ed8-0c33-4e70-ae88-d7571c84de2a'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:33 user nova-compute[72766]: INFO os_vif [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:ba:ec,bridge_name='br-int',has_traffic_filtering=True,id=53e31c0d-29ff-4d0d-8f3a-6a08a69c927e,network=Network(52ed808b-c840-47a7-aa8f-8055fd7bd1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53e31c0d-29')
Aug 14 23:10:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:10:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] No VIF found with MAC fa:16:3e:ba:ba:ec, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:10:34 user nova-compute[72766]: DEBUG nova.network.neutron [req-41bd093a-5ba7-4c4f-a85f-7e5d0bdbbed5 req-c5bd6441-90dd-4bbb-8932-6982540f4566 service nova] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Updated VIF entry in instance network info cache for port 53e31c0d-29ff-4d0d-8f3a-6a08a69c927e. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:10:34 user nova-compute[72766]: DEBUG nova.network.neutron [req-41bd093a-5ba7-4c4f-a85f-7e5d0bdbbed5 req-c5bd6441-90dd-4bbb-8932-6982540f4566 service nova] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Updating instance_info_cache with network_info: [{"id": "53e31c0d-29ff-4d0d-8f3a-6a08a69c927e", "address": "fa:16:3e:ba:ba:ec", "network": {"id": "52ed808b-c840-47a7-aa8f-8055fd7bd1ef", "bridge": "br-int", "label": "tempest-TestStampPattern-1964150399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2329e260514d818d5af10aeeda498d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e31c0d-29", "ovs_interfaceid": "53e31c0d-29ff-4d0d-8f3a-6a08a69c927e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:10:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-41bd093a-5ba7-4c4f-a85f-7e5d0bdbbed5 req-c5bd6441-90dd-4bbb-8932-6982540f4566 service nova] Releasing lock "refresh_cache-9ec72ed8-0c33-4e70-ae88-d7571c84de2a" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:10:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:35 user nova-compute[72766]: DEBUG nova.compute.manager [req-0ef41bb6-3161-4f72-8995-adb7225bcf00 req-f2b8093c-b612-4d15-9108-2ab1faae6f54 service nova] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Received event network-vif-plugged-53e31c0d-29ff-4d0d-8f3a-6a08a69c927e {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:10:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0ef41bb6-3161-4f72-8995-adb7225bcf00 req-f2b8093c-b612-4d15-9108-2ab1faae6f54 service nova] Acquiring lock "9ec72ed8-0c33-4e70-ae88-d7571c84de2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:10:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0ef41bb6-3161-4f72-8995-adb7225bcf00 req-f2b8093c-b612-4d15-9108-2ab1faae6f54 service nova] Lock "9ec72ed8-0c33-4e70-ae88-d7571c84de2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:10:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0ef41bb6-3161-4f72-8995-adb7225bcf00 req-f2b8093c-b612-4d15-9108-2ab1faae6f54 service nova] Lock "9ec72ed8-0c33-4e70-ae88-d7571c84de2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:10:35 user nova-compute[72766]: DEBUG nova.compute.manager [req-0ef41bb6-3161-4f72-8995-adb7225bcf00 req-f2b8093c-b612-4d15-9108-2ab1faae6f54 service nova] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] No waiting events found dispatching network-vif-plugged-53e31c0d-29ff-4d0d-8f3a-6a08a69c927e {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:10:35 user nova-compute[72766]: WARNING nova.compute.manager [req-0ef41bb6-3161-4f72-8995-adb7225bcf00 req-f2b8093c-b612-4d15-9108-2ab1faae6f54 service nova] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Received unexpected event network-vif-plugged-53e31c0d-29ff-4d0d-8f3a-6a08a69c927e for instance with vm_state building and task_state spawning.
Aug 14 23:10:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:37 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054637.1282017, 9ec72ed8-0c33-4e70-ae88-d7571c84de2a => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:10:37 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] VM Resumed (Lifecycle Event)
Aug 14 23:10:37 user nova-compute[72766]: DEBUG nova.compute.manager [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:10:37 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 23:10:37 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Instance spawned successfully.
Aug 14 23:10:37 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 23:10:37 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:10:37 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:10:37 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:10:37 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:10:37 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:10:37 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:10:37 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:10:37 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:10:37 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:10:37 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054637.130329, 9ec72ed8-0c33-4e70-ae88-d7571c84de2a => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:10:37 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] VM Started (Lifecycle Event)
Aug 14 23:10:37 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:10:37 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:10:37 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:10:37 user nova-compute[72766]: INFO nova.compute.manager [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Took 5.73 seconds to spawn the instance on the hypervisor.
Aug 14 23:10:37 user nova-compute[72766]: DEBUG nova.compute.manager [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:10:37 user nova-compute[72766]: INFO nova.compute.manager [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Took 6.89 seconds to build instance.
Aug 14 23:10:37 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1f10c87f-7772-4e5b-b85a-f7e5a5698202 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "9ec72ed8-0c33-4e70-ae88-d7571c84de2a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.005s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:10:37 user nova-compute[72766]: DEBUG nova.compute.manager [req-bbc174b9-3759-46aa-884d-860833c5c0a5 req-5391be9f-9e70-4bf8-b9b8-c3cf483406c2 service nova] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Received event network-vif-plugged-53e31c0d-29ff-4d0d-8f3a-6a08a69c927e {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:10:37 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-bbc174b9-3759-46aa-884d-860833c5c0a5 req-5391be9f-9e70-4bf8-b9b8-c3cf483406c2 service nova] Acquiring lock "9ec72ed8-0c33-4e70-ae88-d7571c84de2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:10:37 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-bbc174b9-3759-46aa-884d-860833c5c0a5 req-5391be9f-9e70-4bf8-b9b8-c3cf483406c2 service nova] Lock "9ec72ed8-0c33-4e70-ae88-d7571c84de2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:10:37 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-bbc174b9-3759-46aa-884d-860833c5c0a5 req-5391be9f-9e70-4bf8-b9b8-c3cf483406c2 service nova] Lock "9ec72ed8-0c33-4e70-ae88-d7571c84de2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:10:37 user nova-compute[72766]: DEBUG nova.compute.manager [req-bbc174b9-3759-46aa-884d-860833c5c0a5 req-5391be9f-9e70-4bf8-b9b8-c3cf483406c2 service nova] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] No waiting events found dispatching network-vif-plugged-53e31c0d-29ff-4d0d-8f3a-6a08a69c927e {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:10:37 user nova-compute[72766]: WARNING nova.compute.manager [req-bbc174b9-3759-46aa-884d-860833c5c0a5 req-5391be9f-9e70-4bf8-b9b8-c3cf483406c2 service nova] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Received unexpected event network-vif-plugged-53e31c0d-29ff-4d0d-8f3a-6a08a69c927e for instance with vm_state active and task_state None.
Aug 14 23:10:37 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:39 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:41 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692054626.026724, 11e79581-a122-4c0a-8485-a8b6c62e73b8 => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:10:41 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] VM Stopped (Lifecycle Event)
Aug 14 23:10:41 user nova-compute[72766]: DEBUG nova.compute.manager [None req-739781f2-7eee-4323-8ef8-7770fffce40e None None] [instance: 11e79581-a122-4c0a-8485-a8b6c62e73b8] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:10:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:41 user nova-compute[72766]: DEBUG nova.compute.manager [None req-8d50934b-bcbb-42d6-a055-c5de3892c81c tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:10:41 user nova-compute[72766]: INFO nova.compute.manager [None req-8d50934b-bcbb-42d6-a055-c5de3892c81c tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] instance snapshotting
Aug 14 23:10:41 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-8d50934b-bcbb-42d6-a055-c5de3892c81c tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Beginning live snapshot process
Aug 14 23:10:41 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-8d50934b-bcbb-42d6-a055-c5de3892c81c tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk --force-share --output=json -f qcow2 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:10:42 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-8d50934b-bcbb-42d6-a055-c5de3892c81c tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk --force-share --output=json -f qcow2" returned: 0 in 0.196s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:10:42 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-8d50934b-bcbb-42d6-a055-c5de3892c81c tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk --force-share --output=json -f qcow2 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:10:42 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-8d50934b-bcbb-42d6-a055-c5de3892c81c tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:10:42 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-8d50934b-bcbb-42d6-a055-c5de3892c81c tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:10:42 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-8d50934b-bcbb-42d6-a055-c5de3892c81c tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.183s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:10:42 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-8d50934b-bcbb-42d6-a055-c5de3892c81c tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpkdsl1mj4/c8a6def648f94618a0c0a1a353cbe8be.delta 1073741824 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:10:42 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-8d50934b-bcbb-42d6-a055-c5de3892c81c tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpkdsl1mj4/c8a6def648f94618a0c0a1a353cbe8be.delta 1073741824" returned: 0 in 0.066s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:10:42 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-8d50934b-bcbb-42d6-a055-c5de3892c81c tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 14 23:10:43 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-8d50934b-bcbb-42d6-a055-c5de3892c81c tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72766) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 23:10:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:43 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-8d50934b-bcbb-42d6-a055-c5de3892c81c tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72766) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 23:10:43 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-8d50934b-bcbb-42d6-a055-c5de3892c81c tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 14 23:10:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:43 user nova-compute[72766]: DEBUG nova.privsep.utils [None req-8d50934b-bcbb-42d6-a055-c5de3892c81c tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72766) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 23:10:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-8d50934b-bcbb-42d6-a055-c5de3892c81c tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpkdsl1mj4/c8a6def648f94618a0c0a1a353cbe8be.delta /opt/stack/data/nova/instances/snapshots/tmpkdsl1mj4/c8a6def648f94618a0c0a1a353cbe8be {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:10:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:44 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-8d50934b-bcbb-42d6-a055-c5de3892c81c tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpkdsl1mj4/c8a6def648f94618a0c0a1a353cbe8be.delta /opt/stack/data/nova/instances/snapshots/tmpkdsl1mj4/c8a6def648f94618a0c0a1a353cbe8be" returned: 0 in 0.738s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:10:44 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-8d50934b-bcbb-42d6-a055-c5de3892c81c tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Snapshot extracted, beginning image upload
Aug 14 23:10:47 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-8d50934b-bcbb-42d6-a055-c5de3892c81c tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Snapshot image upload complete
Aug 14 23:10:47 user nova-compute[72766]: INFO nova.compute.manager [None req-8d50934b-bcbb-42d6-a055-c5de3892c81c tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Took 5.67 seconds to snapshot the instance on the hypervisor.
Aug 14 23:10:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Acquiring lock "88009c57-377b-4636-ba54-1945c1bc7928" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:10:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lock "88009c57-377b-4636-ba54-1945c1bc7928" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:10:47 user nova-compute[72766]: DEBUG nova.compute.manager [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 23:10:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:10:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:10:47 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 23:10:47 user nova-compute[72766]: INFO nova.compute.claims [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Claim successful on node user
Aug 14 23:10:48 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:10:48 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:10:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.461s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:10:48 user nova-compute[72766]: DEBUG nova.compute.manager [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 23:10:48 user nova-compute[72766]: DEBUG nova.compute.manager [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 23:10:48 user nova-compute[72766]: DEBUG nova.network.neutron [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 23:10:48 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 23:10:48 user nova-compute[72766]: DEBUG nova.compute.manager [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 23:10:48 user nova-compute[72766]: DEBUG nova.policy [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '55a41318297e40a886cd9b3a2364ea28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4877b20c8c2a4034923a341600e1d69f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 23:10:48 user nova-compute[72766]: DEBUG nova.compute.manager [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 23:10:48 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 23:10:48 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Creating image(s)
Aug 14 23:10:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Acquiring lock "/opt/stack/data/nova/instances/88009c57-377b-4636-ba54-1945c1bc7928/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:10:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lock "/opt/stack/data/nova/instances/88009c57-377b-4636-ba54-1945c1bc7928/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:10:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lock "/opt/stack/data/nova/instances/88009c57-377b-4636-ba54-1945c1bc7928/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:10:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:10:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.170s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:10:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Acquiring lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:10:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:10:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:10:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.177s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:10:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/88009c57-377b-4636-ba54-1945c1bc7928/disk 1073741824 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:10:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/88009c57-377b-4636-ba54-1945c1bc7928/disk 1073741824" returned: 0 in 0.070s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:10:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:10:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:10:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.170s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:10:49 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Checking if we can resize image /opt/stack/data/nova/instances/88009c57-377b-4636-ba54-1945c1bc7928/disk. size=1073741824 {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 23:10:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88009c57-377b-4636-ba54-1945c1bc7928/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:10:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88009c57-377b-4636-ba54-1945c1bc7928/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:10:49 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Cannot resize image /opt/stack/data/nova/instances/88009c57-377b-4636-ba54-1945c1bc7928/disk to a smaller size. {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 23:10:49 user nova-compute[72766]: DEBUG nova.objects.instance [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lazy-loading 'migration_context' on Instance uuid 88009c57-377b-4636-ba54-1945c1bc7928 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:10:49 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 23:10:49 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Ensure instance console log exists: /opt/stack/data/nova/instances/88009c57-377b-4636-ba54-1945c1bc7928/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 23:10:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:10:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:10:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:10:49 user nova-compute[72766]: DEBUG nova.network.neutron [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Successfully created port: e2f51f15-395f-4f23-b946-0da2eef80a35 {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG nova.network.neutron [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Successfully updated port: e2f51f15-395f-4f23-b946-0da2eef80a35 {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Acquiring lock "refresh_cache-88009c57-377b-4636-ba54-1945c1bc7928" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Acquired lock "refresh_cache-88009c57-377b-4636-ba54-1945c1bc7928" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG nova.network.neutron [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG nova.compute.manager [req-550e9430-962c-4215-812b-02a7721aafd8 req-49de3985-1884-4603-9ef1-017fb57aad2e service nova] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Received event network-changed-e2f51f15-395f-4f23-b946-0da2eef80a35 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG nova.compute.manager [req-550e9430-962c-4215-812b-02a7721aafd8 req-49de3985-1884-4603-9ef1-017fb57aad2e service nova] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Refreshing instance network info cache due to event network-changed-e2f51f15-395f-4f23-b946-0da2eef80a35. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-550e9430-962c-4215-812b-02a7721aafd8 req-49de3985-1884-4603-9ef1-017fb57aad2e service nova] Acquiring lock "refresh_cache-88009c57-377b-4636-ba54-1945c1bc7928" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG nova.network.neutron [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG nova.network.neutron [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Updating instance_info_cache with network_info: [{"id": "e2f51f15-395f-4f23-b946-0da2eef80a35", "address": "fa:16:3e:72:6d:7f", "network": {"id": "d68d40ee-41e8-4e08-a00d-fc9c322c578a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1597134173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4877b20c8c2a4034923a341600e1d69f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f51f15-39", "ovs_interfaceid": "e2f51f15-395f-4f23-b946-0da2eef80a35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Releasing lock "refresh_cache-88009c57-377b-4636-ba54-1945c1bc7928" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG nova.compute.manager [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Instance network_info: |[{"id": "e2f51f15-395f-4f23-b946-0da2eef80a35", "address": "fa:16:3e:72:6d:7f", "network": {"id": "d68d40ee-41e8-4e08-a00d-fc9c322c578a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1597134173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4877b20c8c2a4034923a341600e1d69f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f51f15-39", "ovs_interfaceid": "e2f51f15-395f-4f23-b946-0da2eef80a35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-550e9430-962c-4215-812b-02a7721aafd8 req-49de3985-1884-4603-9ef1-017fb57aad2e service nova] Acquired lock "refresh_cache-88009c57-377b-4636-ba54-1945c1bc7928" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG nova.network.neutron [req-550e9430-962c-4215-812b-02a7721aafd8 req-49de3985-1884-4603-9ef1-017fb57aad2e service nova] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Refreshing network info cache for port e2f51f15-395f-4f23-b946-0da2eef80a35 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Start _get_guest_xml network_info=[{"id": "e2f51f15-395f-4f23-b946-0da2eef80a35", "address": "fa:16:3e:72:6d:7f", "network": {"id": "d68d40ee-41e8-4e08-a00d-fc9c322c578a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1597134173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4877b20c8c2a4034923a341600e1d69f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f51f15-39", "ovs_interfaceid": "e2f51f15-395f-4f23-b946-0da2eef80a35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd2900d30-2c4c-4d57-9135-d45564c0c596'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:10:50 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:10:50 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:10:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:10:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-846513150',display_name='tempest-TestServerVolumeAttachmentScenario-server-846513150',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-846513150',id=29,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAX/APmKrGrsBogrrV45YBTtFKQrrmIRSmv0NInnv5Gc1zMcYNTFgMpDzY0RUIDZ+fYjFWMy9wJUsBWFv8ayakIu0+uEg2jeXzf2LlQCzx4kxsYhIIbU3S59akGehku0vA==',key_name='tempest-keypair-1252254229',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4877b20c8c2a4034923a341600e1d69f',ramdisk_id='',reservation_id='r-p6clntjk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-878359931',owner_user_name='tempest-TestServerVolumeAttachmentScenario-878359931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:10:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55a41318297e40a886cd9b3a2364ea28',uuid=88009c57-377b-4636-ba54-1945c1bc7928,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2f51f15-395f-4f23-b946-0da2eef80a35", "address": "fa:16:3e:72:6d:7f", "network": {"id": "d68d40ee-41e8-4e08-a00d-fc9c322c578a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1597134173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4877b20c8c2a4034923a341600e1d69f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f51f15-39", "ovs_interfaceid": "e2f51f15-395f-4f23-b946-0da2eef80a35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Converting VIF {"id": "e2f51f15-395f-4f23-b946-0da2eef80a35", "address": "fa:16:3e:72:6d:7f", "network": {"id": "d68d40ee-41e8-4e08-a00d-fc9c322c578a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1597134173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4877b20c8c2a4034923a341600e1d69f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f51f15-39", "ovs_interfaceid": "e2f51f15-395f-4f23-b946-0da2eef80a35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:6d:7f,bridge_name='br-int',has_traffic_filtering=True,id=e2f51f15-395f-4f23-b946-0da2eef80a35,network=Network(d68d40ee-41e8-4e08-a00d-fc9c322c578a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2f51f15-39') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG nova.objects.instance [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lazy-loading 'pci_devices' on Instance uuid 88009c57-377b-4636-ba54-1945c1bc7928 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:10:50 user nova-compute[72766]:   <uuid>88009c57-377b-4636-ba54-1945c1bc7928</uuid>
Aug 14 23:10:50 user nova-compute[72766]:   <name>instance-0000001d</name>
Aug 14 23:10:50 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:10:50 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:10:50 user nova-compute[72766]:   <metadata>
Aug 14 23:10:50 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:10:50 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:10:50 user nova-compute[72766]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-846513150</nova:name>
Aug 14 23:10:50 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:10:50</nova:creationTime>
Aug 14 23:10:50 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:10:50 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:10:50 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:10:50 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:10:50 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:10:50 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:10:50 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:10:50 user nova-compute[72766]:       <nova:owner>
Aug 14 23:10:50 user nova-compute[72766]:         <nova:user uuid="55a41318297e40a886cd9b3a2364ea28">tempest-TestServerVolumeAttachmentScenario-878359931-project-member</nova:user>
Aug 14 23:10:50 user nova-compute[72766]:         <nova:project uuid="4877b20c8c2a4034923a341600e1d69f">tempest-TestServerVolumeAttachmentScenario-878359931</nova:project>
Aug 14 23:10:50 user nova-compute[72766]:       </nova:owner>
Aug 14 23:10:50 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 23:10:50 user nova-compute[72766]:       <nova:ports>
Aug 14 23:10:50 user nova-compute[72766]:         <nova:port uuid="e2f51f15-395f-4f23-b946-0da2eef80a35">
Aug 14 23:10:50 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 23:10:50 user nova-compute[72766]:         </nova:port>
Aug 14 23:10:50 user nova-compute[72766]:       </nova:ports>
Aug 14 23:10:50 user nova-compute[72766]:     </nova:instance>
Aug 14 23:10:50 user nova-compute[72766]:   </metadata>
Aug 14 23:10:50 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:10:50 user nova-compute[72766]:     <system>
Aug 14 23:10:50 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:10:50 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:10:50 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:10:50 user nova-compute[72766]:       <entry name="serial">88009c57-377b-4636-ba54-1945c1bc7928</entry>
Aug 14 23:10:50 user nova-compute[72766]:       <entry name="uuid">88009c57-377b-4636-ba54-1945c1bc7928</entry>
Aug 14 23:10:50 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:10:50 user nova-compute[72766]:     </system>
Aug 14 23:10:50 user nova-compute[72766]:   </sysinfo>
Aug 14 23:10:50 user nova-compute[72766]:   <os>
Aug 14 23:10:50 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:10:50 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:10:50 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:10:50 user nova-compute[72766]:   </os>
Aug 14 23:10:50 user nova-compute[72766]:   <features>
Aug 14 23:10:50 user nova-compute[72766]:     <acpi/>
Aug 14 23:10:50 user nova-compute[72766]:     <apic/>
Aug 14 23:10:50 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:10:50 user nova-compute[72766]:   </features>
Aug 14 23:10:50 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:10:50 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:10:50 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:10:50 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:10:50 user nova-compute[72766]:   </clock>
Aug 14 23:10:50 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:10:50 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:10:50 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:10:50 user nova-compute[72766]:   </cpu>
Aug 14 23:10:50 user nova-compute[72766]:   <devices>
Aug 14 23:10:50 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 23:10:50 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 23:10:50 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/88009c57-377b-4636-ba54-1945c1bc7928/disk"/>
Aug 14 23:10:50 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:10:50 user nova-compute[72766]:     </disk>
Aug 14 23:10:50 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:10:50 user nova-compute[72766]:       <mac address="fa:16:3e:72:6d:7f"/>
Aug 14 23:10:50 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:10:50 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:10:50 user nova-compute[72766]:       <target dev="tape2f51f15-39"/>
Aug 14 23:10:50 user nova-compute[72766]:     </interface>
Aug 14 23:10:50 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:10:50 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/88009c57-377b-4636-ba54-1945c1bc7928/console.log" append="off"/>
Aug 14 23:10:50 user nova-compute[72766]:     </serial>
Aug 14 23:10:50 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:10:50 user nova-compute[72766]:     <video>
Aug 14 23:10:50 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:10:50 user nova-compute[72766]:     </video>
Aug 14 23:10:50 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:10:50 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:10:50 user nova-compute[72766]:     </rng>
Aug 14 23:10:50 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:10:50 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:10:50 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:10:50 user nova-compute[72766]:     </memballoon>
Aug 14 23:10:50 user nova-compute[72766]:   </devices>
Aug 14 23:10:50 user nova-compute[72766]: </domain>
Aug 14 23:10:50 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:10:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-846513150',display_name='tempest-TestServerVolumeAttachmentScenario-server-846513150',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-846513150',id=29,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAX/APmKrGrsBogrrV45YBTtFKQrrmIRSmv0NInnv5Gc1zMcYNTFgMpDzY0RUIDZ+fYjFWMy9wJUsBWFv8ayakIu0+uEg2jeXzf2LlQCzx4kxsYhIIbU3S59akGehku0vA==',key_name='tempest-keypair-1252254229',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4877b20c8c2a4034923a341600e1d69f',ramdisk_id='',reservation_id='r-p6clntjk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-878359931',owner_user_name='tempest-TestServerVolumeAttachmentScenario-878359931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:10:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55a41318297e40a886cd9b3a2364ea28',uuid=88009c57-377b-4636-ba54-1945c1bc7928,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2f51f15-395f-4f23-b946-0da2eef80a35", "address": "fa:16:3e:72:6d:7f", "network": {"id": "d68d40ee-41e8-4e08-a00d-fc9c322c578a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1597134173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4877b20c8c2a4034923a341600e1d69f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f51f15-39", "ovs_interfaceid": "e2f51f15-395f-4f23-b946-0da2eef80a35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Converting VIF {"id": "e2f51f15-395f-4f23-b946-0da2eef80a35", "address": "fa:16:3e:72:6d:7f", "network": {"id": "d68d40ee-41e8-4e08-a00d-fc9c322c578a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1597134173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4877b20c8c2a4034923a341600e1d69f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f51f15-39", "ovs_interfaceid": "e2f51f15-395f-4f23-b946-0da2eef80a35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:6d:7f,bridge_name='br-int',has_traffic_filtering=True,id=e2f51f15-395f-4f23-b946-0da2eef80a35,network=Network(d68d40ee-41e8-4e08-a00d-fc9c322c578a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2f51f15-39') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG os_vif [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:6d:7f,bridge_name='br-int',has_traffic_filtering=True,id=e2f51f15-395f-4f23-b946-0da2eef80a35,network=Network(d68d40ee-41e8-4e08-a00d-fc9c322c578a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2f51f15-39') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2f51f15-39, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape2f51f15-39, col_values=(('external_ids', {'iface-id': 'e2f51f15-395f-4f23-b946-0da2eef80a35', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:6d:7f', 'vm-uuid': '88009c57-377b-4636-ba54-1945c1bc7928'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:50 user nova-compute[72766]: INFO os_vif [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:6d:7f,bridge_name='br-int',has_traffic_filtering=True,id=e2f51f15-395f-4f23-b946-0da2eef80a35,network=Network(d68d40ee-41e8-4e08-a00d-fc9c322c578a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2f51f15-39')
Aug 14 23:10:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:10:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] No VIF found with MAC fa:16:3e:72:6d:7f, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:10:51 user nova-compute[72766]: DEBUG nova.network.neutron [req-550e9430-962c-4215-812b-02a7721aafd8 req-49de3985-1884-4603-9ef1-017fb57aad2e service nova] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Updated VIF entry in instance network info cache for port e2f51f15-395f-4f23-b946-0da2eef80a35. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:10:51 user nova-compute[72766]: DEBUG nova.network.neutron [req-550e9430-962c-4215-812b-02a7721aafd8 req-49de3985-1884-4603-9ef1-017fb57aad2e service nova] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Updating instance_info_cache with network_info: [{"id": "e2f51f15-395f-4f23-b946-0da2eef80a35", "address": "fa:16:3e:72:6d:7f", "network": {"id": "d68d40ee-41e8-4e08-a00d-fc9c322c578a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1597134173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4877b20c8c2a4034923a341600e1d69f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f51f15-39", "ovs_interfaceid": "e2f51f15-395f-4f23-b946-0da2eef80a35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:10:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-550e9430-962c-4215-812b-02a7721aafd8 req-49de3985-1884-4603-9ef1-017fb57aad2e service nova] Releasing lock "refresh_cache-88009c57-377b-4636-ba54-1945c1bc7928" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:10:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:52 user nova-compute[72766]: DEBUG nova.compute.manager [req-87a45360-d585-46f6-9aeb-6bf8800babd0 req-1472b104-623e-4be6-9e3f-ca183fe508c8 service nova] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Received event network-vif-plugged-e2f51f15-395f-4f23-b946-0da2eef80a35 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:10:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-87a45360-d585-46f6-9aeb-6bf8800babd0 req-1472b104-623e-4be6-9e3f-ca183fe508c8 service nova] Acquiring lock "88009c57-377b-4636-ba54-1945c1bc7928-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:10:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-87a45360-d585-46f6-9aeb-6bf8800babd0 req-1472b104-623e-4be6-9e3f-ca183fe508c8 service nova] Lock "88009c57-377b-4636-ba54-1945c1bc7928-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:10:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-87a45360-d585-46f6-9aeb-6bf8800babd0 req-1472b104-623e-4be6-9e3f-ca183fe508c8 service nova] Lock "88009c57-377b-4636-ba54-1945c1bc7928-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:10:52 user nova-compute[72766]: DEBUG nova.compute.manager [req-87a45360-d585-46f6-9aeb-6bf8800babd0 req-1472b104-623e-4be6-9e3f-ca183fe508c8 service nova] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] No waiting events found dispatching network-vif-plugged-e2f51f15-395f-4f23-b946-0da2eef80a35 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:10:52 user nova-compute[72766]: WARNING nova.compute.manager [req-87a45360-d585-46f6-9aeb-6bf8800babd0 req-1472b104-623e-4be6-9e3f-ca183fe508c8 service nova] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Received unexpected event network-vif-plugged-e2f51f15-395f-4f23-b946-0da2eef80a35 for instance with vm_state building and task_state spawning.
Aug 14 23:10:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:54 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054654.1431296, 88009c57-377b-4636-ba54-1945c1bc7928 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:10:54 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] VM Resumed (Lifecycle Event)
Aug 14 23:10:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:10:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 23:10:54 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Instance spawned successfully.
Aug 14 23:10:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 23:10:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:10:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:10:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:10:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:10:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:10:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:10:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:10:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:10:54 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:10:54 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054654.1467574, 88009c57-377b-4636-ba54-1945c1bc7928 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:10:54 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] VM Started (Lifecycle Event)
Aug 14 23:10:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:10:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:10:54 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:10:54 user nova-compute[72766]: INFO nova.compute.manager [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Took 5.62 seconds to spawn the instance on the hypervisor.
Aug 14 23:10:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:10:54 user nova-compute[72766]: INFO nova.compute.manager [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Took 6.39 seconds to build instance.
Aug 14 23:10:54 user nova-compute[72766]: DEBUG nova.compute.manager [req-d14c06fa-0f84-42f2-a39d-c518c0751c19 req-4f21f246-df39-46ef-bce5-a5b6ad719848 service nova] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Received event network-vif-plugged-e2f51f15-395f-4f23-b946-0da2eef80a35 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:10:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d14c06fa-0f84-42f2-a39d-c518c0751c19 req-4f21f246-df39-46ef-bce5-a5b6ad719848 service nova] Acquiring lock "88009c57-377b-4636-ba54-1945c1bc7928-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:10:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d14c06fa-0f84-42f2-a39d-c518c0751c19 req-4f21f246-df39-46ef-bce5-a5b6ad719848 service nova] Lock "88009c57-377b-4636-ba54-1945c1bc7928-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:10:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d14c06fa-0f84-42f2-a39d-c518c0751c19 req-4f21f246-df39-46ef-bce5-a5b6ad719848 service nova] Lock "88009c57-377b-4636-ba54-1945c1bc7928-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:10:54 user nova-compute[72766]: DEBUG nova.compute.manager [req-d14c06fa-0f84-42f2-a39d-c518c0751c19 req-4f21f246-df39-46ef-bce5-a5b6ad719848 service nova] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] No waiting events found dispatching network-vif-plugged-e2f51f15-395f-4f23-b946-0da2eef80a35 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:10:54 user nova-compute[72766]: WARNING nova.compute.manager [req-d14c06fa-0f84-42f2-a39d-c518c0751c19 req-4f21f246-df39-46ef-bce5-a5b6ad719848 service nova] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Received unexpected event network-vif-plugged-e2f51f15-395f-4f23-b946-0da2eef80a35 for instance with vm_state active and task_state None.
Aug 14 23:10:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-674d268e-3fda-4199-98b5-94b0dcd871e0 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lock "88009c57-377b-4636-ba54-1945c1bc7928" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.479s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:10:55 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:10:59 user nova-compute[72766]: DEBUG nova.objects.instance [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lazy-loading 'flavor' on Instance uuid 66578337-cbff-4613-87a1-85ddabaebb2d {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:10:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquiring lock "refresh_cache-66578337-cbff-4613-87a1-85ddabaebb2d" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:10:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquired lock "refresh_cache-66578337-cbff-4613-87a1-85ddabaebb2d" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:10:59 user nova-compute[72766]: DEBUG nova.network.neutron [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:10:59 user nova-compute[72766]: DEBUG nova.objects.instance [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lazy-loading 'info_cache' on Instance uuid 66578337-cbff-4613-87a1-85ddabaebb2d {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:11:00 user nova-compute[72766]: DEBUG nova.network.neutron [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Updating instance_info_cache with network_info: [{"id": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "address": "fa:16:3e:e2:97:1e", "network": {"id": "b375da9b-b613-4a88-a262-962f959597b9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-462508113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1dd09415664f1aa0b0dbdeeb4b8d32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffc1761b-5d", "ovs_interfaceid": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:11:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Releasing lock "refresh_cache-66578337-cbff-4613-87a1-85ddabaebb2d" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:11:00 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Instance destroyed successfully.
Aug 14 23:11:00 user nova-compute[72766]: DEBUG nova.objects.instance [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lazy-loading 'resources' on Instance uuid 66578337-cbff-4613-87a1-85ddabaebb2d {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:11:00 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:03:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-217587435',display_name='tempest-AttachVolumeTestJSON-server-217587435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-217587435',id=21,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBINZx5RlQmHKeHXxfdC+NXwuqcWxgRblOsB0YY2uiI6sAZZohfv46zguEF36eLiA7VkgzN1UzneQgr1/yAGU0LFY6JMqRhzyWlR9BBcwz/CmcDywCLsqGwbsFhgR7C+vTQ==',key_name='tempest-keypair-1163729093',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:03:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3b1dd09415664f1aa0b0dbdeeb4b8d32',ramdisk_id='',reservation_id='r-p88w362t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-716158533',owner_user_name='tempest-AttachVolumeTestJSON-716158533-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:09:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a41813929144571a3306300dbf6f485',uuid=66578337-cbff-4613-87a1-85ddabaebb2d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "address": "fa:16:3e:e2:97:1e", "network": {"id": "b375da9b-b613-4a88-a262-962f959597b9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-462508113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1dd09415664f1aa0b0dbdeeb4b8d32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffc1761b-5d", "ovs_interfaceid": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:11:00 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Converting VIF {"id": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "address": "fa:16:3e:e2:97:1e", "network": {"id": "b375da9b-b613-4a88-a262-962f959597b9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-462508113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1dd09415664f1aa0b0dbdeeb4b8d32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffc1761b-5d", "ovs_interfaceid": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:11:00 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:97:1e,bridge_name='br-int',has_traffic_filtering=True,id=ffc1761b-5d95-4c58-9b92-b6b43b4823a6,network=Network(b375da9b-b613-4a88-a262-962f959597b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffc1761b-5d') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:11:00 user nova-compute[72766]: DEBUG os_vif [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:97:1e,bridge_name='br-int',has_traffic_filtering=True,id=ffc1761b-5d95-4c58-9b92-b6b43b4823a6,network=Network(b375da9b-b613-4a88-a262-962f959597b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffc1761b-5d') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:11:00 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:11:00 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapffc1761b-5d, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:11:00 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:11:00 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:11:00 user nova-compute[72766]: INFO os_vif [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:97:1e,bridge_name='br-int',has_traffic_filtering=True,id=ffc1761b-5d95-4c58-9b92-b6b43b4823a6,network=Network(b375da9b-b613-4a88-a262-962f959597b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffc1761b-5d')
Aug 14 23:11:00 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Start _get_guest_xml network_info=[{"id": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "address": "fa:16:3e:e2:97:1e", "network": {"id": "b375da9b-b613-4a88-a262-962f959597b9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-462508113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1dd09415664f1aa0b0dbdeeb4b8d32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffc1761b-5d", "ovs_interfaceid": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd2900d30-2c4c-4d57-9135-d45564c0c596'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:11:00 user nova-compute[72766]: DEBUG nova.objects.instance [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lazy-loading 'numa_topology' on Instance uuid 66578337-cbff-4613-87a1-85ddabaebb2d {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:11:00 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:11:00 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:11:00 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:11:00 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:11:00 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:11:00 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:11:00 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:11:00 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:11:00 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:11:00 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:11:00 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:11:00 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:11:00 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:11:00 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:11:00 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:11:00 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:11:00 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:11:00 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:11:00 user nova-compute[72766]: DEBUG nova.objects.instance [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lazy-loading 'vcpu_model' on Instance uuid 66578337-cbff-4613-87a1-85ddabaebb2d {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:11:00 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:03:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-217587435',display_name='tempest-AttachVolumeTestJSON-server-217587435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-217587435',id=21,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBINZx5RlQmHKeHXxfdC+NXwuqcWxgRblOsB0YY2uiI6sAZZohfv46zguEF36eLiA7VkgzN1UzneQgr1/yAGU0LFY6JMqRhzyWlR9BBcwz/CmcDywCLsqGwbsFhgR7C+vTQ==',key_name='tempest-keypair-1163729093',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:03:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3b1dd09415664f1aa0b0dbdeeb4b8d32',ramdisk_id='',reservation_id='r-p88w362t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-716158533',owner_user_name='tempest-AttachVolumeTestJSON-716158533-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:09:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a41813929144571a3306300dbf6f485',uuid=66578337-cbff-4613-87a1-85ddabaebb2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "address": "fa:16:3e:e2:97:1e", "network": {"id": "b375da9b-b613-4a88-a262-962f959597b9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-462508113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1dd09415664f1aa0b0dbdeeb4b8d32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffc1761b-5d", "ovs_interfaceid": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:11:00 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Converting VIF {"id": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "address": "fa:16:3e:e2:97:1e", "network": {"id": "b375da9b-b613-4a88-a262-962f959597b9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-462508113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1dd09415664f1aa0b0dbdeeb4b8d32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffc1761b-5d", "ovs_interfaceid": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:11:00 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:97:1e,bridge_name='br-int',has_traffic_filtering=True,id=ffc1761b-5d95-4c58-9b92-b6b43b4823a6,network=Network(b375da9b-b613-4a88-a262-962f959597b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffc1761b-5d') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:11:00 user nova-compute[72766]: DEBUG nova.objects.instance [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lazy-loading 'pci_devices' on Instance uuid 66578337-cbff-4613-87a1-85ddabaebb2d {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:11:00 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:11:00 user nova-compute[72766]:   <uuid>66578337-cbff-4613-87a1-85ddabaebb2d</uuid>
Aug 14 23:11:00 user nova-compute[72766]:   <name>instance-00000015</name>
Aug 14 23:11:00 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:11:00 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:11:00 user nova-compute[72766]:   <metadata>
Aug 14 23:11:00 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:11:00 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:11:00 user nova-compute[72766]:       <nova:name>tempest-AttachVolumeTestJSON-server-217587435</nova:name>
Aug 14 23:11:00 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:11:00</nova:creationTime>
Aug 14 23:11:00 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:11:00 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:11:00 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:11:00 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:11:00 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:11:00 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:11:00 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:11:00 user nova-compute[72766]:       <nova:owner>
Aug 14 23:11:00 user nova-compute[72766]:         <nova:user uuid="7a41813929144571a3306300dbf6f485">tempest-AttachVolumeTestJSON-716158533-project-member</nova:user>
Aug 14 23:11:00 user nova-compute[72766]:         <nova:project uuid="3b1dd09415664f1aa0b0dbdeeb4b8d32">tempest-AttachVolumeTestJSON-716158533</nova:project>
Aug 14 23:11:00 user nova-compute[72766]:       </nova:owner>
Aug 14 23:11:00 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 23:11:00 user nova-compute[72766]:       <nova:ports>
Aug 14 23:11:00 user nova-compute[72766]:         <nova:port uuid="ffc1761b-5d95-4c58-9b92-b6b43b4823a6">
Aug 14 23:11:00 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 23:11:00 user nova-compute[72766]:         </nova:port>
Aug 14 23:11:00 user nova-compute[72766]:       </nova:ports>
Aug 14 23:11:00 user nova-compute[72766]:     </nova:instance>
Aug 14 23:11:00 user nova-compute[72766]:   </metadata>
Aug 14 23:11:00 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:11:00 user nova-compute[72766]:     <system>
Aug 14 23:11:00 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:11:00 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:11:00 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:11:00 user nova-compute[72766]:       <entry name="serial">66578337-cbff-4613-87a1-85ddabaebb2d</entry>
Aug 14 23:11:00 user nova-compute[72766]:       <entry name="uuid">66578337-cbff-4613-87a1-85ddabaebb2d</entry>
Aug 14 23:11:00 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:11:00 user nova-compute[72766]:     </system>
Aug 14 23:11:00 user nova-compute[72766]:   </sysinfo>
Aug 14 23:11:00 user nova-compute[72766]:   <os>
Aug 14 23:11:00 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:11:00 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:11:00 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:11:00 user nova-compute[72766]:   </os>
Aug 14 23:11:00 user nova-compute[72766]:   <features>
Aug 14 23:11:00 user nova-compute[72766]:     <acpi/>
Aug 14 23:11:00 user nova-compute[72766]:     <apic/>
Aug 14 23:11:00 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:11:00 user nova-compute[72766]:   </features>
Aug 14 23:11:00 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:11:00 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:11:00 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:11:00 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:11:00 user nova-compute[72766]:   </clock>
Aug 14 23:11:00 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:11:00 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:11:00 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:11:00 user nova-compute[72766]:   </cpu>
Aug 14 23:11:00 user nova-compute[72766]:   <devices>
Aug 14 23:11:00 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 23:11:00 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 23:11:00 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk"/>
Aug 14 23:11:00 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:11:00 user nova-compute[72766]:     </disk>
Aug 14 23:11:00 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:11:00 user nova-compute[72766]:       <mac address="fa:16:3e:e2:97:1e"/>
Aug 14 23:11:00 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:11:00 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:11:00 user nova-compute[72766]:       <target dev="tapffc1761b-5d"/>
Aug 14 23:11:00 user nova-compute[72766]:     </interface>
Aug 14 23:11:00 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:11:00 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/console.log" append="off"/>
Aug 14 23:11:00 user nova-compute[72766]:     </serial>
Aug 14 23:11:00 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:11:00 user nova-compute[72766]:     <video>
Aug 14 23:11:00 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:11:00 user nova-compute[72766]:     </video>
Aug 14 23:11:00 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:11:00 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:11:00 user nova-compute[72766]:     </rng>
Aug 14 23:11:00 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:11:00 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:11:00 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:11:00 user nova-compute[72766]:     </memballoon>
Aug 14 23:11:00 user nova-compute[72766]:   </devices>
Aug 14 23:11:00 user nova-compute[72766]: </domain>
Aug 14 23:11:00 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:11:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:11:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:11:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:11:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:11:01 user nova-compute[72766]: DEBUG nova.objects.instance [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lazy-loading 'trusted_certs' on Instance uuid 66578337-cbff-4613-87a1-85ddabaebb2d {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:11:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:11:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.175s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:11:01 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Checking if we can resize image /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk. size=1073741824 {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 23:11:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:11:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:11:01 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Cannot resize image /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk to a smaller size. {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 23:11:01 user nova-compute[72766]: DEBUG nova.objects.instance [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lazy-loading 'migration_context' on Instance uuid 66578337-cbff-4613-87a1-85ddabaebb2d {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:11:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:03:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-217587435',display_name='tempest-AttachVolumeTestJSON-server-217587435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-217587435',id=21,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBINZx5RlQmHKeHXxfdC+NXwuqcWxgRblOsB0YY2uiI6sAZZohfv46zguEF36eLiA7VkgzN1UzneQgr1/yAGU0LFY6JMqRhzyWlR9BBcwz/CmcDywCLsqGwbsFhgR7C+vTQ==',key_name='tempest-keypair-1163729093',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:03:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='3b1dd09415664f1aa0b0dbdeeb4b8d32',ramdisk_id='',reservation_id='r-p88w362t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-716158533',owner_user_name='tempest-AttachVolumeTestJSON-716158533-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:09:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a41813929144571a3306300dbf6f485',uuid=66578337-cbff-4613-87a1-85ddabaebb2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "address": "fa:16:3e:e2:97:1e", "network": {"id": "b375da9b-b613-4a88-a262-962f959597b9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-462508113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1dd09415664f1aa0b0dbdeeb4b8d32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffc1761b-5d", "ovs_interfaceid": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:11:01 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Converting VIF {"id": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "address": "fa:16:3e:e2:97:1e", "network": {"id": "b375da9b-b613-4a88-a262-962f959597b9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-462508113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1dd09415664f1aa0b0dbdeeb4b8d32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffc1761b-5d", "ovs_interfaceid": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:11:01 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:97:1e,bridge_name='br-int',has_traffic_filtering=True,id=ffc1761b-5d95-4c58-9b92-b6b43b4823a6,network=Network(b375da9b-b613-4a88-a262-962f959597b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffc1761b-5d') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:11:01 user nova-compute[72766]: DEBUG os_vif [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:97:1e,bridge_name='br-int',has_traffic_filtering=True,id=ffc1761b-5d95-4c58-9b92-b6b43b4823a6,network=Network(b375da9b-b613-4a88-a262-962f959597b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffc1761b-5d') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:11:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:11:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:11:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:11:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:11:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapffc1761b-5d, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:11:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapffc1761b-5d, col_values=(('external_ids', {'iface-id': 'ffc1761b-5d95-4c58-9b92-b6b43b4823a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:97:1e', 'vm-uuid': '66578337-cbff-4613-87a1-85ddabaebb2d'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:11:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:11:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:11:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:11:01 user nova-compute[72766]: INFO os_vif [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:97:1e,bridge_name='br-int',has_traffic_filtering=True,id=ffc1761b-5d95-4c58-9b92-b6b43b4823a6,network=Network(b375da9b-b613-4a88-a262-962f959597b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffc1761b-5d')
Aug 14 23:11:02 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:11:02 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:11:02 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:11:03 user nova-compute[72766]: DEBUG nova.compute.manager [req-7f529ca5-935d-4cfe-8e68-30630ff2ac40 req-9026807f-6f26-43b8-a3d5-1e7ad0c2612e service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Received event network-vif-plugged-ffc1761b-5d95-4c58-9b92-b6b43b4823a6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:11:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7f529ca5-935d-4cfe-8e68-30630ff2ac40 req-9026807f-6f26-43b8-a3d5-1e7ad0c2612e service nova] Acquiring lock "66578337-cbff-4613-87a1-85ddabaebb2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:11:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7f529ca5-935d-4cfe-8e68-30630ff2ac40 req-9026807f-6f26-43b8-a3d5-1e7ad0c2612e service nova] Lock "66578337-cbff-4613-87a1-85ddabaebb2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:11:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7f529ca5-935d-4cfe-8e68-30630ff2ac40 req-9026807f-6f26-43b8-a3d5-1e7ad0c2612e service nova] Lock "66578337-cbff-4613-87a1-85ddabaebb2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:11:03 user nova-compute[72766]: DEBUG nova.compute.manager [req-7f529ca5-935d-4cfe-8e68-30630ff2ac40 req-9026807f-6f26-43b8-a3d5-1e7ad0c2612e service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] No waiting events found dispatching network-vif-plugged-ffc1761b-5d95-4c58-9b92-b6b43b4823a6 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:11:03 user nova-compute[72766]: WARNING nova.compute.manager [req-7f529ca5-935d-4cfe-8e68-30630ff2ac40 req-9026807f-6f26-43b8-a3d5-1e7ad0c2612e service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Received unexpected event network-vif-plugged-ffc1761b-5d95-4c58-9b92-b6b43b4823a6 for instance with vm_state stopped and task_state powering-on.
Aug 14 23:11:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:11:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:11:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:11:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:11:05 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054665.068557, 66578337-cbff-4613-87a1-85ddabaebb2d => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:11:05 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] VM Resumed (Lifecycle Event)
Aug 14 23:11:05 user nova-compute[72766]: DEBUG nova.compute.manager [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:11:05 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Instance rebooted successfully.
Aug 14 23:11:05 user nova-compute[72766]: DEBUG nova.compute.manager [None req-99dfeb2a-575f-4364-afe0-4415e51fc20f tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:11:05 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:11:05 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:11:05 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 14 23:11:05 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054665.0749393, 66578337-cbff-4613-87a1-85ddabaebb2d => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:11:05 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] VM Started (Lifecycle Event)
Aug 14 23:11:05 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:11:05 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:11:05 user nova-compute[72766]: DEBUG nova.compute.manager [req-ec465c81-d3ec-4c26-af62-a3f08e5231aa req-77053f8c-ba54-46d8-a45a-1fd92f66174f service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Received event network-vif-plugged-ffc1761b-5d95-4c58-9b92-b6b43b4823a6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:11:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ec465c81-d3ec-4c26-af62-a3f08e5231aa req-77053f8c-ba54-46d8-a45a-1fd92f66174f service nova] Acquiring lock "66578337-cbff-4613-87a1-85ddabaebb2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:11:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ec465c81-d3ec-4c26-af62-a3f08e5231aa req-77053f8c-ba54-46d8-a45a-1fd92f66174f service nova] Lock "66578337-cbff-4613-87a1-85ddabaebb2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:11:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ec465c81-d3ec-4c26-af62-a3f08e5231aa req-77053f8c-ba54-46d8-a45a-1fd92f66174f service nova] Lock "66578337-cbff-4613-87a1-85ddabaebb2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:11:05 user nova-compute[72766]: DEBUG nova.compute.manager [req-ec465c81-d3ec-4c26-af62-a3f08e5231aa req-77053f8c-ba54-46d8-a45a-1fd92f66174f service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] No waiting events found dispatching network-vif-plugged-ffc1761b-5d95-4c58-9b92-b6b43b4823a6 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:11:05 user nova-compute[72766]: WARNING nova.compute.manager [req-ec465c81-d3ec-4c26-af62-a3f08e5231aa req-77053f8c-ba54-46d8-a45a-1fd92f66174f service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Received unexpected event network-vif-plugged-ffc1761b-5d95-4c58-9b92-b6b43b4823a6 for instance with vm_state active and task_state None.
Aug 14 23:11:06 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:11:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:11:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:11:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:11:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:11:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:11:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquiring lock "34998d61-8b57-453c-a16c-5bb7a2b2c96c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:11:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "34998d61-8b57-453c-a16c-5bb7a2b2c96c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:11:19 user nova-compute[72766]: DEBUG nova.compute.manager [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 23:11:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:11:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:11:19 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 23:11:19 user nova-compute[72766]: INFO nova.compute.claims [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Claim successful on node user
Aug 14 23:11:19 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:11:19 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:11:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.324s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:11:19 user nova-compute[72766]: DEBUG nova.compute.manager [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 23:11:19 user nova-compute[72766]: DEBUG nova.compute.manager [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 23:11:19 user nova-compute[72766]: DEBUG nova.network.neutron [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 23:11:19 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 23:11:19 user nova-compute[72766]: DEBUG nova.compute.manager [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 23:11:19 user nova-compute[72766]: DEBUG nova.policy [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb167893135e4073928a60630ae7720c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f36bd126bda43c6971bccdef2b1da91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 23:11:19 user nova-compute[72766]: DEBUG nova.compute.manager [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 23:11:19 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 23:11:19 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Creating image(s)
Aug 14 23:11:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquiring lock "/opt/stack/data/nova/instances/34998d61-8b57-453c-a16c-5bb7a2b2c96c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:11:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "/opt/stack/data/nova/instances/34998d61-8b57-453c-a16c-5bb7a2b2c96c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:11:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "/opt/stack/data/nova/instances/34998d61-8b57-453c-a16c-5bb7a2b2c96c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:11:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:11:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.182s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:11:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquiring lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:11:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:11:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:11:20 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.175s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:11:20 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/34998d61-8b57-453c-a16c-5bb7a2b2c96c/disk 1073741824 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:11:20 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/34998d61-8b57-453c-a16c-5bb7a2b2c96c/disk 1073741824" returned: 0 in 0.050s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:11:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:11:20 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:11:20 user nova-compute[72766]: DEBUG nova.network.neutron [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Successfully created port: d75b30b8-130a-44f8-b342-28a13e78fcd1 {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 23:11:20 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.185s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:11:20 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Checking if we can resize image /opt/stack/data/nova/instances/34998d61-8b57-453c-a16c-5bb7a2b2c96c/disk. size=1073741824 {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 23:11:20 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34998d61-8b57-453c-a16c-5bb7a2b2c96c/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:11:20 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34998d61-8b57-453c-a16c-5bb7a2b2c96c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:11:20 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Cannot resize image /opt/stack/data/nova/instances/34998d61-8b57-453c-a16c-5bb7a2b2c96c/disk to a smaller size. {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 23:11:20 user nova-compute[72766]: DEBUG nova.objects.instance [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lazy-loading 'migration_context' on Instance uuid 34998d61-8b57-453c-a16c-5bb7a2b2c96c {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:11:20 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 23:11:20 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Ensure instance console log exists: /opt/stack/data/nova/instances/34998d61-8b57-453c-a16c-5bb7a2b2c96c/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 23:11:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:11:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:11:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG nova.network.neutron [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Successfully updated port: d75b30b8-130a-44f8-b342-28a13e78fcd1 {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquiring lock "refresh_cache-34998d61-8b57-453c-a16c-5bb7a2b2c96c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquired lock "refresh_cache-34998d61-8b57-453c-a16c-5bb7a2b2c96c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG nova.network.neutron [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG nova.network.neutron [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG nova.compute.manager [req-3d88e58e-29fb-4230-ac74-ae05365f165d req-3dbd4054-1170-43f7-b214-0af845832b94 service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Received event network-changed-d75b30b8-130a-44f8-b342-28a13e78fcd1 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG nova.compute.manager [req-3d88e58e-29fb-4230-ac74-ae05365f165d req-3dbd4054-1170-43f7-b214-0af845832b94 service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Refreshing instance network info cache due to event network-changed-d75b30b8-130a-44f8-b342-28a13e78fcd1. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-3d88e58e-29fb-4230-ac74-ae05365f165d req-3dbd4054-1170-43f7-b214-0af845832b94 service nova] Acquiring lock "refresh_cache-34998d61-8b57-453c-a16c-5bb7a2b2c96c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG nova.network.neutron [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Updating instance_info_cache with network_info: [{"id": "d75b30b8-130a-44f8-b342-28a13e78fcd1", "address": "fa:16:3e:b3:d6:8a", "network": {"id": "ed86b27c-3e64-4c0a-8824-9bf68068058a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-506861998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f36bd126bda43c6971bccdef2b1da91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd75b30b8-13", "ovs_interfaceid": "d75b30b8-130a-44f8-b342-28a13e78fcd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Releasing lock "refresh_cache-34998d61-8b57-453c-a16c-5bb7a2b2c96c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG nova.compute.manager [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Instance network_info: |[{"id": "d75b30b8-130a-44f8-b342-28a13e78fcd1", "address": "fa:16:3e:b3:d6:8a", "network": {"id": "ed86b27c-3e64-4c0a-8824-9bf68068058a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-506861998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f36bd126bda43c6971bccdef2b1da91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd75b30b8-13", "ovs_interfaceid": "d75b30b8-130a-44f8-b342-28a13e78fcd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-3d88e58e-29fb-4230-ac74-ae05365f165d req-3dbd4054-1170-43f7-b214-0af845832b94 service nova] Acquired lock "refresh_cache-34998d61-8b57-453c-a16c-5bb7a2b2c96c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG nova.network.neutron [req-3d88e58e-29fb-4230-ac74-ae05365f165d req-3dbd4054-1170-43f7-b214-0af845832b94 service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Refreshing network info cache for port d75b30b8-130a-44f8-b342-28a13e78fcd1 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Start _get_guest_xml network_info=[{"id": "d75b30b8-130a-44f8-b342-28a13e78fcd1", "address": "fa:16:3e:b3:d6:8a", "network": {"id": "ed86b27c-3e64-4c0a-8824-9bf68068058a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-506861998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f36bd126bda43c6971bccdef2b1da91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd75b30b8-13", "ovs_interfaceid": "d75b30b8-130a-44f8-b342-28a13e78fcd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd2900d30-2c4c-4d57-9135-d45564c0c596'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:11:21 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:11:21 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:11:21 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:11:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-573188518',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-573188518',id=30,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpCVNDOqJWsIopbIhA73fRWIMxhbGF3wyhqjeShQpFoDYaqRQlt+NjAJQM0+PHWFUaev0WNxHDrS1h03CUy+jZZz1Sbi35V266D2CLbwQbdXvPbnjiItTGPMQSCRiXk9A==',key_name='tempest-keypair-2040959384',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f36bd126bda43c6971bccdef2b1da91',ramdisk_id='',reservation_id='r-wzdhb2yu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1828708750',owner_user_name='tempest-AttachVolumeShelveTestJSON-1828708750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:11:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb167893135e4073928a60630ae7720c',uuid=34998d61-8b57-453c-a16c-5bb7a2b2c96c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d75b30b8-130a-44f8-b342-28a13e78fcd1", "address": "fa:16:3e:b3:d6:8a", "network": {"id": "ed86b27c-3e64-4c0a-8824-9bf68068058a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-506861998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f36bd126bda43c6971bccdef2b1da91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd75b30b8-13", "ovs_interfaceid": "d75b30b8-130a-44f8-b342-28a13e78fcd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Converting VIF {"id": "d75b30b8-130a-44f8-b342-28a13e78fcd1", "address": "fa:16:3e:b3:d6:8a", "network": {"id": "ed86b27c-3e64-4c0a-8824-9bf68068058a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-506861998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f36bd126bda43c6971bccdef2b1da91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd75b30b8-13", "ovs_interfaceid": "d75b30b8-130a-44f8-b342-28a13e78fcd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:d6:8a,bridge_name='br-int',has_traffic_filtering=True,id=d75b30b8-130a-44f8-b342-28a13e78fcd1,network=Network(ed86b27c-3e64-4c0a-8824-9bf68068058a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd75b30b8-13') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG nova.objects.instance [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lazy-loading 'pci_devices' on Instance uuid 34998d61-8b57-453c-a16c-5bb7a2b2c96c {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:11:21 user nova-compute[72766]:   <uuid>34998d61-8b57-453c-a16c-5bb7a2b2c96c</uuid>
Aug 14 23:11:21 user nova-compute[72766]:   <name>instance-0000001e</name>
Aug 14 23:11:21 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:11:21 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:11:21 user nova-compute[72766]:   <metadata>
Aug 14 23:11:21 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:11:21 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:11:21 user nova-compute[72766]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-573188518</nova:name>
Aug 14 23:11:21 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:11:21</nova:creationTime>
Aug 14 23:11:21 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:11:21 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:11:21 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:11:21 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:11:21 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:11:21 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:11:21 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:11:21 user nova-compute[72766]:       <nova:owner>
Aug 14 23:11:21 user nova-compute[72766]:         <nova:user uuid="fb167893135e4073928a60630ae7720c">tempest-AttachVolumeShelveTestJSON-1828708750-project-member</nova:user>
Aug 14 23:11:21 user nova-compute[72766]:         <nova:project uuid="3f36bd126bda43c6971bccdef2b1da91">tempest-AttachVolumeShelveTestJSON-1828708750</nova:project>
Aug 14 23:11:21 user nova-compute[72766]:       </nova:owner>
Aug 14 23:11:21 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 23:11:21 user nova-compute[72766]:       <nova:ports>
Aug 14 23:11:21 user nova-compute[72766]:         <nova:port uuid="d75b30b8-130a-44f8-b342-28a13e78fcd1">
Aug 14 23:11:21 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 23:11:21 user nova-compute[72766]:         </nova:port>
Aug 14 23:11:21 user nova-compute[72766]:       </nova:ports>
Aug 14 23:11:21 user nova-compute[72766]:     </nova:instance>
Aug 14 23:11:21 user nova-compute[72766]:   </metadata>
Aug 14 23:11:21 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:11:21 user nova-compute[72766]:     <system>
Aug 14 23:11:21 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:11:21 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:11:21 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:11:21 user nova-compute[72766]:       <entry name="serial">34998d61-8b57-453c-a16c-5bb7a2b2c96c</entry>
Aug 14 23:11:21 user nova-compute[72766]:       <entry name="uuid">34998d61-8b57-453c-a16c-5bb7a2b2c96c</entry>
Aug 14 23:11:21 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:11:21 user nova-compute[72766]:     </system>
Aug 14 23:11:21 user nova-compute[72766]:   </sysinfo>
Aug 14 23:11:21 user nova-compute[72766]:   <os>
Aug 14 23:11:21 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:11:21 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:11:21 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:11:21 user nova-compute[72766]:   </os>
Aug 14 23:11:21 user nova-compute[72766]:   <features>
Aug 14 23:11:21 user nova-compute[72766]:     <acpi/>
Aug 14 23:11:21 user nova-compute[72766]:     <apic/>
Aug 14 23:11:21 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:11:21 user nova-compute[72766]:   </features>
Aug 14 23:11:21 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:11:21 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:11:21 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:11:21 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:11:21 user nova-compute[72766]:   </clock>
Aug 14 23:11:21 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:11:21 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:11:21 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:11:21 user nova-compute[72766]:   </cpu>
Aug 14 23:11:21 user nova-compute[72766]:   <devices>
Aug 14 23:11:21 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 23:11:21 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 23:11:21 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/34998d61-8b57-453c-a16c-5bb7a2b2c96c/disk"/>
Aug 14 23:11:21 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:11:21 user nova-compute[72766]:     </disk>
Aug 14 23:11:21 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:11:21 user nova-compute[72766]:       <mac address="fa:16:3e:b3:d6:8a"/>
Aug 14 23:11:21 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:11:21 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:11:21 user nova-compute[72766]:       <target dev="tapd75b30b8-13"/>
Aug 14 23:11:21 user nova-compute[72766]:     </interface>
Aug 14 23:11:21 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:11:21 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/34998d61-8b57-453c-a16c-5bb7a2b2c96c/console.log" append="off"/>
Aug 14 23:11:21 user nova-compute[72766]:     </serial>
Aug 14 23:11:21 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:11:21 user nova-compute[72766]:     <video>
Aug 14 23:11:21 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:11:21 user nova-compute[72766]:     </video>
Aug 14 23:11:21 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:11:21 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:11:21 user nova-compute[72766]:     </rng>
Aug 14 23:11:21 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:11:21 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:11:21 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:11:21 user nova-compute[72766]:     </memballoon>
Aug 14 23:11:21 user nova-compute[72766]:   </devices>
Aug 14 23:11:21 user nova-compute[72766]: </domain>
Aug 14 23:11:21 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:11:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-573188518',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-573188518',id=30,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpCVNDOqJWsIopbIhA73fRWIMxhbGF3wyhqjeShQpFoDYaqRQlt+NjAJQM0+PHWFUaev0WNxHDrS1h03CUy+jZZz1Sbi35V266D2CLbwQbdXvPbnjiItTGPMQSCRiXk9A==',key_name='tempest-keypair-2040959384',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f36bd126bda43c6971bccdef2b1da91',ramdisk_id='',reservation_id='r-wzdhb2yu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1828708750',owner_user_name='tempest-AttachVolumeShelveTestJSON-1828708750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:11:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb167893135e4073928a60630ae7720c',uuid=34998d61-8b57-453c-a16c-5bb7a2b2c96c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d75b30b8-130a-44f8-b342-28a13e78fcd1", "address": "fa:16:3e:b3:d6:8a", "network": {"id": "ed86b27c-3e64-4c0a-8824-9bf68068058a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-506861998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f36bd126bda43c6971bccdef2b1da91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd75b30b8-13", "ovs_interfaceid": "d75b30b8-130a-44f8-b342-28a13e78fcd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Converting VIF {"id": "d75b30b8-130a-44f8-b342-28a13e78fcd1", "address": "fa:16:3e:b3:d6:8a", "network": {"id": "ed86b27c-3e64-4c0a-8824-9bf68068058a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-506861998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f36bd126bda43c6971bccdef2b1da91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd75b30b8-13", "ovs_interfaceid": "d75b30b8-130a-44f8-b342-28a13e78fcd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:d6:8a,bridge_name='br-int',has_traffic_filtering=True,id=d75b30b8-130a-44f8-b342-28a13e78fcd1,network=Network(ed86b27c-3e64-4c0a-8824-9bf68068058a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd75b30b8-13') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG os_vif [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:d6:8a,bridge_name='br-int',has_traffic_filtering=True,id=d75b30b8-130a-44f8-b342-28a13e78fcd1,network=Network(ed86b27c-3e64-4c0a-8824-9bf68068058a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd75b30b8-13') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd75b30b8-13, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd75b30b8-13, col_values=(('external_ids', {'iface-id': 'd75b30b8-130a-44f8-b342-28a13e78fcd1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:d6:8a', 'vm-uuid': '34998d61-8b57-453c-a16c-5bb7a2b2c96c'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:11:21 user nova-compute[72766]: INFO os_vif [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:d6:8a,bridge_name='br-int',has_traffic_filtering=True,id=d75b30b8-130a-44f8-b342-28a13e78fcd1,network=Network(ed86b27c-3e64-4c0a-8824-9bf68068058a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd75b30b8-13')
Aug 14 23:11:21 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] No VIF found with MAC fa:16:3e:b3:d6:8a, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG nova.network.neutron [req-3d88e58e-29fb-4230-ac74-ae05365f165d req-3dbd4054-1170-43f7-b214-0af845832b94 service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Updated VIF entry in instance network info cache for port d75b30b8-130a-44f8-b342-28a13e78fcd1. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG nova.network.neutron [req-3d88e58e-29fb-4230-ac74-ae05365f165d req-3dbd4054-1170-43f7-b214-0af845832b94 service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Updating instance_info_cache with network_info: [{"id": "d75b30b8-130a-44f8-b342-28a13e78fcd1", "address": "fa:16:3e:b3:d6:8a", "network": {"id": "ed86b27c-3e64-4c0a-8824-9bf68068058a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-506861998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f36bd126bda43c6971bccdef2b1da91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd75b30b8-13", "ovs_interfaceid": "d75b30b8-130a-44f8-b342-28a13e78fcd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:11:21 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-3d88e58e-29fb-4230-ac74-ae05365f165d req-3dbd4054-1170-43f7-b214-0af845832b94 service nova] Releasing lock "refresh_cache-34998d61-8b57-453c-a16c-5bb7a2b2c96c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:11:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:11:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:11:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:11:23 user nova-compute[72766]: DEBUG nova.compute.manager [req-00002de4-021c-4eac-9774-ffcf9a2d485c req-a46b1b55-76f4-437d-9928-bb858d26e7a4 service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Received event network-vif-plugged-d75b30b8-130a-44f8-b342-28a13e78fcd1 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:11:23 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-00002de4-021c-4eac-9774-ffcf9a2d485c req-a46b1b55-76f4-437d-9928-bb858d26e7a4 service nova] Acquiring lock "34998d61-8b57-453c-a16c-5bb7a2b2c96c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:11:23 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-00002de4-021c-4eac-9774-ffcf9a2d485c req-a46b1b55-76f4-437d-9928-bb858d26e7a4 service nova] Lock "34998d61-8b57-453c-a16c-5bb7a2b2c96c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:11:23 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-00002de4-021c-4eac-9774-ffcf9a2d485c req-a46b1b55-76f4-437d-9928-bb858d26e7a4 service nova] Lock "34998d61-8b57-453c-a16c-5bb7a2b2c96c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:11:23 user nova-compute[72766]: DEBUG nova.compute.manager [req-00002de4-021c-4eac-9774-ffcf9a2d485c req-a46b1b55-76f4-437d-9928-bb858d26e7a4 service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] No waiting events found dispatching network-vif-plugged-d75b30b8-130a-44f8-b342-28a13e78fcd1 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:11:23 user nova-compute[72766]: WARNING nova.compute.manager [req-00002de4-021c-4eac-9774-ffcf9a2d485c req-a46b1b55-76f4-437d-9928-bb858d26e7a4 service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Received unexpected event network-vif-plugged-d75b30b8-130a-44f8-b342-28a13e78fcd1 for instance with vm_state building and task_state spawning.
Aug 14 23:11:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:11:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:11:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:11:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:11:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:11:24 user nova-compute[72766]: DEBUG nova.compute.manager [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:11:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 23:11:24 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054684.959206, 34998d61-8b57-453c-a16c-5bb7a2b2c96c => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:11:24 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] VM Resumed (Lifecycle Event)
Aug 14 23:11:24 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Instance spawned successfully.
Aug 14 23:11:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 23:11:24 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:11:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:11:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:11:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:11:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:11:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:11:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:11:24 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:11:25 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:11:25 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054684.9597564, 34998d61-8b57-453c-a16c-5bb7a2b2c96c => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:11:25 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] VM Started (Lifecycle Event)
Aug 14 23:11:25 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:11:25 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:11:25 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:11:25 user nova-compute[72766]: INFO nova.compute.manager [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Took 5.34 seconds to spawn the instance on the hypervisor.
Aug 14 23:11:25 user nova-compute[72766]: DEBUG nova.compute.manager [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:11:25 user nova-compute[72766]: INFO nova.compute.manager [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Took 5.97 seconds to build instance.
Aug 14 23:11:25 user nova-compute[72766]: DEBUG nova.compute.manager [req-633a114d-b316-4e57-8f06-003d44273651 req-092d679e-265e-44b1-b04b-e65e784b3723 service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Received event network-vif-plugged-d75b30b8-130a-44f8-b342-28a13e78fcd1 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:11:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-633a114d-b316-4e57-8f06-003d44273651 req-092d679e-265e-44b1-b04b-e65e784b3723 service nova] Acquiring lock "34998d61-8b57-453c-a16c-5bb7a2b2c96c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:11:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-633a114d-b316-4e57-8f06-003d44273651 req-092d679e-265e-44b1-b04b-e65e784b3723 service nova] Lock "34998d61-8b57-453c-a16c-5bb7a2b2c96c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:11:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-633a114d-b316-4e57-8f06-003d44273651 req-092d679e-265e-44b1-b04b-e65e784b3723 service nova] Lock "34998d61-8b57-453c-a16c-5bb7a2b2c96c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:11:25 user nova-compute[72766]: DEBUG nova.compute.manager [req-633a114d-b316-4e57-8f06-003d44273651 req-092d679e-265e-44b1-b04b-e65e784b3723 service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] No waiting events found dispatching network-vif-plugged-d75b30b8-130a-44f8-b342-28a13e78fcd1 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:11:25 user nova-compute[72766]: WARNING nova.compute.manager [req-633a114d-b316-4e57-8f06-003d44273651 req-092d679e-265e-44b1-b04b-e65e784b3723 service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Received unexpected event network-vif-plugged-d75b30b8-130a-44f8-b342-28a13e78fcd1 for instance with vm_state building and task_state spawning.
Aug 14 23:11:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-335280a2-9a77-401f-ab4d-51b011f77f43 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "34998d61-8b57-453c-a16c-5bb7a2b2c96c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.062s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:11:25 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:11:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:11:27 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:11:27 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:11:27 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Didn't find any instances for network info cache update. {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 23:11:27 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:11:27 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:11:27 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:11:27 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:11:27 user nova-compute[72766]: WARNING nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] While synchronizing instance power states, found 9 instances in the database and 8 instances on the hypervisor.
Aug 14 23:11:27 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Triggering sync for uuid 3ff300ff-34fd-4e94-9d2d-681fb133ba32 {{(pid=72766) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 23:11:27 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Triggering sync for uuid cbcf7851-e6f7-4f46-97cc-d773286ccddf {{(pid=72766) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 23:11:27 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Triggering sync for uuid 66578337-cbff-4613-87a1-85ddabaebb2d {{(pid=72766) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 23:11:27 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Triggering sync for uuid 83084ccc-8e55-43dc-9a37-ffcb35a10922 {{(pid=72766) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 23:11:27 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Triggering sync for uuid 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef {{(pid=72766) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 23:11:27 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Triggering sync for uuid 71970b47-b09b-4492-9d99-a2be8b3b2042 {{(pid=72766) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 23:11:27 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Triggering sync for uuid 9ec72ed8-0c33-4e70-ae88-d7571c84de2a {{(pid=72766) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 23:11:27 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Triggering sync for uuid 88009c57-377b-4636-ba54-1945c1bc7928 {{(pid=72766) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 23:11:27 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Triggering sync for uuid 34998d61-8b57-453c-a16c-5bb7a2b2c96c {{(pid=72766) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 23:11:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "3ff300ff-34fd-4e94-9d2d-681fb133ba32" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:11:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "3ff300ff-34fd-4e94-9d2d-681fb133ba32" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:11:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "cbcf7851-e6f7-4f46-97cc-d773286ccddf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:11:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "cbcf7851-e6f7-4f46-97cc-d773286ccddf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:11:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "66578337-cbff-4613-87a1-85ddabaebb2d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:11:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "66578337-cbff-4613-87a1-85ddabaebb2d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:11:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "83084ccc-8e55-43dc-9a37-ffcb35a10922" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:11:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "83084ccc-8e55-43dc-9a37-ffcb35a10922" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:11:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:11:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:11:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "71970b47-b09b-4492-9d99-a2be8b3b2042" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:11:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "71970b47-b09b-4492-9d99-a2be8b3b2042" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:11:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "9ec72ed8-0c33-4e70-ae88-d7571c84de2a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:11:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "9ec72ed8-0c33-4e70-ae88-d7571c84de2a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:11:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "88009c57-377b-4636-ba54-1945c1bc7928" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:11:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "88009c57-377b-4636-ba54-1945c1bc7928" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:11:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "34998d61-8b57-453c-a16c-5bb7a2b2c96c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:11:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "34998d61-8b57-453c-a16c-5bb7a2b2c96c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:11:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "66578337-cbff-4613-87a1-85ddabaebb2d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:11:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "cbcf7851-e6f7-4f46-97cc-d773286ccddf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:11:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "3ff300ff-34fd-4e94-9d2d-681fb133ba32" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:11:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "71970b47-b09b-4492-9d99-a2be8b3b2042" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:11:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "83084ccc-8e55-43dc-9a37-ffcb35a10922" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:11:27 user nova-compute[72766]: INFO nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] During _sync_instance_power_state the DB power_state (1) does not match the vm_power_state from the hypervisor (0). Updating power_state in the DB to match the hypervisor.
Aug 14 23:11:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "34998d61-8b57-453c-a16c-5bb7a2b2c96c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:11:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "9ec72ed8-0c33-4e70-ae88-d7571c84de2a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:11:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "88009c57-377b-4636-ba54-1945c1bc7928" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:11:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.123s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:11:28 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:11:28 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:11:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:11:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:11:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:11:28 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:11:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:11:28 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:11:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:11:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:11:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:11:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:11:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:11:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:11:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:11:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:11:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:11:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:11:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:11:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:11:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:11:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:11:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:11:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:11:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88009c57-377b-4636-ba54-1945c1bc7928/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:11:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88009c57-377b-4636-ba54-1945c1bc7928/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:11:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88009c57-377b-4636-ba54-1945c1bc7928/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:11:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88009c57-377b-4636-ba54-1945c1bc7928/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:11:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34998d61-8b57-453c-a16c-5bb7a2b2c96c/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:11:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34998d61-8b57-453c-a16c-5bb7a2b2c96c/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:11:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34998d61-8b57-453c-a16c-5bb7a2b2c96c/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:11:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34998d61-8b57-453c-a16c-5bb7a2b2c96c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:11:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:11:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:11:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:11:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:11:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:11:31 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:11:31 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:11:31 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=7805MB free_disk=25.345840454101562GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:11:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:11:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:11:32 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 3ff300ff-34fd-4e94-9d2d-681fb133ba32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:11:32 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance cbcf7851-e6f7-4f46-97cc-d773286ccddf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:11:32 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 66578337-cbff-4613-87a1-85ddabaebb2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:11:32 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 83084ccc-8e55-43dc-9a37-ffcb35a10922 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:11:32 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 71970b47-b09b-4492-9d99-a2be8b3b2042 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:11:32 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 9ec72ed8-0c33-4e70-ae88-d7571c84de2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:11:32 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 88009c57-377b-4636-ba54-1945c1bc7928 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:11:32 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 34998d61-8b57-453c-a16c-5bb7a2b2c96c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:11:32 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:11:32 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:11:32 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Refreshing inventories for resource provider 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 23:11:32 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Updating ProviderTree inventory for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 23:11:32 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Updating inventory in ProviderTree for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 23:11:32 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Refreshing aggregate associations for resource provider 45c8ff08-bf31-4ab6-8452-2e293102f899, aggregates: None {{(pid=72766) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 23:11:32 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Refreshing trait associations for resource provider 45c8ff08-bf31-4ab6-8452-2e293102f899, traits: COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=72766) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 23:11:32 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:11:32 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:11:32 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:11:32 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.623s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:11:32 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:11:32 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Cleaning up deleted instances {{(pid=72766) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 23:11:32 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] There are 0 instances to clean {{(pid=72766) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 23:11:32 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:11:33 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:11:33 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:11:33 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:11:33 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:11:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:11:36 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:11:36 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72766) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 23:11:36 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:11:39 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:11:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:11:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:11:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:11:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:11:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:11:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:11:49 user nova-compute[72766]: DEBUG nova.compute.manager [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 23:11:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:11:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:11:49 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 23:11:49 user nova-compute[72766]: INFO nova.compute.claims [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Claim successful on node user
Aug 14 23:11:49 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:11:49 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:11:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.338s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:11:49 user nova-compute[72766]: DEBUG nova.compute.manager [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 23:11:49 user nova-compute[72766]: DEBUG nova.compute.manager [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 23:11:49 user nova-compute[72766]: DEBUG nova.network.neutron [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 23:11:49 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 23:11:49 user nova-compute[72766]: DEBUG nova.compute.manager [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 23:11:50 user nova-compute[72766]: INFO nova.virt.block_device [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Booting with volume-backed-image d2900d30-2c4c-4d57-9135-d45564c0c596 at /dev/vda
Aug 14 23:11:50 user nova-compute[72766]: DEBUG nova.policy [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '32e61321c50d4af28adeab72811a3f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3725c4b1cd78403f9628c8af9f8e5cc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 23:11:51 user nova-compute[72766]: DEBUG nova.network.neutron [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Successfully created port: f2f08b69-eb49-4a38-9357-36420ee797d6 {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 23:11:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:11:52 user nova-compute[72766]: DEBUG nova.network.neutron [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Successfully updated port: f2f08b69-eb49-4a38-9357-36420ee797d6 {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 23:11:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "refresh_cache-901fe741-3b2f-472e-b91c-a90c9d4a9c39" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:11:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquired lock "refresh_cache-901fe741-3b2f-472e-b91c-a90c9d4a9c39" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:11:52 user nova-compute[72766]: DEBUG nova.network.neutron [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:11:52 user nova-compute[72766]: DEBUG nova.compute.manager [req-e274ea3c-edbc-44fe-871d-6cdffd8ccf8b req-17e833e2-db9d-4ab0-a393-338259ba10f1 service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Received event network-changed-f2f08b69-eb49-4a38-9357-36420ee797d6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:11:52 user nova-compute[72766]: DEBUG nova.compute.manager [req-e274ea3c-edbc-44fe-871d-6cdffd8ccf8b req-17e833e2-db9d-4ab0-a393-338259ba10f1 service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Refreshing instance network info cache due to event network-changed-f2f08b69-eb49-4a38-9357-36420ee797d6. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:11:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e274ea3c-edbc-44fe-871d-6cdffd8ccf8b req-17e833e2-db9d-4ab0-a393-338259ba10f1 service nova] Acquiring lock "refresh_cache-901fe741-3b2f-472e-b91c-a90c9d4a9c39" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:11:52 user nova-compute[72766]: DEBUG nova.network.neutron [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 23:11:52 user nova-compute[72766]: DEBUG nova.network.neutron [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Updating instance_info_cache with network_info: [{"id": "f2f08b69-eb49-4a38-9357-36420ee797d6", "address": "fa:16:3e:44:c6:dd", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f08b69-eb", "ovs_interfaceid": "f2f08b69-eb49-4a38-9357-36420ee797d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:11:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Releasing lock "refresh_cache-901fe741-3b2f-472e-b91c-a90c9d4a9c39" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:11:52 user nova-compute[72766]: DEBUG nova.compute.manager [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Instance network_info: |[{"id": "f2f08b69-eb49-4a38-9357-36420ee797d6", "address": "fa:16:3e:44:c6:dd", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f08b69-eb", "ovs_interfaceid": "f2f08b69-eb49-4a38-9357-36420ee797d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 23:11:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e274ea3c-edbc-44fe-871d-6cdffd8ccf8b req-17e833e2-db9d-4ab0-a393-338259ba10f1 service nova] Acquired lock "refresh_cache-901fe741-3b2f-472e-b91c-a90c9d4a9c39" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:11:52 user nova-compute[72766]: DEBUG nova.network.neutron [req-e274ea3c-edbc-44fe-871d-6cdffd8ccf8b req-17e833e2-db9d-4ab0-a393-338259ba10f1 service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Refreshing network info cache for port f2f08b69-eb49-4a38-9357-36420ee797d6 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:11:52 user nova-compute[72766]: DEBUG nova.network.neutron [req-e274ea3c-edbc-44fe-871d-6cdffd8ccf8b req-17e833e2-db9d-4ab0-a393-338259ba10f1 service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Updated VIF entry in instance network info cache for port f2f08b69-eb49-4a38-9357-36420ee797d6. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:11:52 user nova-compute[72766]: DEBUG nova.network.neutron [req-e274ea3c-edbc-44fe-871d-6cdffd8ccf8b req-17e833e2-db9d-4ab0-a393-338259ba10f1 service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Updating instance_info_cache with network_info: [{"id": "f2f08b69-eb49-4a38-9357-36420ee797d6", "address": "fa:16:3e:44:c6:dd", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f08b69-eb", "ovs_interfaceid": "f2f08b69-eb49-4a38-9357-36420ee797d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:11:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e274ea3c-edbc-44fe-871d-6cdffd8ccf8b req-17e833e2-db9d-4ab0-a393-338259ba10f1 service nova] Releasing lock "refresh_cache-901fe741-3b2f-472e-b91c-a90c9d4a9c39" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:11:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:11:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:12:01 user nova-compute[72766]: DEBUG os_brick.utils [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:12:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:01 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e92750b-84d0-4686-91f6-e1e3a2e8d457]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:01 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[222f9bd5-05d8-4ae5-b5ae-9e547fb8ed5f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:01 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f29ea30-b1fb-40f7-a913-a1bd77c88e3f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:01 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4575ae4f-cca6-46eb-9a36-45781c22e3ca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:12:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 23:12:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:12:01 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 23:12:01 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a5ae1e-98f4-4211-9e6f-08c3605ccb79]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 23:12:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 23:12:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 23:12:01 user nova-compute[72766]: DEBUG os_brick.utils [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:12:01 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Updating existing volume attachment record: 610aa83b-f013-4048-8aad-8aae0235a4ad {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 23:12:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:12:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:12:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:12:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:12:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:12:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:12:06 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:12:09 user nova-compute[72766]: DEBUG nova.compute.manager [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 23:12:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 23:12:09 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Creating image(s)
Aug 14 23:12:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Did not create local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 23:12:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Ensure instance console log exists: /opt/stack/data/nova/instances/901fe741-3b2f-472e-b91c-a90c9d4a9c39/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 23:12:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:12:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:12:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:12:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Start _get_guest_xml network_info=[{"id": "f2f08b69-eb49-4a38-9357-36420ee797d6", "address": "fa:16:3e:44:c6:dd", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f08b69-eb", "ovs_interfaceid": "f2f08b69-eb49-4a38-9357-36420ee797d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '610aa83b-f013-4048-8aad-8aae0235a4ad', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fNiWyvpJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '901fe741-3b2f-472e-b91c-a90c9d4a9c39', 'attached_at': '', 'detached_at': '', 'volume_id': '9c962ff1-98b5-48ca-bbce-dd40c372a3c4', 'serial': '9c962ff1-98b5-48ca-bbce-dd40c372a3c4'}, 'volume_type': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:12:09 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:12:09 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:12:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:12:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:12:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:12:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:12:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:12:09 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:12:09 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:12:09 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:12:09 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:12:09 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:12:09 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:12:09 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:12:09 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:12:09 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:12:09 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:12:09 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:12:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 23:12:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fNiWyvpJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:12:09 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:12:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:12:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:12:09 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:12:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:12:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:12:09 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 23:12:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d902c7-5ea2-4a52-b353-62cf8680bf89]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 23:12:09 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:12:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ecbb6a7-a41c-4f83-ad76-8b728b61bcb2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4] added
Aug 14 23:12:09 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:12:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d65976-4cd0-43fa-b3e9-364c26747cc0]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:12:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfff13f9-b943-4bec-bb31-7cc64e2a138c]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:12:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fNiWyvpJ {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fNiWyvpJ" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:10 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b8da9e-e7aa-44cb-8c95-7ef4b7654fec]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fNiWyvpJ'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:12:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:10 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[6990823a-7810-4348-b20e-fa6ef147c9bf]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:12:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:10 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[725a3514-70b0-4d27-9ddb-7d69339aa810]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:12:10 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:12:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:12:10 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:12:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:10 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a52100-a345-41cf-95fe-f7178db402d9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4, portal: 172.16.0.220,3260]
Aug 14 23:12:10 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4, portal: 172.16.0.220,3260] successful.
Aug 14 23:12:10 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:12:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:10 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13caeea-a4eb-4a73-a889-c7ed138645c8]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:12:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:10 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a521567-71b1-4994-89b5-03b876d80e5c]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:12:10 user nova-compute[72766]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)
Aug 14 23:12:10 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:12:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:12:10 user nova-compute[72766]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)
Aug 14 23:12:10 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:12:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:12:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 23:12:10 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 23:12:10 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 23:12:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:10 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5e0d56-2263-41aa-af31-66c24f53dc02]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:10 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: None {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:12:11 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:12:11 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fNiWyvpJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 23:12:11 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:12:11 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26664646432366231', 'path': '/dev/sdb'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:12:11 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664646432366231', 'path': '/dev/sdb'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 23:12:11 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:11:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-952087033',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-952087033',id=31,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3725c4b1cd78403f9628c8af9f8e5cc5',ramdisk_id='',reservation_id='r-4s8wi2wt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-86235447',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:11:50Z,user_data=None,user_id='32e61321c50d4af28adeab72811a3f86',uuid=901fe741-3b2f-472e-b91c-a90c9d4a9c39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2f08b69-eb49-4a38-9357-36420ee797d6", "address": "fa:16:3e:44:c6:dd", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f08b69-eb", "ovs_interfaceid": "f2f08b69-eb49-4a38-9357-36420ee797d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:12:11 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Converting VIF {"id": "f2f08b69-eb49-4a38-9357-36420ee797d6", "address": "fa:16:3e:44:c6:dd", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f08b69-eb", "ovs_interfaceid": "f2f08b69-eb49-4a38-9357-36420ee797d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:12:11 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:c6:dd,bridge_name='br-int',has_traffic_filtering=True,id=f2f08b69-eb49-4a38-9357-36420ee797d6,network=Network(f4efdeee-d89b-45e5-b0d9-b45573564e9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2f08b69-eb') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:12:11 user nova-compute[72766]: DEBUG nova.objects.instance [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lazy-loading 'pci_devices' on Instance uuid 901fe741-3b2f-472e-b91c-a90c9d4a9c39 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:12:11 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:12:11 user nova-compute[72766]:   <uuid>901fe741-3b2f-472e-b91c-a90c9d4a9c39</uuid>
Aug 14 23:12:11 user nova-compute[72766]:   <name>instance-0000001f</name>
Aug 14 23:12:11 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:12:11 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:12:11 user nova-compute[72766]:   <metadata>
Aug 14 23:12:11 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:12:11 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:12:11 user nova-compute[72766]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-952087033</nova:name>
Aug 14 23:12:11 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:12:09</nova:creationTime>
Aug 14 23:12:11 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:12:11 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:12:11 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:12:11 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:12:11 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:12:11 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:12:11 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:12:11 user nova-compute[72766]:       <nova:owner>
Aug 14 23:12:11 user nova-compute[72766]:         <nova:user uuid="32e61321c50d4af28adeab72811a3f86">tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member</nova:user>
Aug 14 23:12:11 user nova-compute[72766]:         <nova:project uuid="3725c4b1cd78403f9628c8af9f8e5cc5">tempest-ServerBootFromVolumeStableRescueTest-86235447</nova:project>
Aug 14 23:12:11 user nova-compute[72766]:       </nova:owner>
Aug 14 23:12:11 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 23:12:11 user nova-compute[72766]:       <nova:ports>
Aug 14 23:12:11 user nova-compute[72766]:         <nova:port uuid="f2f08b69-eb49-4a38-9357-36420ee797d6">
Aug 14 23:12:11 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 23:12:11 user nova-compute[72766]:         </nova:port>
Aug 14 23:12:11 user nova-compute[72766]:       </nova:ports>
Aug 14 23:12:11 user nova-compute[72766]:     </nova:instance>
Aug 14 23:12:11 user nova-compute[72766]:   </metadata>
Aug 14 23:12:11 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:12:11 user nova-compute[72766]:     <system>
Aug 14 23:12:11 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:12:11 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:12:11 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:12:11 user nova-compute[72766]:       <entry name="serial">901fe741-3b2f-472e-b91c-a90c9d4a9c39</entry>
Aug 14 23:12:11 user nova-compute[72766]:       <entry name="uuid">901fe741-3b2f-472e-b91c-a90c9d4a9c39</entry>
Aug 14 23:12:11 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:12:11 user nova-compute[72766]:     </system>
Aug 14 23:12:11 user nova-compute[72766]:   </sysinfo>
Aug 14 23:12:11 user nova-compute[72766]:   <os>
Aug 14 23:12:11 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:12:11 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:12:11 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:12:11 user nova-compute[72766]:   </os>
Aug 14 23:12:11 user nova-compute[72766]:   <features>
Aug 14 23:12:11 user nova-compute[72766]:     <acpi/>
Aug 14 23:12:11 user nova-compute[72766]:     <apic/>
Aug 14 23:12:11 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:12:11 user nova-compute[72766]:   </features>
Aug 14 23:12:11 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:12:11 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:12:11 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:12:11 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:12:11 user nova-compute[72766]:   </clock>
Aug 14 23:12:11 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:12:11 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:12:11 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:12:11 user nova-compute[72766]:   </cpu>
Aug 14 23:12:11 user nova-compute[72766]:   <devices>
Aug 14 23:12:11 user nova-compute[72766]:     <disk type="block" device="disk">
Aug 14 23:12:11 user nova-compute[72766]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:12:11 user nova-compute[72766]:       <source dev="/dev/sdb"/>
Aug 14 23:12:11 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:12:11 user nova-compute[72766]:       <serial>9c962ff1-98b5-48ca-bbce-dd40c372a3c4</serial>
Aug 14 23:12:11 user nova-compute[72766]:     </disk>
Aug 14 23:12:11 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:12:11 user nova-compute[72766]:       <mac address="fa:16:3e:44:c6:dd"/>
Aug 14 23:12:11 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:12:11 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:12:11 user nova-compute[72766]:       <target dev="tapf2f08b69-eb"/>
Aug 14 23:12:11 user nova-compute[72766]:     </interface>
Aug 14 23:12:11 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:12:11 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/901fe741-3b2f-472e-b91c-a90c9d4a9c39/console.log" append="off"/>
Aug 14 23:12:11 user nova-compute[72766]:     </serial>
Aug 14 23:12:11 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:12:11 user nova-compute[72766]:     <video>
Aug 14 23:12:11 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:12:11 user nova-compute[72766]:     </video>
Aug 14 23:12:11 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:12:11 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:12:11 user nova-compute[72766]:     </rng>
Aug 14 23:12:11 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:12:11 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:12:11 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:12:11 user nova-compute[72766]:     </memballoon>
Aug 14 23:12:11 user nova-compute[72766]:   </devices>
Aug 14 23:12:11 user nova-compute[72766]: </domain>
Aug 14 23:12:11 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:12:11 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:11:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-952087033',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-952087033',id=31,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3725c4b1cd78403f9628c8af9f8e5cc5',ramdisk_id='',reservation_id='r-4s8wi2wt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-86235447',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:11:50Z,user_data=None,user_id='32e61321c50d4af28adeab72811a3f86',uuid=901fe741-3b2f-472e-b91c-a90c9d4a9c39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2f08b69-eb49-4a38-9357-36420ee797d6", "address": "fa:16:3e:44:c6:dd", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f08b69-eb", "ovs_interfaceid": "f2f08b69-eb49-4a38-9357-36420ee797d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:12:11 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Converting VIF {"id": "f2f08b69-eb49-4a38-9357-36420ee797d6", "address": "fa:16:3e:44:c6:dd", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f08b69-eb", "ovs_interfaceid": "f2f08b69-eb49-4a38-9357-36420ee797d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:12:11 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:c6:dd,bridge_name='br-int',has_traffic_filtering=True,id=f2f08b69-eb49-4a38-9357-36420ee797d6,network=Network(f4efdeee-d89b-45e5-b0d9-b45573564e9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2f08b69-eb') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:12:11 user nova-compute[72766]: DEBUG os_vif [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:c6:dd,bridge_name='br-int',has_traffic_filtering=True,id=f2f08b69-eb49-4a38-9357-36420ee797d6,network=Network(f4efdeee-d89b-45e5-b0d9-b45573564e9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2f08b69-eb') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:12:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:12:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:12:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:12:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:12:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2f08b69-eb, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:12:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf2f08b69-eb, col_values=(('external_ids', {'iface-id': 'f2f08b69-eb49-4a38-9357-36420ee797d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:c6:dd', 'vm-uuid': '901fe741-3b2f-472e-b91c-a90c9d4a9c39'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:12:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:12:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:12:11 user nova-compute[72766]: INFO os_vif [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:c6:dd,bridge_name='br-int',has_traffic_filtering=True,id=f2f08b69-eb49-4a38-9357-36420ee797d6,network=Network(f4efdeee-d89b-45e5-b0d9-b45573564e9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2f08b69-eb')
Aug 14 23:12:11 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:12:11 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] No VIF found with MAC fa:16:3e:44:c6:dd, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:12:12 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:12:12 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:12:12 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:12:12 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:12:12 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:12:12 user nova-compute[72766]: DEBUG nova.compute.manager [req-2676691a-080c-40c2-a10a-a2b0ccd0affc req-062b4bfd-d251-47af-9eb2-03d58a5287a1 service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Received event network-vif-plugged-f2f08b69-eb49-4a38-9357-36420ee797d6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:12:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2676691a-080c-40c2-a10a-a2b0ccd0affc req-062b4bfd-d251-47af-9eb2-03d58a5287a1 service nova] Acquiring lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:12:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2676691a-080c-40c2-a10a-a2b0ccd0affc req-062b4bfd-d251-47af-9eb2-03d58a5287a1 service nova] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:12:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2676691a-080c-40c2-a10a-a2b0ccd0affc req-062b4bfd-d251-47af-9eb2-03d58a5287a1 service nova] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:12:12 user nova-compute[72766]: DEBUG nova.compute.manager [req-2676691a-080c-40c2-a10a-a2b0ccd0affc req-062b4bfd-d251-47af-9eb2-03d58a5287a1 service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] No waiting events found dispatching network-vif-plugged-f2f08b69-eb49-4a38-9357-36420ee797d6 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:12:12 user nova-compute[72766]: WARNING nova.compute.manager [req-2676691a-080c-40c2-a10a-a2b0ccd0affc req-062b4bfd-d251-47af-9eb2-03d58a5287a1 service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Received unexpected event network-vif-plugged-f2f08b69-eb49-4a38-9357-36420ee797d6 for instance with vm_state building and task_state spawning.
Aug 14 23:12:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:12:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:12:14 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054734.4977155, 901fe741-3b2f-472e-b91c-a90c9d4a9c39 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:12:14 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] VM Resumed (Lifecycle Event)
Aug 14 23:12:14 user nova-compute[72766]: DEBUG nova.compute.manager [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:12:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 23:12:14 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Instance spawned successfully.
Aug 14 23:12:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 23:12:14 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:12:14 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:12:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:12:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:12:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:12:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:12:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:12:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:12:14 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:12:14 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054734.5032485, 901fe741-3b2f-472e-b91c-a90c9d4a9c39 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:12:14 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] VM Started (Lifecycle Event)
Aug 14 23:12:14 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:12:14 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:12:14 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:12:14 user nova-compute[72766]: INFO nova.compute.manager [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Took 4.79 seconds to spawn the instance on the hypervisor.
Aug 14 23:12:14 user nova-compute[72766]: DEBUG nova.compute.manager [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:12:14 user nova-compute[72766]: INFO nova.compute.manager [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Took 25.23 seconds to build instance.
Aug 14 23:12:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6901cb93-8512-4627-b116-ffbd9ea5121d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.418s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:12:14 user nova-compute[72766]: DEBUG nova.compute.manager [req-7f9be0f4-f83a-495c-b7b5-c713565440fa req-e4e1f67f-c372-4f6e-827e-3cf5aea598b8 service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Received event network-vif-plugged-f2f08b69-eb49-4a38-9357-36420ee797d6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:12:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7f9be0f4-f83a-495c-b7b5-c713565440fa req-e4e1f67f-c372-4f6e-827e-3cf5aea598b8 service nova] Acquiring lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:12:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7f9be0f4-f83a-495c-b7b5-c713565440fa req-e4e1f67f-c372-4f6e-827e-3cf5aea598b8 service nova] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:12:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7f9be0f4-f83a-495c-b7b5-c713565440fa req-e4e1f67f-c372-4f6e-827e-3cf5aea598b8 service nova] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:12:14 user nova-compute[72766]: DEBUG nova.compute.manager [req-7f9be0f4-f83a-495c-b7b5-c713565440fa req-e4e1f67f-c372-4f6e-827e-3cf5aea598b8 service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] No waiting events found dispatching network-vif-plugged-f2f08b69-eb49-4a38-9357-36420ee797d6 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:12:14 user nova-compute[72766]: WARNING nova.compute.manager [req-7f9be0f4-f83a-495c-b7b5-c713565440fa req-e4e1f67f-c372-4f6e-827e-3cf5aea598b8 service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Received unexpected event network-vif-plugged-f2f08b69-eb49-4a38-9357-36420ee797d6 for instance with vm_state active and task_state None.
Aug 14 23:12:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:12:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:12:22 user nova-compute[72766]: DEBUG nova.compute.manager [req-d0ce8305-cf1b-4646-9ffa-b6c4e0d79006 req-ec0013e1-d9d4-4db3-ad86-3f597679f678 service nova] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Received event network-changed-53e31c0d-29ff-4d0d-8f3a-6a08a69c927e {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:12:22 user nova-compute[72766]: DEBUG nova.compute.manager [req-d0ce8305-cf1b-4646-9ffa-b6c4e0d79006 req-ec0013e1-d9d4-4db3-ad86-3f597679f678 service nova] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Refreshing instance network info cache due to event network-changed-53e31c0d-29ff-4d0d-8f3a-6a08a69c927e. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:12:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d0ce8305-cf1b-4646-9ffa-b6c4e0d79006 req-ec0013e1-d9d4-4db3-ad86-3f597679f678 service nova] Acquiring lock "refresh_cache-9ec72ed8-0c33-4e70-ae88-d7571c84de2a" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:12:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d0ce8305-cf1b-4646-9ffa-b6c4e0d79006 req-ec0013e1-d9d4-4db3-ad86-3f597679f678 service nova] Acquired lock "refresh_cache-9ec72ed8-0c33-4e70-ae88-d7571c84de2a" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:12:22 user nova-compute[72766]: DEBUG nova.network.neutron [req-d0ce8305-cf1b-4646-9ffa-b6c4e0d79006 req-ec0013e1-d9d4-4db3-ad86-3f597679f678 service nova] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Refreshing network info cache for port 53e31c0d-29ff-4d0d-8f3a-6a08a69c927e {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:12:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Acquiring lock "9ec72ed8-0c33-4e70-ae88-d7571c84de2a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:12:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "9ec72ed8-0c33-4e70-ae88-d7571c84de2a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:12:22 user nova-compute[72766]: DEBUG nova.network.neutron [req-d0ce8305-cf1b-4646-9ffa-b6c4e0d79006 req-ec0013e1-d9d4-4db3-ad86-3f597679f678 service nova] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Updated VIF entry in instance network info cache for port 53e31c0d-29ff-4d0d-8f3a-6a08a69c927e. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:12:22 user nova-compute[72766]: DEBUG nova.network.neutron [req-d0ce8305-cf1b-4646-9ffa-b6c4e0d79006 req-ec0013e1-d9d4-4db3-ad86-3f597679f678 service nova] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Updating instance_info_cache with network_info: [{"id": "53e31c0d-29ff-4d0d-8f3a-6a08a69c927e", "address": "fa:16:3e:ba:ba:ec", "network": {"id": "52ed808b-c840-47a7-aa8f-8055fd7bd1ef", "bridge": "br-int", "label": "tempest-TestStampPattern-1964150399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2329e260514d818d5af10aeeda498d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e31c0d-29", "ovs_interfaceid": "53e31c0d-29ff-4d0d-8f3a-6a08a69c927e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:12:22 user nova-compute[72766]: DEBUG nova.objects.instance [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lazy-loading 'flavor' on Instance uuid 9ec72ed8-0c33-4e70-ae88-d7571c84de2a {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:12:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d0ce8305-cf1b-4646-9ffa-b6c4e0d79006 req-ec0013e1-d9d4-4db3-ad86-3f597679f678 service nova] Releasing lock "refresh_cache-9ec72ed8-0c33-4e70-ae88-d7571c84de2a" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:12:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "9ec72ed8-0c33-4e70-ae88-d7571c84de2a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:12:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Acquiring lock "9ec72ed8-0c33-4e70-ae88-d7571c84de2a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:12:23 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "9ec72ed8-0c33-4e70-ae88-d7571c84de2a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:12:23 user nova-compute[72766]: INFO nova.compute.manager [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Attaching volume 9ea09372-d9b9-4edf-a8a6-99fc6f112309 to /dev/vdb
Aug 14 23:12:23 user nova-compute[72766]: DEBUG os_brick.utils [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:12:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:23 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b7eedd-2b39-465b-80cd-7a8c1a12f17a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:23 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbaa750d-0c89-49fc-9d70-5cc112570c99]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:23 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[801baac4-1650-492f-bc1e-fbcbed96ba86]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:23 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1922dc4-4200-47b9-84d6-4767c7b44e4e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:12:23 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 23:12:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:12:23 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 23:12:23 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba67386-ad89-4231-a6c4-fe51dafeecd1]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:23 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 23:12:23 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 23:12:23 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 23:12:23 user nova-compute[72766]: DEBUG os_brick.utils [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:12:23 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Updating existing volume attachment record: 7ccd93a7-cbbd-4276-ad9b-962cd000c0eb {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 23:12:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:12:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:12:26 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:12:27 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:12:28 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:12:28 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:12:28 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Rebuilding the list of instances to heal {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 23:12:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-3ff300ff-34fd-4e94-9d2d-681fb133ba32" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:12:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-3ff300ff-34fd-4e94-9d2d-681fb133ba32" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:12:28 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:12:28 user nova-compute[72766]: DEBUG nova.objects.instance [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lazy-loading 'info_cache' on Instance uuid 3ff300ff-34fd-4e94-9d2d-681fb133ba32 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:12:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:12:29 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Updating instance_info_cache with network_info: [{"id": "c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d", "address": "fa:16:3e:67:f9:a0", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46ab9cb-e6", "ovs_interfaceid": "c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:12:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-3ff300ff-34fd-4e94-9d2d-681fb133ba32" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:12:29 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:12:29 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:12:29 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:12:29 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:12:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:12:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:12:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:12:29 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:12:29 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:12:29 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:12:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88009c57-377b-4636-ba54-1945c1bc7928/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88009c57-377b-4636-ba54-1945c1bc7928/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88009c57-377b-4636-ba54-1945c1bc7928/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:12:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88009c57-377b-4636-ba54-1945c1bc7928/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34998d61-8b57-453c-a16c-5bb7a2b2c96c/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34998d61-8b57-453c-a16c-5bb7a2b2c96c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34998d61-8b57-453c-a16c-5bb7a2b2c96c/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34998d61-8b57-453c-a16c-5bb7a2b2c96c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:31 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 23:12:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NvZutIST', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:12:31 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:12:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:12:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:12:31 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:12:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:12:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:12:31 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 23:12:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309 -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2936986-dea1-4768-a720-53316d4a88a2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 23:12:32 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309 -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f6b2fa-fce0-4bcf-bd05-4ee4668c84c9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309] added
Aug 14 23:12:32 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a17ec08-2d62-453e-a048-d58f1f8dda10]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d54ee6-fb40-4b60-9567-2cea734b2552]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NvZutIST {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NvZutIST" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d31327-6d14-4e1d-b290-fcc3f79f1b36]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NvZutIST'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c650951-667f-4fe3-9dfe-1c10b7b5c0a6]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[177e9102-dd89-40ec-9c40-880e5ae067ef]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:12:32 user nova-compute[72766]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)
Aug 14 23:12:32 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:12:32 user nova-compute[72766]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)
Aug 14 23:12:32 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309 -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:32 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:12:32 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:12:32 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=7680MB free_disk=25.315937042236328GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[47af62c5-2390-4902-9ba8-9e89092aea96]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309, portal: 172.16.0.220,3260]
Aug 14 23:12:32 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309, portal: 172.16.0.220,3260] successful.
Aug 14 23:12:32 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d81ac6d-bd84-4101-84b4-991823b17815]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd89b5ae-dea6-4b02-85c1-4d2699030a7b]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:12:32 user nova-compute[72766]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)
Aug 14 23:12:32 user nova-compute[72766]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309 (non-flash)
Aug 14 23:12:32 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:12:32 user nova-compute[72766]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)
Aug 14 23:12:32 user nova-compute[72766]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309 (non-flash)
Aug 14 23:12:32 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.816s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae201af5-d587-42ee-b850-0aeb52fdd637]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: None {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 3ff300ff-34fd-4e94-9d2d-681fb133ba32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance cbcf7851-e6f7-4f46-97cc-d773286ccddf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 66578337-cbff-4613-87a1-85ddabaebb2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 83084ccc-8e55-43dc-9a37-ffcb35a10922 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 71970b47-b09b-4492-9d99-a2be8b3b2042 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 9ec72ed8-0c33-4e70-ae88-d7571c84de2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 88009c57-377b-4636-ba54-1945c1bc7928 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 34998d61-8b57-453c-a16c-5bb7a2b2c96c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 901fe741-3b2f-472e-b91c-a90c9d4a9c39 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:12:32 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:12:33 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:12:33 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:12:33 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:12:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.429s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:12:33 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:12:33 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:12:33 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:12:33 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:12:33 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:12:33 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NvZutIST', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 23:12:33 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.846s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:12:33 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] <== connect_volume: return (1848ms) {'type': 'block', 'scsi_wwn': '26237636639326536', 'path': '/dev/sdc'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:12:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237636639326536', 'path': '/dev/sdc'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 23:12:33 user nova-compute[72766]: DEBUG nova.objects.instance [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lazy-loading 'flavor' on Instance uuid 9ec72ed8-0c33-4e70-ae88-d7571c84de2a {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:12:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 23:12:33 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:12:33 user nova-compute[72766]:   <source dev="/dev/sdc"/>
Aug 14 23:12:33 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:12:33 user nova-compute[72766]:   <serial>9ea09372-d9b9-4edf-a8a6-99fc6f112309</serial>
Aug 14 23:12:33 user nova-compute[72766]: </disk>
Aug 14 23:12:33 user nova-compute[72766]:  {{(pid=72766) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 23:12:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:12:34 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:12:34 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:12:34 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] No VIF found with MAC fa:16:3e:ba:ba:ec, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:12:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-8ebcb971-6d84-4a7f-908d-0b25424b872c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "9ec72ed8-0c33-4e70-ae88-d7571c84de2a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.417s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:12:36 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:12:36 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f7f36a95-d07a-464f-80ee-5e6ec51e5e7d tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Acquiring lock "9ec72ed8-0c33-4e70-ae88-d7571c84de2a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:12:36 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f7f36a95-d07a-464f-80ee-5e6ec51e5e7d tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "9ec72ed8-0c33-4e70-ae88-d7571c84de2a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:12:36 user nova-compute[72766]: INFO nova.compute.manager [None req-f7f36a95-d07a-464f-80ee-5e6ec51e5e7d tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Detaching volume 9ea09372-d9b9-4edf-a8a6-99fc6f112309
Aug 14 23:12:36 user nova-compute[72766]: INFO nova.virt.block_device [None req-f7f36a95-d07a-464f-80ee-5e6ec51e5e7d tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Attempting to driver detach volume 9ea09372-d9b9-4edf-a8a6-99fc6f112309 from mountpoint /dev/vdb
Aug 14 23:12:36 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f7f36a95-d07a-464f-80ee-5e6ec51e5e7d tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Attempting to detach device vdb from instance 9ec72ed8-0c33-4e70-ae88-d7571c84de2a from the persistent domain config. {{(pid=72766) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 23:12:36 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-f7f36a95-d07a-464f-80ee-5e6ec51e5e7d tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 23:12:36 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:12:36 user nova-compute[72766]:   <source dev="/dev/sdc"/>
Aug 14 23:12:36 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:12:36 user nova-compute[72766]:   <serial>9ea09372-d9b9-4edf-a8a6-99fc6f112309</serial>
Aug 14 23:12:36 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 23:12:36 user nova-compute[72766]: </disk>
Aug 14 23:12:36 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 23:12:36 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-f7f36a95-d07a-464f-80ee-5e6ec51e5e7d tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Successfully detached device vdb from instance 9ec72ed8-0c33-4e70-ae88-d7571c84de2a from the persistent domain config.
Aug 14 23:12:36 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f7f36a95-d07a-464f-80ee-5e6ec51e5e7d tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9ec72ed8-0c33-4e70-ae88-d7571c84de2a from the live domain config. {{(pid=72766) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 23:12:36 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-f7f36a95-d07a-464f-80ee-5e6ec51e5e7d tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 23:12:36 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:12:36 user nova-compute[72766]:   <source dev="/dev/sdc"/>
Aug 14 23:12:36 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:12:36 user nova-compute[72766]:   <serial>9ea09372-d9b9-4edf-a8a6-99fc6f112309</serial>
Aug 14 23:12:36 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 23:12:36 user nova-compute[72766]: </disk>
Aug 14 23:12:36 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Received event <DeviceRemovedEvent: 1692054757.1235015, 9ec72ed8-0c33-4e70-ae88-d7571c84de2a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72766) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f7f36a95-d07a-464f-80ee-5e6ec51e5e7d tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9ec72ed8-0c33-4e70-ae88-d7571c84de2a {{(pid=72766) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 23:12:37 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-f7f36a95-d07a-464f-80ee-5e6ec51e5e7d tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Successfully detached device vdb from instance 9ec72ed8-0c33-4e70-ae88-d7571c84de2a from the live domain config.
Aug 14 23:12:37 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7f36a95-d07a-464f-80ee-5e6ec51e5e7d tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f36a95-d07a-464f-80ee-5e6ec51e5e7d tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NvZutIST', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:12:37 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-f7f36a95-d07a-464f-80ee-5e6ec51e5e7d tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:12:37 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-f7f36a95-d07a-464f-80ee-5e6ec51e5e7d tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-f7f36a95-d07a-464f-80ee-5e6ec51e5e7d tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f36a95-d07a-464f-80ee-5e6ec51e5e7d tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ab2a19-ac57-411b-b55f-4fddb7791fe7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[079908ca-3a76-4b89-8a85-4827d49e4f87]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f36a95-d07a-464f-80ee-5e6ec51e5e7d tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:12:37 user nova-compute[72766]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)
Aug 14 23:12:37 user nova-compute[72766]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309 (non-flash)
Aug 14 23:12:37 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f36a95-d07a-464f-80ee-5e6ec51e5e7d tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:12:37 user nova-compute[72766]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)
Aug 14 23:12:37 user nova-compute[72766]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309 (non-flash)
Aug 14 23:12:37 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f36a95-d07a-464f-80ee-5e6ec51e5e7d tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff15430ef80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309'): ({'sdc'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-f7f36a95-d07a-464f-80ee-5e6ec51e5e7d tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Removing single pathed devices sdc {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e5091b-3b25-45bb-a174-0bbc48d7e77d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a172921-e18d-4880-bfc6-663af22b992e]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-f7f36a95-d07a-464f-80ee-5e6ec51e5e7d tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Flushing IO for device /dev/sdc {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[71751f39-55e3-4a1e-9b49-20c6bb26ff6c]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-f7f36a95-d07a-464f-80ee-5e6ec51e5e7d tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[763855f6-9998-40a0-b300-ed1b367f75b0]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-f7f36a95-d07a-464f-80ee-5e6ec51e5e7d tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-f7f36a95-d07a-464f-80ee-5e6ec51e5e7d tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] SCSI volumes sdc have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f36a95-d07a-464f-80ee-5e6ec51e5e7d tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc5d83a-25e6-489d-b355-75a7ec0c1bf5]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f36a95-d07a-464f-80ee-5e6ec51e5e7d tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309 -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb2bd29-7c2b-491b-ae56-4ada5f8461b0]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f36a95-d07a-464f-80ee-5e6ec51e5e7d tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309, portal: 172.16.0.220,3260]
Aug 14 23:12:37 user nova-compute[72766]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309, portal: 172.16.0.220,3260] successful.
Aug 14 23:12:37 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309 -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ea09372-d9b9-4edf-a8a6-99fc6f112309 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[901ba3a6-3626-4e74-b34a-b22cbafb865e]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f36a95-d07a-464f-80ee-5e6ec51e5e7d tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-f7f36a95-d07a-464f-80ee-5e6ec51e5e7d tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f36a95-d07a-464f-80ee-5e6ec51e5e7d tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] <== disconnect_volume: return (269ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:12:37 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7f36a95-d07a-464f-80ee-5e6ec51e5e7d tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:12:38 user nova-compute[72766]: DEBUG nova.objects.instance [None req-f7f36a95-d07a-464f-80ee-5e6ec51e5e7d tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lazy-loading 'flavor' on Instance uuid 9ec72ed8-0c33-4e70-ae88-d7571c84de2a {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:12:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f7f36a95-d07a-464f-80ee-5e6ec51e5e7d tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "9ec72ed8-0c33-4e70-ae88-d7571c84de2a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.697s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:12:38 user nova-compute[72766]: DEBUG nova.compute.manager [req-1f203078-1315-4091-8053-93e7232a48e0 req-6092634a-3580-4384-9fd8-3310c86a7c11 service nova] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Received event network-changed-e2f51f15-395f-4f23-b946-0da2eef80a35 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:12:38 user nova-compute[72766]: DEBUG nova.compute.manager [req-1f203078-1315-4091-8053-93e7232a48e0 req-6092634a-3580-4384-9fd8-3310c86a7c11 service nova] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Refreshing instance network info cache due to event network-changed-e2f51f15-395f-4f23-b946-0da2eef80a35. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:12:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-1f203078-1315-4091-8053-93e7232a48e0 req-6092634a-3580-4384-9fd8-3310c86a7c11 service nova] Acquiring lock "refresh_cache-88009c57-377b-4636-ba54-1945c1bc7928" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:12:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-1f203078-1315-4091-8053-93e7232a48e0 req-6092634a-3580-4384-9fd8-3310c86a7c11 service nova] Acquired lock "refresh_cache-88009c57-377b-4636-ba54-1945c1bc7928" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:12:38 user nova-compute[72766]: DEBUG nova.network.neutron [req-1f203078-1315-4091-8053-93e7232a48e0 req-6092634a-3580-4384-9fd8-3310c86a7c11 service nova] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Refreshing network info cache for port e2f51f15-395f-4f23-b946-0da2eef80a35 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:12:39 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:12:39 user nova-compute[72766]: DEBUG nova.network.neutron [req-1f203078-1315-4091-8053-93e7232a48e0 req-6092634a-3580-4384-9fd8-3310c86a7c11 service nova] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Updated VIF entry in instance network info cache for port e2f51f15-395f-4f23-b946-0da2eef80a35. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:12:39 user nova-compute[72766]: DEBUG nova.network.neutron [req-1f203078-1315-4091-8053-93e7232a48e0 req-6092634a-3580-4384-9fd8-3310c86a7c11 service nova] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Updating instance_info_cache with network_info: [{"id": "e2f51f15-395f-4f23-b946-0da2eef80a35", "address": "fa:16:3e:72:6d:7f", "network": {"id": "d68d40ee-41e8-4e08-a00d-fc9c322c578a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1597134173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4877b20c8c2a4034923a341600e1d69f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f51f15-39", "ovs_interfaceid": "e2f51f15-395f-4f23-b946-0da2eef80a35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:12:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-1f203078-1315-4091-8053-93e7232a48e0 req-6092634a-3580-4384-9fd8-3310c86a7c11 service nova] Releasing lock "refresh_cache-88009c57-377b-4636-ba54-1945c1bc7928" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:12:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Acquiring lock "88009c57-377b-4636-ba54-1945c1bc7928" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:12:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lock "88009c57-377b-4636-ba54-1945c1bc7928" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:12:39 user nova-compute[72766]: DEBUG nova.objects.instance [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lazy-loading 'flavor' on Instance uuid 88009c57-377b-4636-ba54-1945c1bc7928 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:12:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lock "88009c57-377b-4636-ba54-1945c1bc7928" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:12:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Acquiring lock "88009c57-377b-4636-ba54-1945c1bc7928" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:12:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lock "88009c57-377b-4636-ba54-1945c1bc7928" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:12:40 user nova-compute[72766]: INFO nova.compute.manager [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Attaching volume 0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8 to /dev/vdb
Aug 14 23:12:40 user nova-compute[72766]: DEBUG os_brick.utils [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:12:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:40 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[68113d83-8918-4245-9866-31ae598a824d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:40 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5809fc-7e88-404f-b6b8-474146e34c4d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:40 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb08598-48c9-4a60-b66e-d45dc5542102]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:40 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af266ec-a626-4f95-a8ba-68e8896813ce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:12:40 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 23:12:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:12:40 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 23:12:40 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac11f49a-7ec1-40ae-b66c-fe65ddc07747]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:40 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 23:12:40 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 23:12:40 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 23:12:40 user nova-compute[72766]: DEBUG os_brick.utils [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:12:40 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Updating existing volume attachment record: da5ff0c5-a616-4d1c-975f-207e6a49033e {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 23:12:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:12:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:12:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:12:48 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 23:12:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QluUxPrj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:12:48 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:12:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:12:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:12:48 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:12:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:12:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:12:48 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 23:12:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8 -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:48 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c077c713-72a7-42f6-ac80-5c0625314e2c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 23:12:48 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:12:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:48 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e81e704-c734-4f80-aefa-aca56625fa9d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8] added
Aug 14 23:12:48 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:12:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:48 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f5122c-2244-4421-99f8-f96064021eb9]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:12:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:48 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a92441-6320-43e3-9b5c-c184593683c6]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:12:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QluUxPrj {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QluUxPrj" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:48 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[5983d61b-062f-4330-881c-ab3cedcd9fbf]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QluUxPrj'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:12:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:48 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6c4a7a-fd96-4df5-af6d-f421ef1366d3]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:12:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:49 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef622647-5c92-44d0-ab32-56ce3bf4e76d]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:49 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:12:49 user nova-compute[72766]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)
Aug 14 23:12:49 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:12:49 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:12:49 user nova-compute[72766]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)
Aug 14 23:12:49 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:12:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8 -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:49 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[cceb3543-d2ff-4495-8030-46289faabe74]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:49 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8, portal: 172.16.0.220,3260]
Aug 14 23:12:49 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8, portal: 172.16.0.220,3260] successful.
Aug 14 23:12:49 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:12:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:49 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3aefc6-7b0c-4e9b-a017-536d15de742f]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:49 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:12:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:49 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6cce122-e1e7-47f0-8771-d101ee93a0ad]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:49 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:12:49 user nova-compute[72766]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)
Aug 14 23:12:49 user nova-compute[72766]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8 (non-flash)
Aug 14 23:12:49 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:12:49 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:12:49 user nova-compute[72766]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)
Aug 14 23:12:49 user nova-compute[72766]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8 (non-flash)
Aug 14 23:12:49 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:12:49 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:12:49 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 23:12:49 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 23:12:49 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 23:12:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:49 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f719f39-a5ca-418c-9d47-c23a46d5c2a4]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:49 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:12:49 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QluUxPrj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 23:12:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:12:50 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:12:50 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23461373330653364', 'path': '/dev/sdc'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:12:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461373330653364', 'path': '/dev/sdc'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 23:12:50 user nova-compute[72766]: DEBUG nova.objects.instance [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lazy-loading 'flavor' on Instance uuid 88009c57-377b-4636-ba54-1945c1bc7928 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:12:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 23:12:50 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:12:50 user nova-compute[72766]:   <source dev="/dev/sdc"/>
Aug 14 23:12:50 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:12:50 user nova-compute[72766]:   <serial>0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8</serial>
Aug 14 23:12:50 user nova-compute[72766]: </disk>
Aug 14 23:12:50 user nova-compute[72766]:  {{(pid=72766) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 23:12:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:12:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:12:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] No VIF found with MAC fa:16:3e:72:6d:7f, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:12:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-4edaf7c5-7bad-4e2d-ae68-e7abf9f3f347 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lock "88009c57-377b-4636-ba54-1945c1bc7928" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.423s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:12:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:12:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-827540b7-9be4-4c95-a4b3-f75500bd5746 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquiring lock "66578337-cbff-4613-87a1-85ddabaebb2d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:12:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-827540b7-9be4-4c95-a4b3-f75500bd5746 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "66578337-cbff-4613-87a1-85ddabaebb2d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:12:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-827540b7-9be4-4c95-a4b3-f75500bd5746 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquiring lock "66578337-cbff-4613-87a1-85ddabaebb2d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:12:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-827540b7-9be4-4c95-a4b3-f75500bd5746 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "66578337-cbff-4613-87a1-85ddabaebb2d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:12:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-827540b7-9be4-4c95-a4b3-f75500bd5746 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "66578337-cbff-4613-87a1-85ddabaebb2d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:12:51 user nova-compute[72766]: INFO nova.compute.manager [None req-827540b7-9be4-4c95-a4b3-f75500bd5746 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Terminating instance
Aug 14 23:12:51 user nova-compute[72766]: DEBUG nova.compute.manager [None req-827540b7-9be4-4c95-a4b3-f75500bd5746 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:12:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:12:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:12:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:12:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:12:51 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Instance destroyed successfully.
Aug 14 23:12:51 user nova-compute[72766]: DEBUG nova.objects.instance [None req-827540b7-9be4-4c95-a4b3-f75500bd5746 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lazy-loading 'resources' on Instance uuid 66578337-cbff-4613-87a1-85ddabaebb2d {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:12:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-827540b7-9be4-4c95-a4b3-f75500bd5746 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:03:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-217587435',display_name='tempest-AttachVolumeTestJSON-server-217587435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-217587435',id=21,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBINZx5RlQmHKeHXxfdC+NXwuqcWxgRblOsB0YY2uiI6sAZZohfv46zguEF36eLiA7VkgzN1UzneQgr1/yAGU0LFY6JMqRhzyWlR9BBcwz/CmcDywCLsqGwbsFhgR7C+vTQ==',key_name='tempest-keypair-1163729093',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:03:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b1dd09415664f1aa0b0dbdeeb4b8d32',ramdisk_id='',reservation_id='r-p88w362t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-716158533',owner_user_name='tempest-AttachVolumeTestJSON-716158533-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:11:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a41813929144571a3306300dbf6f485',uuid=66578337-cbff-4613-87a1-85ddabaebb2d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "address": "fa:16:3e:e2:97:1e", "network": {"id": "b375da9b-b613-4a88-a262-962f959597b9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-462508113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1dd09415664f1aa0b0dbdeeb4b8d32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffc1761b-5d", "ovs_interfaceid": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:12:51 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-827540b7-9be4-4c95-a4b3-f75500bd5746 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Converting VIF {"id": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "address": "fa:16:3e:e2:97:1e", "network": {"id": "b375da9b-b613-4a88-a262-962f959597b9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-462508113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1dd09415664f1aa0b0dbdeeb4b8d32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffc1761b-5d", "ovs_interfaceid": "ffc1761b-5d95-4c58-9b92-b6b43b4823a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:12:51 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-827540b7-9be4-4c95-a4b3-f75500bd5746 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:97:1e,bridge_name='br-int',has_traffic_filtering=True,id=ffc1761b-5d95-4c58-9b92-b6b43b4823a6,network=Network(b375da9b-b613-4a88-a262-962f959597b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffc1761b-5d') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:12:51 user nova-compute[72766]: DEBUG os_vif [None req-827540b7-9be4-4c95-a4b3-f75500bd5746 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:97:1e,bridge_name='br-int',has_traffic_filtering=True,id=ffc1761b-5d95-4c58-9b92-b6b43b4823a6,network=Network(b375da9b-b613-4a88-a262-962f959597b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffc1761b-5d') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:12:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:12:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapffc1761b-5d, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:12:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:12:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:12:51 user nova-compute[72766]: INFO os_vif [None req-827540b7-9be4-4c95-a4b3-f75500bd5746 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:97:1e,bridge_name='br-int',has_traffic_filtering=True,id=ffc1761b-5d95-4c58-9b92-b6b43b4823a6,network=Network(b375da9b-b613-4a88-a262-962f959597b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffc1761b-5d')
Aug 14 23:12:51 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-827540b7-9be4-4c95-a4b3-f75500bd5746 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Deleting instance files /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d_del
Aug 14 23:12:51 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-827540b7-9be4-4c95-a4b3-f75500bd5746 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Deletion of /opt/stack/data/nova/instances/66578337-cbff-4613-87a1-85ddabaebb2d_del complete
Aug 14 23:12:51 user nova-compute[72766]: INFO nova.compute.manager [None req-827540b7-9be4-4c95-a4b3-f75500bd5746 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Took 0.67 seconds to destroy the instance on the hypervisor.
Aug 14 23:12:51 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-827540b7-9be4-4c95-a4b3-f75500bd5746 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:12:51 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:12:51 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:12:52 user nova-compute[72766]: DEBUG nova.compute.manager [req-1ccae5a8-e62c-4408-8159-d2da5fc31dc7 req-8dd78672-978a-4bcc-9506-ed5ff27fab9f service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Received event network-vif-unplugged-ffc1761b-5d95-4c58-9b92-b6b43b4823a6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:12:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-1ccae5a8-e62c-4408-8159-d2da5fc31dc7 req-8dd78672-978a-4bcc-9506-ed5ff27fab9f service nova] Acquiring lock "66578337-cbff-4613-87a1-85ddabaebb2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:12:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-1ccae5a8-e62c-4408-8159-d2da5fc31dc7 req-8dd78672-978a-4bcc-9506-ed5ff27fab9f service nova] Lock "66578337-cbff-4613-87a1-85ddabaebb2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:12:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-1ccae5a8-e62c-4408-8159-d2da5fc31dc7 req-8dd78672-978a-4bcc-9506-ed5ff27fab9f service nova] Lock "66578337-cbff-4613-87a1-85ddabaebb2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:12:52 user nova-compute[72766]: DEBUG nova.compute.manager [req-1ccae5a8-e62c-4408-8159-d2da5fc31dc7 req-8dd78672-978a-4bcc-9506-ed5ff27fab9f service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] No waiting events found dispatching network-vif-unplugged-ffc1761b-5d95-4c58-9b92-b6b43b4823a6 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:12:52 user nova-compute[72766]: DEBUG nova.compute.manager [req-1ccae5a8-e62c-4408-8159-d2da5fc31dc7 req-8dd78672-978a-4bcc-9506-ed5ff27fab9f service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Received event network-vif-unplugged-ffc1761b-5d95-4c58-9b92-b6b43b4823a6 for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:12:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:12:53 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:12:53 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Took 1.10 seconds to deallocate network for instance.
Aug 14 23:12:53 user nova-compute[72766]: DEBUG nova.compute.manager [req-0bb822ed-1209-4873-9d76-3a1a3a4043e3 req-c3c00854-391a-4bf6-817c-59bbbaca3ab5 service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Received event network-vif-deleted-ffc1761b-5d95-4c58-9b92-b6b43b4823a6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:12:53 user nova-compute[72766]: INFO nova.compute.manager [req-0bb822ed-1209-4873-9d76-3a1a3a4043e3 req-c3c00854-391a-4bf6-817c-59bbbaca3ab5 service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Neutron deleted interface ffc1761b-5d95-4c58-9b92-b6b43b4823a6; detaching it from the instance and deleting it from the info cache
Aug 14 23:12:53 user nova-compute[72766]: DEBUG nova.network.neutron [req-0bb822ed-1209-4873-9d76-3a1a3a4043e3 req-c3c00854-391a-4bf6-817c-59bbbaca3ab5 service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:12:53 user nova-compute[72766]: DEBUG nova.compute.manager [req-0bb822ed-1209-4873-9d76-3a1a3a4043e3 req-c3c00854-391a-4bf6-817c-59bbbaca3ab5 service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Detach interface failed, port_id=ffc1761b-5d95-4c58-9b92-b6b43b4823a6, reason: Instance 66578337-cbff-4613-87a1-85ddabaebb2d could not be found. {{(pid=72766) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 23:12:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-827540b7-9be4-4c95-a4b3-f75500bd5746 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:12:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-827540b7-9be4-4c95-a4b3-f75500bd5746 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:12:53 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-827540b7-9be4-4c95-a4b3-f75500bd5746 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:12:53 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-827540b7-9be4-4c95-a4b3-f75500bd5746 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:12:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-827540b7-9be4-4c95-a4b3-f75500bd5746 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.277s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:12:53 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-827540b7-9be4-4c95-a4b3-f75500bd5746 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Deleted allocations for instance 66578337-cbff-4613-87a1-85ddabaebb2d
Aug 14 23:12:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-827540b7-9be4-4c95-a4b3-f75500bd5746 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "66578337-cbff-4613-87a1-85ddabaebb2d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.218s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:12:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Acquiring lock "88009c57-377b-4636-ba54-1945c1bc7928" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:12:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lock "88009c57-377b-4636-ba54-1945c1bc7928" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:12:53 user nova-compute[72766]: DEBUG nova.objects.instance [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lazy-loading 'flavor' on Instance uuid 88009c57-377b-4636-ba54-1945c1bc7928 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:12:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lock "88009c57-377b-4636-ba54-1945c1bc7928" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:12:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Acquiring lock "88009c57-377b-4636-ba54-1945c1bc7928" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:12:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lock "88009c57-377b-4636-ba54-1945c1bc7928" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:12:53 user nova-compute[72766]: INFO nova.compute.manager [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Attaching volume 86cf7fe9-a817-4d43-9d19-e3819d640cbe to /dev/vdc
Aug 14 23:12:53 user nova-compute[72766]: DEBUG os_brick.utils [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:12:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:53 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece7fe18-25f2-4fd6-9d5a-af0f60294a4c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:53 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c20b55-834f-4bb7-9389-f3cfba73cf46]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:12:53 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec28806-da4c-442e-8c36-1d86a21cdfe7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:53 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0ec787-4a85-48fc-9fea-45984c05349f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:12:53 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 23:12:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:12:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:12:53 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 23:12:53 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[add0fd42-4e41-4241-b72b-2dad154315f9]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:12:53 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 23:12:53 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 23:12:53 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 23:12:53 user nova-compute[72766]: DEBUG os_brick.utils [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:12:53 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Updating existing volume attachment record: c88462b8-5b81-4f22-b0d0-403153bd7627 {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 23:12:54 user nova-compute[72766]: DEBUG nova.compute.manager [req-6f1bdbb7-19d7-4cf8-a73e-88eedc978c8f req-0cd6c166-8b45-4506-af1d-0a8f1460d8dd service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Received event network-vif-plugged-ffc1761b-5d95-4c58-9b92-b6b43b4823a6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:12:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-6f1bdbb7-19d7-4cf8-a73e-88eedc978c8f req-0cd6c166-8b45-4506-af1d-0a8f1460d8dd service nova] Acquiring lock "66578337-cbff-4613-87a1-85ddabaebb2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:12:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-6f1bdbb7-19d7-4cf8-a73e-88eedc978c8f req-0cd6c166-8b45-4506-af1d-0a8f1460d8dd service nova] Lock "66578337-cbff-4613-87a1-85ddabaebb2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:12:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-6f1bdbb7-19d7-4cf8-a73e-88eedc978c8f req-0cd6c166-8b45-4506-af1d-0a8f1460d8dd service nova] Lock "66578337-cbff-4613-87a1-85ddabaebb2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:12:54 user nova-compute[72766]: DEBUG nova.compute.manager [req-6f1bdbb7-19d7-4cf8-a73e-88eedc978c8f req-0cd6c166-8b45-4506-af1d-0a8f1460d8dd service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] No waiting events found dispatching network-vif-plugged-ffc1761b-5d95-4c58-9b92-b6b43b4823a6 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:12:54 user nova-compute[72766]: WARNING nova.compute.manager [req-6f1bdbb7-19d7-4cf8-a73e-88eedc978c8f req-0cd6c166-8b45-4506-af1d-0a8f1460d8dd service nova] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Received unexpected event network-vif-plugged-ffc1761b-5d95-4c58-9b92-b6b43b4823a6 for instance with vm_state deleted and task_state None.
Aug 14 23:12:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:12:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'utcqDahG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:13:02 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:13:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:13:02 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:13:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:13:02 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 23:13:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[56068cbe-0c7f-42cf-b026-979f323bb840]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 23:13:02 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2baea281-8c3a-475d-a763-91a5b1766f88]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe] added
Aug 14 23:13:02 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a854b376-7db1-4fb7-a087-8d43c5ec79dc]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a512cd-e5bd-4dc0-90f8-3184eabcdde0]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v utcqDahG {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v utcqDahG" returned: 0 in 0.025s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[38165ed7-6c4e-4c34-8175-83fe4aeae057]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'utcqDahG'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa24c4d-1ba1-4009-a302-4d8b40b58473]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e6090e-71ba-43b2-9262-a1a19258d11c]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:13:02 user nova-compute[72766]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)
Aug 14 23:13:02 user nova-compute[72766]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8 (non-flash)
Aug 14 23:13:02 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:13:02 user nova-compute[72766]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)
Aug 14 23:13:02 user nova-compute[72766]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8 (non-flash)
Aug 14 23:13:02 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[751c2dc5-8952-49ef-bf52-51caced7e1d0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe, portal: 172.16.0.220,3260]
Aug 14 23:13:02 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe, portal: 172.16.0.220,3260] successful.
Aug 14 23:13:02 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5eeb895-f4d0-48cb-ab05-af3002f548cd]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[25300e20-61d6-4b54-bf19-840f72324373]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:13:02 user nova-compute[72766]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)
Aug 14 23:13:02 user nova-compute[72766]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8 (non-flash)
Aug 14 23:13:02 user nova-compute[72766]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe (non-flash)
Aug 14 23:13:02 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:13:02 user nova-compute[72766]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)
Aug 14 23:13:02 user nova-compute[72766]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8 (non-flash)
Aug 14 23:13:02 user nova-compute[72766]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe (non-flash)
Aug 14 23:13:02 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[85005aac-0cc9-480c-bacb-cab4aa6207d1]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:13:02 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: None {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:13:03 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:13:03 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'utcqDahG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 23:13:03 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:13:03 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23036396466363233', 'path': '/dev/sdd'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:13:03 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036396466363233', 'path': '/dev/sdd'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 23:13:03 user nova-compute[72766]: DEBUG nova.objects.instance [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lazy-loading 'flavor' on Instance uuid 88009c57-377b-4636-ba54-1945c1bc7928 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:13:03 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 23:13:03 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:13:03 user nova-compute[72766]:   <source dev="/dev/sdd"/>
Aug 14 23:13:03 user nova-compute[72766]:   <target dev="vdc" bus="virtio"/>
Aug 14 23:13:03 user nova-compute[72766]:   <serial>86cf7fe9-a817-4d43-9d19-e3819d640cbe</serial>
Aug 14 23:13:03 user nova-compute[72766]: </disk>
Aug 14 23:13:03 user nova-compute[72766]:  {{(pid=72766) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 23:13:04 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:13:04 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:13:04 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:13:04 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] No VIF found with MAC fa:16:3e:72:6d:7f, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:13:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c5b3aa48-5a46-4f32-830a-ca238234fd10 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lock "88009c57-377b-4636-ba54-1945c1bc7928" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.672s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:13:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-20554e46-8acc-4387-bd7c-f711844b9528 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Acquiring lock "88009c57-377b-4636-ba54-1945c1bc7928" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:13:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-20554e46-8acc-4387-bd7c-f711844b9528 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lock "88009c57-377b-4636-ba54-1945c1bc7928" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:13:04 user nova-compute[72766]: INFO nova.compute.manager [None req-20554e46-8acc-4387-bd7c-f711844b9528 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Detaching volume 86cf7fe9-a817-4d43-9d19-e3819d640cbe
Aug 14 23:13:04 user nova-compute[72766]: INFO nova.virt.block_device [None req-20554e46-8acc-4387-bd7c-f711844b9528 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Attempting to driver detach volume 86cf7fe9-a817-4d43-9d19-e3819d640cbe from mountpoint /dev/vdc
Aug 14 23:13:04 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-20554e46-8acc-4387-bd7c-f711844b9528 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Attempting to detach device vdc from instance 88009c57-377b-4636-ba54-1945c1bc7928 from the persistent domain config. {{(pid=72766) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 23:13:04 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-20554e46-8acc-4387-bd7c-f711844b9528 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 23:13:04 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:13:04 user nova-compute[72766]:   <source dev="/dev/sdd"/>
Aug 14 23:13:04 user nova-compute[72766]:   <target dev="vdc" bus="virtio"/>
Aug 14 23:13:04 user nova-compute[72766]:   <serial>86cf7fe9-a817-4d43-9d19-e3819d640cbe</serial>
Aug 14 23:13:04 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 14 23:13:04 user nova-compute[72766]: </disk>
Aug 14 23:13:04 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 23:13:04 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-20554e46-8acc-4387-bd7c-f711844b9528 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Successfully detached device vdc from instance 88009c57-377b-4636-ba54-1945c1bc7928 from the persistent domain config.
Aug 14 23:13:04 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-20554e46-8acc-4387-bd7c-f711844b9528 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 88009c57-377b-4636-ba54-1945c1bc7928 from the live domain config. {{(pid=72766) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 23:13:04 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-20554e46-8acc-4387-bd7c-f711844b9528 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 23:13:04 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:13:04 user nova-compute[72766]:   <source dev="/dev/sdd"/>
Aug 14 23:13:04 user nova-compute[72766]:   <target dev="vdc" bus="virtio"/>
Aug 14 23:13:04 user nova-compute[72766]:   <serial>86cf7fe9-a817-4d43-9d19-e3819d640cbe</serial>
Aug 14 23:13:04 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 14 23:13:04 user nova-compute[72766]: </disk>
Aug 14 23:13:04 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Received event <DeviceRemovedEvent: 1692054785.2904193, 88009c57-377b-4636-ba54-1945c1bc7928 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72766) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-20554e46-8acc-4387-bd7c-f711844b9528 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 88009c57-377b-4636-ba54-1945c1bc7928 {{(pid=72766) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 23:13:05 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-20554e46-8acc-4387-bd7c-f711844b9528 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Successfully detached device vdc from instance 88009c57-377b-4636-ba54-1945c1bc7928 from the live domain config.
Aug 14 23:13:05 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20554e46-8acc-4387-bd7c-f711844b9528 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-20554e46-8acc-4387-bd7c-f711844b9528 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'utcqDahG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:13:05 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-20554e46-8acc-4387-bd7c-f711844b9528 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:13:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-20554e46-8acc-4387-bd7c-f711844b9528 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-20554e46-8acc-4387-bd7c-f711844b9528 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-20554e46-8acc-4387-bd7c-f711844b9528 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc3ca1b-42c1-4217-a61a-960143093512]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68f01af-e257-44c4-801b-840208e7c344]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-20554e46-8acc-4387-bd7c-f711844b9528 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:13:05 user nova-compute[72766]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)
Aug 14 23:13:05 user nova-compute[72766]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8 (non-flash)
Aug 14 23:13:05 user nova-compute[72766]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe (non-flash)
Aug 14 23:13:05 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-20554e46-8acc-4387-bd7c-f711844b9528 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:13:05 user nova-compute[72766]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)
Aug 14 23:13:05 user nova-compute[72766]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8 (non-flash)
Aug 14 23:13:05 user nova-compute[72766]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe (non-flash)
Aug 14 23:13:05 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-20554e46-8acc-4387-bd7c-f711844b9528 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff1544c7d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe'): ({'sdd'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-20554e46-8acc-4387-bd7c-f711844b9528 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Removing single pathed devices sdd {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e97073-d93f-4106-b129-eb65697462b9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e42e3a-7a86-47b8-878c-d76a96cb400e]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-20554e46-8acc-4387-bd7c-f711844b9528 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Flushing IO for device /dev/sdd {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e572cb7f-3b53-4d22-a0ff-42657fc7e836]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-20554e46-8acc-4387-bd7c-f711844b9528 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f6566a-ad3d-44bd-8dd4-5c927e534a2e]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-20554e46-8acc-4387-bd7c-f711844b9528 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-20554e46-8acc-4387-bd7c-f711844b9528 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] SCSI volumes sdd have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-20554e46-8acc-4387-bd7c-f711844b9528 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e8d9c8-6da1-4eb7-bde4-a2c92bcda9b2]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-20554e46-8acc-4387-bd7c-f711844b9528 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[193620bc-37d9-48a4-8c1a-0f8a11f2ab9b]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-20554e46-8acc-4387-bd7c-f711844b9528 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe, portal: 172.16.0.220,3260]
Aug 14 23:13:05 user nova-compute[72766]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe, portal: 172.16.0.220,3260] successful.
Aug 14 23:13:05 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86cf7fe9-a817-4d43-9d19-e3819d640cbe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ad435a-2ec3-4236-9133-6d9e51a0ddcf]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-20554e46-8acc-4387-bd7c-f711844b9528 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-20554e46-8acc-4387-bd7c-f711844b9528 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-20554e46-8acc-4387-bd7c-f711844b9528 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] <== disconnect_volume: return (289ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:13:05 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20554e46-8acc-4387-bd7c-f711844b9528 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:13:06 user nova-compute[72766]: DEBUG nova.objects.instance [None req-20554e46-8acc-4387-bd7c-f711844b9528 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lazy-loading 'flavor' on Instance uuid 88009c57-377b-4636-ba54-1945c1bc7928 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:13:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-20554e46-8acc-4387-bd7c-f711844b9528 tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lock "88009c57-377b-4636-ba54-1945c1bc7928" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.745s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:13:06 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692054771.8602238, 66578337-cbff-4613-87a1-85ddabaebb2d => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:13:06 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] VM Stopped (Lifecycle Event)
Aug 14 23:13:06 user nova-compute[72766]: DEBUG nova.compute.manager [None req-0ec1e54d-a455-43f2-a196-32a487136ba4 None None] [instance: 66578337-cbff-4613-87a1-85ddabaebb2d] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:13:06 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:13:06 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:13:06 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:13:06 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:13:06 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:13:06 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:10 user nova-compute[72766]: DEBUG nova.compute.manager [req-42b28149-39ae-47a2-a140-ab17915754f3 req-9f8546fe-ee88-44f6-85da-6c54326e46c5 service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Received event network-changed-d75b30b8-130a-44f8-b342-28a13e78fcd1 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:13:10 user nova-compute[72766]: DEBUG nova.compute.manager [req-42b28149-39ae-47a2-a140-ab17915754f3 req-9f8546fe-ee88-44f6-85da-6c54326e46c5 service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Refreshing instance network info cache due to event network-changed-d75b30b8-130a-44f8-b342-28a13e78fcd1. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:13:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-42b28149-39ae-47a2-a140-ab17915754f3 req-9f8546fe-ee88-44f6-85da-6c54326e46c5 service nova] Acquiring lock "refresh_cache-34998d61-8b57-453c-a16c-5bb7a2b2c96c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:13:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-42b28149-39ae-47a2-a140-ab17915754f3 req-9f8546fe-ee88-44f6-85da-6c54326e46c5 service nova] Acquired lock "refresh_cache-34998d61-8b57-453c-a16c-5bb7a2b2c96c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:13:10 user nova-compute[72766]: DEBUG nova.network.neutron [req-42b28149-39ae-47a2-a140-ab17915754f3 req-9f8546fe-ee88-44f6-85da-6c54326e46c5 service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Refreshing network info cache for port d75b30b8-130a-44f8-b342-28a13e78fcd1 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:13:10 user nova-compute[72766]: DEBUG nova.network.neutron [req-42b28149-39ae-47a2-a140-ab17915754f3 req-9f8546fe-ee88-44f6-85da-6c54326e46c5 service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Updated VIF entry in instance network info cache for port d75b30b8-130a-44f8-b342-28a13e78fcd1. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:13:10 user nova-compute[72766]: DEBUG nova.network.neutron [req-42b28149-39ae-47a2-a140-ab17915754f3 req-9f8546fe-ee88-44f6-85da-6c54326e46c5 service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Updating instance_info_cache with network_info: [{"id": "d75b30b8-130a-44f8-b342-28a13e78fcd1", "address": "fa:16:3e:b3:d6:8a", "network": {"id": "ed86b27c-3e64-4c0a-8824-9bf68068058a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-506861998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f36bd126bda43c6971bccdef2b1da91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd75b30b8-13", "ovs_interfaceid": "d75b30b8-130a-44f8-b342-28a13e78fcd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:13:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-42b28149-39ae-47a2-a140-ab17915754f3 req-9f8546fe-ee88-44f6-85da-6c54326e46c5 service nova] Releasing lock "refresh_cache-34998d61-8b57-453c-a16c-5bb7a2b2c96c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:13:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-35392745-d9c7-4870-8399-39a79521cc94 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquiring lock "34998d61-8b57-453c-a16c-5bb7a2b2c96c" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:13:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-35392745-d9c7-4870-8399-39a79521cc94 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "34998d61-8b57-453c-a16c-5bb7a2b2c96c" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:13:14 user nova-compute[72766]: INFO nova.compute.manager [None req-35392745-d9c7-4870-8399-39a79521cc94 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Shelving
Aug 14 23:13:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:15 user nova-compute[72766]: DEBUG nova.compute.manager [req-bbf40504-ff2e-4642-aa82-0d889218c738 req-6cd63a92-ef36-4f2f-a9fb-f23a0f26e0c6 service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Received event network-vif-unplugged-d75b30b8-130a-44f8-b342-28a13e78fcd1 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:13:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-bbf40504-ff2e-4642-aa82-0d889218c738 req-6cd63a92-ef36-4f2f-a9fb-f23a0f26e0c6 service nova] Acquiring lock "34998d61-8b57-453c-a16c-5bb7a2b2c96c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:13:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-bbf40504-ff2e-4642-aa82-0d889218c738 req-6cd63a92-ef36-4f2f-a9fb-f23a0f26e0c6 service nova] Lock "34998d61-8b57-453c-a16c-5bb7a2b2c96c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:13:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-bbf40504-ff2e-4642-aa82-0d889218c738 req-6cd63a92-ef36-4f2f-a9fb-f23a0f26e0c6 service nova] Lock "34998d61-8b57-453c-a16c-5bb7a2b2c96c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:13:15 user nova-compute[72766]: DEBUG nova.compute.manager [req-bbf40504-ff2e-4642-aa82-0d889218c738 req-6cd63a92-ef36-4f2f-a9fb-f23a0f26e0c6 service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] No waiting events found dispatching network-vif-unplugged-d75b30b8-130a-44f8-b342-28a13e78fcd1 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:13:15 user nova-compute[72766]: WARNING nova.compute.manager [req-bbf40504-ff2e-4642-aa82-0d889218c738 req-6cd63a92-ef36-4f2f-a9fb-f23a0f26e0c6 service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Received unexpected event network-vif-unplugged-d75b30b8-130a-44f8-b342-28a13e78fcd1 for instance with vm_state active and task_state shelving.
Aug 14 23:13:15 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Instance destroyed successfully.
Aug 14 23:13:15 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-35392745-d9c7-4870-8399-39a79521cc94 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Beginning cold snapshot process
Aug 14 23:13:15 user nova-compute[72766]: DEBUG nova.privsep.utils [None req-35392745-d9c7-4870-8399-39a79521cc94 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72766) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 23:13:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-35392745-d9c7-4870-8399-39a79521cc94 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/34998d61-8b57-453c-a16c-5bb7a2b2c96c/disk /opt/stack/data/nova/instances/snapshots/tmp3i343lrd/2b0649e618744569a4c475eaebcb8631 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-35392745-d9c7-4870-8399-39a79521cc94 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/34998d61-8b57-453c-a16c-5bb7a2b2c96c/disk /opt/stack/data/nova/instances/snapshots/tmp3i343lrd/2b0649e618744569a4c475eaebcb8631" returned: 0 in 0.652s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:16 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-35392745-d9c7-4870-8399-39a79521cc94 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Snapshot extracted, beginning image upload
Aug 14 23:13:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:17 user nova-compute[72766]: DEBUG nova.compute.manager [req-b807ed43-6f38-4d25-a686-3ccd0f1fd939 req-da18a5c7-b088-4e76-922e-699d80b98bf9 service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Received event network-vif-plugged-d75b30b8-130a-44f8-b342-28a13e78fcd1 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:13:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-b807ed43-6f38-4d25-a686-3ccd0f1fd939 req-da18a5c7-b088-4e76-922e-699d80b98bf9 service nova] Acquiring lock "34998d61-8b57-453c-a16c-5bb7a2b2c96c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:13:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-b807ed43-6f38-4d25-a686-3ccd0f1fd939 req-da18a5c7-b088-4e76-922e-699d80b98bf9 service nova] Lock "34998d61-8b57-453c-a16c-5bb7a2b2c96c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:13:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-b807ed43-6f38-4d25-a686-3ccd0f1fd939 req-da18a5c7-b088-4e76-922e-699d80b98bf9 service nova] Lock "34998d61-8b57-453c-a16c-5bb7a2b2c96c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:13:17 user nova-compute[72766]: DEBUG nova.compute.manager [req-b807ed43-6f38-4d25-a686-3ccd0f1fd939 req-da18a5c7-b088-4e76-922e-699d80b98bf9 service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] No waiting events found dispatching network-vif-plugged-d75b30b8-130a-44f8-b342-28a13e78fcd1 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:13:17 user nova-compute[72766]: WARNING nova.compute.manager [req-b807ed43-6f38-4d25-a686-3ccd0f1fd939 req-da18a5c7-b088-4e76-922e-699d80b98bf9 service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Received unexpected event network-vif-plugged-d75b30b8-130a-44f8-b342-28a13e78fcd1 for instance with vm_state active and task_state shelving_image_uploading.
Aug 14 23:13:18 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-35392745-d9c7-4870-8399-39a79521cc94 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Snapshot image upload complete
Aug 14 23:13:18 user nova-compute[72766]: DEBUG nova.compute.manager [None req-35392745-d9c7-4870-8399-39a79521cc94 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:13:18 user nova-compute[72766]: INFO nova.compute.manager [None req-35392745-d9c7-4870-8399-39a79521cc94 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Shelve offloading
Aug 14 23:13:18 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Instance destroyed successfully.
Aug 14 23:13:18 user nova-compute[72766]: DEBUG nova.compute.manager [None req-35392745-d9c7-4870-8399-39a79521cc94 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:13:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-35392745-d9c7-4870-8399-39a79521cc94 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquiring lock "refresh_cache-34998d61-8b57-453c-a16c-5bb7a2b2c96c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:13:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-35392745-d9c7-4870-8399-39a79521cc94 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquired lock "refresh_cache-34998d61-8b57-453c-a16c-5bb7a2b2c96c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:13:18 user nova-compute[72766]: DEBUG nova.network.neutron [None req-35392745-d9c7-4870-8399-39a79521cc94 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:13:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:19 user nova-compute[72766]: DEBUG nova.network.neutron [None req-35392745-d9c7-4870-8399-39a79521cc94 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Updating instance_info_cache with network_info: [{"id": "d75b30b8-130a-44f8-b342-28a13e78fcd1", "address": "fa:16:3e:b3:d6:8a", "network": {"id": "ed86b27c-3e64-4c0a-8824-9bf68068058a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-506861998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f36bd126bda43c6971bccdef2b1da91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd75b30b8-13", "ovs_interfaceid": "d75b30b8-130a-44f8-b342-28a13e78fcd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:13:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-35392745-d9c7-4870-8399-39a79521cc94 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Releasing lock "refresh_cache-34998d61-8b57-453c-a16c-5bb7a2b2c96c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:13:20 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Instance destroyed successfully.
Aug 14 23:13:20 user nova-compute[72766]: DEBUG nova.objects.instance [None req-35392745-d9c7-4870-8399-39a79521cc94 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lazy-loading 'resources' on Instance uuid 34998d61-8b57-453c-a16c-5bb7a2b2c96c {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:13:20 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-35392745-d9c7-4870-8399-39a79521cc94 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:11:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-573188518',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-573188518',id=30,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpCVNDOqJWsIopbIhA73fRWIMxhbGF3wyhqjeShQpFoDYaqRQlt+NjAJQM0+PHWFUaev0WNxHDrS1h03CUy+jZZz1Sbi35V266D2CLbwQbdXvPbnjiItTGPMQSCRiXk9A==',key_name='tempest-keypair-2040959384',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:11:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3f36bd126bda43c6971bccdef2b1da91',ramdisk_id='',reservation_id='r-wzdhb2yu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1828708750',owner_user_name='tempest-AttachVolumeShelveTestJSON-1828708750-project-member',shelved_at='2023-08-14T23:13:18.678459',shelved_host='user',shelved_image_id='56d0796d-81d0-4dd4-b6ff-221b8452e7cd'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:13:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb167893135e4073928a60630ae7720c',uuid=34998d61-8b57-453c-a16c-5bb7a2b2c96c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "d75b30b8-130a-44f8-b342-28a13e78fcd1", "address": "fa:16:3e:b3:d6:8a", "network": {"id": "ed86b27c-3e64-4c0a-8824-9bf68068058a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-506861998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f36bd126bda43c6971bccdef2b1da91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd75b30b8-13", "ovs_interfaceid": "d75b30b8-130a-44f8-b342-28a13e78fcd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:13:20 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-35392745-d9c7-4870-8399-39a79521cc94 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Converting VIF {"id": "d75b30b8-130a-44f8-b342-28a13e78fcd1", "address": "fa:16:3e:b3:d6:8a", "network": {"id": "ed86b27c-3e64-4c0a-8824-9bf68068058a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-506861998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f36bd126bda43c6971bccdef2b1da91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd75b30b8-13", "ovs_interfaceid": "d75b30b8-130a-44f8-b342-28a13e78fcd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:13:20 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-35392745-d9c7-4870-8399-39a79521cc94 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:d6:8a,bridge_name='br-int',has_traffic_filtering=True,id=d75b30b8-130a-44f8-b342-28a13e78fcd1,network=Network(ed86b27c-3e64-4c0a-8824-9bf68068058a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd75b30b8-13') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:13:20 user nova-compute[72766]: DEBUG os_vif [None req-35392745-d9c7-4870-8399-39a79521cc94 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:d6:8a,bridge_name='br-int',has_traffic_filtering=True,id=d75b30b8-130a-44f8-b342-28a13e78fcd1,network=Network(ed86b27c-3e64-4c0a-8824-9bf68068058a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd75b30b8-13') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:13:20 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:20 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd75b30b8-13, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:13:20 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:20 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:13:20 user nova-compute[72766]: DEBUG nova.compute.manager [req-7c46af5a-d130-403d-a65d-9ba9dc5ac57b req-239d8bbb-a2be-4095-84e7-3b9a86a3e888 service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Received event network-changed-d75b30b8-130a-44f8-b342-28a13e78fcd1 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:13:20 user nova-compute[72766]: DEBUG nova.compute.manager [req-7c46af5a-d130-403d-a65d-9ba9dc5ac57b req-239d8bbb-a2be-4095-84e7-3b9a86a3e888 service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Refreshing instance network info cache due to event network-changed-d75b30b8-130a-44f8-b342-28a13e78fcd1. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:13:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7c46af5a-d130-403d-a65d-9ba9dc5ac57b req-239d8bbb-a2be-4095-84e7-3b9a86a3e888 service nova] Acquiring lock "refresh_cache-34998d61-8b57-453c-a16c-5bb7a2b2c96c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:13:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7c46af5a-d130-403d-a65d-9ba9dc5ac57b req-239d8bbb-a2be-4095-84e7-3b9a86a3e888 service nova] Acquired lock "refresh_cache-34998d61-8b57-453c-a16c-5bb7a2b2c96c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:13:20 user nova-compute[72766]: DEBUG nova.network.neutron [req-7c46af5a-d130-403d-a65d-9ba9dc5ac57b req-239d8bbb-a2be-4095-84e7-3b9a86a3e888 service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Refreshing network info cache for port d75b30b8-130a-44f8-b342-28a13e78fcd1 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:13:20 user nova-compute[72766]: INFO os_vif [None req-35392745-d9c7-4870-8399-39a79521cc94 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:d6:8a,bridge_name='br-int',has_traffic_filtering=True,id=d75b30b8-130a-44f8-b342-28a13e78fcd1,network=Network(ed86b27c-3e64-4c0a-8824-9bf68068058a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd75b30b8-13')
Aug 14 23:13:20 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-35392745-d9c7-4870-8399-39a79521cc94 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Deleting instance files /opt/stack/data/nova/instances/34998d61-8b57-453c-a16c-5bb7a2b2c96c_del
Aug 14 23:13:20 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-35392745-d9c7-4870-8399-39a79521cc94 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Deletion of /opt/stack/data/nova/instances/34998d61-8b57-453c-a16c-5bb7a2b2c96c_del complete
Aug 14 23:13:20 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-35392745-d9c7-4870-8399-39a79521cc94 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Deleted allocations for instance 34998d61-8b57-453c-a16c-5bb7a2b2c96c
Aug 14 23:13:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-35392745-d9c7-4870-8399-39a79521cc94 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:13:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-35392745-d9c7-4870-8399-39a79521cc94 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:13:20 user nova-compute[72766]: DEBUG nova.objects.instance [None req-35392745-d9c7-4870-8399-39a79521cc94 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lazy-loading 'numa_topology' on Instance uuid 34998d61-8b57-453c-a16c-5bb7a2b2c96c {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:13:20 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-35392745-d9c7-4870-8399-39a79521cc94 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:13:20 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-35392745-d9c7-4870-8399-39a79521cc94 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:13:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-35392745-d9c7-4870-8399-39a79521cc94 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.240s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:13:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-35392745-d9c7-4870-8399-39a79521cc94 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "34998d61-8b57-453c-a16c-5bb7a2b2c96c" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.891s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:13:20 user nova-compute[72766]: DEBUG nova.network.neutron [req-7c46af5a-d130-403d-a65d-9ba9dc5ac57b req-239d8bbb-a2be-4095-84e7-3b9a86a3e888 service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Updated VIF entry in instance network info cache for port d75b30b8-130a-44f8-b342-28a13e78fcd1. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:13:20 user nova-compute[72766]: DEBUG nova.network.neutron [req-7c46af5a-d130-403d-a65d-9ba9dc5ac57b req-239d8bbb-a2be-4095-84e7-3b9a86a3e888 service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Updating instance_info_cache with network_info: [{"id": "d75b30b8-130a-44f8-b342-28a13e78fcd1", "address": "fa:16:3e:b3:d6:8a", "network": {"id": "ed86b27c-3e64-4c0a-8824-9bf68068058a", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-506861998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f36bd126bda43c6971bccdef2b1da91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapd75b30b8-13", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:13:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7c46af5a-d130-403d-a65d-9ba9dc5ac57b req-239d8bbb-a2be-4095-84e7-3b9a86a3e888 service nova] Releasing lock "refresh_cache-34998d61-8b57-453c-a16c-5bb7a2b2c96c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:13:25 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:26 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:13:27 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:13:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:29 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:13:29 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:13:29 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:13:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-cbcf7851-e6f7-4f46-97cc-d773286ccddf" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:13:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-cbcf7851-e6f7-4f46-97cc-d773286ccddf" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:13:29 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:13:30 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:30 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Updating instance_info_cache with network_info: [{"id": "8f65f8f0-60fe-4fdb-af66-424a85b12caf", "address": "fa:16:3e:70:30:66", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f65f8f0-60", "ovs_interfaceid": "8f65f8f0-60fe-4fdb-af66-424a85b12caf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:13:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-cbcf7851-e6f7-4f46-97cc-d773286ccddf" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:13:30 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:13:30 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:13:30 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:13:30 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692054795.5452907, 34998d61-8b57-453c-a16c-5bb7a2b2c96c => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:13:30 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] VM Stopped (Lifecycle Event)
Aug 14 23:13:30 user nova-compute[72766]: DEBUG nova.compute.manager [None req-5bef6f0f-6bd4-4ca0-bd10-7f86962f2fa4 None None] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:13:30 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:13:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:13:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:13:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:13:30 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:13:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:13:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:13:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88009c57-377b-4636-ba54-1945c1bc7928/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88009c57-377b-4636-ba54-1945c1bc7928/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88009c57-377b-4636-ba54-1945c1bc7928/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88009c57-377b-4636-ba54-1945c1bc7928/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:32 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:13:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:33 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:13:33 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:13:33 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=8107MB free_disk=25.312870025634766GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:13:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:13:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:13:33 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 3ff300ff-34fd-4e94-9d2d-681fb133ba32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:13:33 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance cbcf7851-e6f7-4f46-97cc-d773286ccddf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:13:33 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 83084ccc-8e55-43dc-9a37-ffcb35a10922 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:13:33 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 71970b47-b09b-4492-9d99-a2be8b3b2042 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:13:33 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 9ec72ed8-0c33-4e70-ae88-d7571c84de2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:13:33 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 88009c57-377b-4636-ba54-1945c1bc7928 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:13:33 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 901fe741-3b2f-472e-b91c-a90c9d4a9c39 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:13:33 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:13:33 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:13:33 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:13:33 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:13:33 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:13:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.356s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:13:34 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:13:34 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:13:34 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:13:35 user nova-compute[72766]: DEBUG nova.compute.manager [None req-bf8dc1fd-9101-4150-a076-5fc658695364 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:13:35 user nova-compute[72766]: INFO nova.compute.manager [None req-bf8dc1fd-9101-4150-a076-5fc658695364 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] instance snapshotting
Aug 14 23:13:35 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-bf8dc1fd-9101-4150-a076-5fc658695364 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Beginning live snapshot process
Aug 14 23:13:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-bf8dc1fd-9101-4150-a076-5fc658695364 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a/disk --force-share --output=json -f qcow2 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-bf8dc1fd-9101-4150-a076-5fc658695364 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a/disk --force-share --output=json -f qcow2" returned: 0 in 0.189s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-bf8dc1fd-9101-4150-a076-5fc658695364 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a/disk --force-share --output=json -f qcow2 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-bf8dc1fd-9101-4150-a076-5fc658695364 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a/disk --force-share --output=json -f qcow2" returned: 0 in 0.172s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-bf8dc1fd-9101-4150-a076-5fc658695364 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:35 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:13:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-bf8dc1fd-9101-4150-a076-5fc658695364 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.180s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-bf8dc1fd-9101-4150-a076-5fc658695364 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9rnerup6/833192ef274947a1bf719dfe70e6e9f8.delta 1073741824 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-bf8dc1fd-9101-4150-a076-5fc658695364 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9rnerup6/833192ef274947a1bf719dfe70e6e9f8.delta 1073741824" returned: 0 in 0.050s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:35 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-bf8dc1fd-9101-4150-a076-5fc658695364 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 14 23:13:36 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-bf8dc1fd-9101-4150-a076-5fc658695364 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=72766) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 23:13:37 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-bf8dc1fd-9101-4150-a076-5fc658695364 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72766) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 23:13:37 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-bf8dc1fd-9101-4150-a076-5fc658695364 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 14 23:13:37 user nova-compute[72766]: DEBUG nova.privsep.utils [None req-bf8dc1fd-9101-4150-a076-5fc658695364 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72766) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 23:13:37 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-bf8dc1fd-9101-4150-a076-5fc658695364 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9rnerup6/833192ef274947a1bf719dfe70e6e9f8.delta /opt/stack/data/nova/instances/snapshots/tmp9rnerup6/833192ef274947a1bf719dfe70e6e9f8 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:37 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-bf8dc1fd-9101-4150-a076-5fc658695364 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9rnerup6/833192ef274947a1bf719dfe70e6e9f8.delta /opt/stack/data/nova/instances/snapshots/tmp9rnerup6/833192ef274947a1bf719dfe70e6e9f8" returned: 0 in 0.238s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:37 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-bf8dc1fd-9101-4150-a076-5fc658695364 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Snapshot extracted, beginning image upload
Aug 14 23:13:40 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-bf8dc1fd-9101-4150-a076-5fc658695364 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Snapshot image upload complete
Aug 14 23:13:40 user nova-compute[72766]: INFO nova.compute.manager [None req-bf8dc1fd-9101-4150-a076-5fc658695364 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Took 4.96 seconds to snapshot the instance on the hypervisor.
Aug 14 23:13:40 user nova-compute[72766]: INFO nova.compute.manager [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Rescuing
Aug 14 23:13:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "refresh_cache-901fe741-3b2f-472e-b91c-a90c9d4a9c39" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:13:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquired lock "refresh_cache-901fe741-3b2f-472e-b91c-a90c9d4a9c39" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:13:40 user nova-compute[72766]: DEBUG nova.network.neutron [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:13:40 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:40 user nova-compute[72766]: DEBUG nova.network.neutron [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Updating instance_info_cache with network_info: [{"id": "f2f08b69-eb49-4a38-9357-36420ee797d6", "address": "fa:16:3e:44:c6:dd", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f08b69-eb", "ovs_interfaceid": "f2f08b69-eb49-4a38-9357-36420ee797d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:13:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Releasing lock "refresh_cache-901fe741-3b2f-472e-b91c-a90c9d4a9c39" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:13:40 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:40 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:40 user nova-compute[72766]: DEBUG nova.compute.manager [req-4a885048-1e4a-40c4-85c7-b2d94b493596 req-4e3f100e-dbc9-4c7f-bbd5-ed9c310a3c5d service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Received event network-vif-unplugged-f2f08b69-eb49-4a38-9357-36420ee797d6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:13:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-4a885048-1e4a-40c4-85c7-b2d94b493596 req-4e3f100e-dbc9-4c7f-bbd5-ed9c310a3c5d service nova] Acquiring lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:13:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-4a885048-1e4a-40c4-85c7-b2d94b493596 req-4e3f100e-dbc9-4c7f-bbd5-ed9c310a3c5d service nova] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:13:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-4a885048-1e4a-40c4-85c7-b2d94b493596 req-4e3f100e-dbc9-4c7f-bbd5-ed9c310a3c5d service nova] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:13:40 user nova-compute[72766]: DEBUG nova.compute.manager [req-4a885048-1e4a-40c4-85c7-b2d94b493596 req-4e3f100e-dbc9-4c7f-bbd5-ed9c310a3c5d service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] No waiting events found dispatching network-vif-unplugged-f2f08b69-eb49-4a38-9357-36420ee797d6 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:13:40 user nova-compute[72766]: WARNING nova.compute.manager [req-4a885048-1e4a-40c4-85c7-b2d94b493596 req-4e3f100e-dbc9-4c7f-bbd5-ed9c310a3c5d service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Received unexpected event network-vif-unplugged-f2f08b69-eb49-4a38-9357-36420ee797d6 for instance with vm_state active and task_state rescuing.
Aug 14 23:13:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:41 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Instance destroyed successfully.
Aug 14 23:13:41 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Attempting a stable device rescue
Aug 14 23:13:41 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72766) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 23:13:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:41 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Instance directory exists: not creating {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 23:13:41 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Creating image(s)
Aug 14 23:13:41 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "/opt/stack/data/nova/instances/901fe741-3b2f-472e-b91c-a90c9d4a9c39/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:13:41 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "/opt/stack/data/nova/instances/901fe741-3b2f-472e-b91c-a90c9d4a9c39/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:13:41 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "/opt/stack/data/nova/instances/901fe741-3b2f-472e-b91c-a90c9d4a9c39/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:13:41 user nova-compute[72766]: DEBUG nova.objects.instance [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lazy-loading 'trusted_certs' on Instance uuid 901fe741-3b2f-472e-b91c-a90c9d4a9c39 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:13:41 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "7a1b02c698f0ea3c3e662cb1c8d8fabe602c64a7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:13:41 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "7a1b02c698f0ea3c3e662cb1c8d8fabe602c64a7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:13:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:42 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a1b02c698f0ea3c3e662cb1c8d8fabe602c64a7.part --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:42 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Acquiring lock "c45186c1-193e-4d52-a09b-aa8d18195c8e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:13:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "c45186c1-193e-4d52-a09b-aa8d18195c8e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:13:42 user nova-compute[72766]: DEBUG nova.compute.manager [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 23:13:42 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a1b02c698f0ea3c3e662cb1c8d8fabe602c64a7.part --force-share --output=json" returned: 0 in 0.186s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:42 user nova-compute[72766]: DEBUG nova.virt.images [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] 68115d6f-2d48-4dc1-9ced-c499459c5fc0 was qcow2, converting to raw {{(pid=72766) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 23:13:42 user nova-compute[72766]: DEBUG nova.privsep.utils [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72766) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 23:13:42 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7a1b02c698f0ea3c3e662cb1c8d8fabe602c64a7.part /opt/stack/data/nova/instances/_base/7a1b02c698f0ea3c3e662cb1c8d8fabe602c64a7.converted {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:13:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:13:42 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 23:13:42 user nova-compute[72766]: INFO nova.compute.claims [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Claim successful on node user
Aug 14 23:13:42 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7a1b02c698f0ea3c3e662cb1c8d8fabe602c64a7.part /opt/stack/data/nova/instances/_base/7a1b02c698f0ea3c3e662cb1c8d8fabe602c64a7.converted" returned: 0 in 0.187s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:42 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a1b02c698f0ea3c3e662cb1c8d8fabe602c64a7.converted --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG nova.compute.manager [req-9c9917ca-819d-42a3-af8f-a015df78e957 req-f17d3f19-2d30-450c-a308-b89467120010 service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Received event network-vif-plugged-f2f08b69-eb49-4a38-9357-36420ee797d6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9c9917ca-819d-42a3-af8f-a015df78e957 req-f17d3f19-2d30-450c-a308-b89467120010 service nova] Acquiring lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9c9917ca-819d-42a3-af8f-a015df78e957 req-f17d3f19-2d30-450c-a308-b89467120010 service nova] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9c9917ca-819d-42a3-af8f-a015df78e957 req-f17d3f19-2d30-450c-a308-b89467120010 service nova] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG nova.compute.manager [req-9c9917ca-819d-42a3-af8f-a015df78e957 req-f17d3f19-2d30-450c-a308-b89467120010 service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] No waiting events found dispatching network-vif-plugged-f2f08b69-eb49-4a38-9357-36420ee797d6 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:13:43 user nova-compute[72766]: WARNING nova.compute.manager [req-9c9917ca-819d-42a3-af8f-a015df78e957 req-f17d3f19-2d30-450c-a308-b89467120010 service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Received unexpected event network-vif-plugged-f2f08b69-eb49-4a38-9357-36420ee797d6 for instance with vm_state active and task_state rescuing.
Aug 14 23:13:43 user nova-compute[72766]: DEBUG nova.compute.manager [req-9c9917ca-819d-42a3-af8f-a015df78e957 req-f17d3f19-2d30-450c-a308-b89467120010 service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Received event network-vif-plugged-f2f08b69-eb49-4a38-9357-36420ee797d6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9c9917ca-819d-42a3-af8f-a015df78e957 req-f17d3f19-2d30-450c-a308-b89467120010 service nova] Acquiring lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9c9917ca-819d-42a3-af8f-a015df78e957 req-f17d3f19-2d30-450c-a308-b89467120010 service nova] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9c9917ca-819d-42a3-af8f-a015df78e957 req-f17d3f19-2d30-450c-a308-b89467120010 service nova] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG nova.compute.manager [req-9c9917ca-819d-42a3-af8f-a015df78e957 req-f17d3f19-2d30-450c-a308-b89467120010 service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] No waiting events found dispatching network-vif-plugged-f2f08b69-eb49-4a38-9357-36420ee797d6 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:13:43 user nova-compute[72766]: WARNING nova.compute.manager [req-9c9917ca-819d-42a3-af8f-a015df78e957 req-f17d3f19-2d30-450c-a308-b89467120010 service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Received unexpected event network-vif-plugged-f2f08b69-eb49-4a38-9357-36420ee797d6 for instance with vm_state active and task_state rescuing.
Aug 14 23:13:43 user nova-compute[72766]: DEBUG nova.compute.manager [req-9c9917ca-819d-42a3-af8f-a015df78e957 req-f17d3f19-2d30-450c-a308-b89467120010 service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Received event network-vif-plugged-f2f08b69-eb49-4a38-9357-36420ee797d6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9c9917ca-819d-42a3-af8f-a015df78e957 req-f17d3f19-2d30-450c-a308-b89467120010 service nova] Acquiring lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9c9917ca-819d-42a3-af8f-a015df78e957 req-f17d3f19-2d30-450c-a308-b89467120010 service nova] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9c9917ca-819d-42a3-af8f-a015df78e957 req-f17d3f19-2d30-450c-a308-b89467120010 service nova] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG nova.compute.manager [req-9c9917ca-819d-42a3-af8f-a015df78e957 req-f17d3f19-2d30-450c-a308-b89467120010 service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] No waiting events found dispatching network-vif-plugged-f2f08b69-eb49-4a38-9357-36420ee797d6 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:13:43 user nova-compute[72766]: WARNING nova.compute.manager [req-9c9917ca-819d-42a3-af8f-a015df78e957 req-f17d3f19-2d30-450c-a308-b89467120010 service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Received unexpected event network-vif-plugged-f2f08b69-eb49-4a38-9357-36420ee797d6 for instance with vm_state active and task_state rescuing.
Aug 14 23:13:43 user nova-compute[72766]: DEBUG nova.compute.manager [req-9c9917ca-819d-42a3-af8f-a015df78e957 req-f17d3f19-2d30-450c-a308-b89467120010 service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Received event network-vif-unplugged-f2f08b69-eb49-4a38-9357-36420ee797d6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9c9917ca-819d-42a3-af8f-a015df78e957 req-f17d3f19-2d30-450c-a308-b89467120010 service nova] Acquiring lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9c9917ca-819d-42a3-af8f-a015df78e957 req-f17d3f19-2d30-450c-a308-b89467120010 service nova] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9c9917ca-819d-42a3-af8f-a015df78e957 req-f17d3f19-2d30-450c-a308-b89467120010 service nova] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG nova.compute.manager [req-9c9917ca-819d-42a3-af8f-a015df78e957 req-f17d3f19-2d30-450c-a308-b89467120010 service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] No waiting events found dispatching network-vif-unplugged-f2f08b69-eb49-4a38-9357-36420ee797d6 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:13:43 user nova-compute[72766]: WARNING nova.compute.manager [req-9c9917ca-819d-42a3-af8f-a015df78e957 req-f17d3f19-2d30-450c-a308-b89467120010 service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Received unexpected event network-vif-unplugged-f2f08b69-eb49-4a38-9357-36420ee797d6 for instance with vm_state active and task_state rescuing.
Aug 14 23:13:43 user nova-compute[72766]: DEBUG nova.compute.manager [req-9c9917ca-819d-42a3-af8f-a015df78e957 req-f17d3f19-2d30-450c-a308-b89467120010 service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Received event network-vif-plugged-f2f08b69-eb49-4a38-9357-36420ee797d6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9c9917ca-819d-42a3-af8f-a015df78e957 req-f17d3f19-2d30-450c-a308-b89467120010 service nova] Acquiring lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9c9917ca-819d-42a3-af8f-a015df78e957 req-f17d3f19-2d30-450c-a308-b89467120010 service nova] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9c9917ca-819d-42a3-af8f-a015df78e957 req-f17d3f19-2d30-450c-a308-b89467120010 service nova] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG nova.compute.manager [req-9c9917ca-819d-42a3-af8f-a015df78e957 req-f17d3f19-2d30-450c-a308-b89467120010 service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] No waiting events found dispatching network-vif-plugged-f2f08b69-eb49-4a38-9357-36420ee797d6 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:13:43 user nova-compute[72766]: WARNING nova.compute.manager [req-9c9917ca-819d-42a3-af8f-a015df78e957 req-f17d3f19-2d30-450c-a308-b89467120010 service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Received unexpected event network-vif-plugged-f2f08b69-eb49-4a38-9357-36420ee797d6 for instance with vm_state active and task_state rescuing.
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a1b02c698f0ea3c3e662cb1c8d8fabe602c64a7.converted --force-share --output=json" returned: 0 in 0.191s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "7a1b02c698f0ea3c3e662cb1c8d8fabe602c64a7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.482s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "7a1b02c698f0ea3c3e662cb1c8d8fabe602c64a7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "7a1b02c698f0ea3c3e662cb1c8d8fabe602c64a7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a1b02c698f0ea3c3e662cb1c8d8fabe602c64a7 --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.570s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG nova.compute.manager [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a1b02c698f0ea3c3e662cb1c8d8fabe602c64a7 --force-share --output=json" returned: 0 in 0.231s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7a1b02c698f0ea3c3e662cb1c8d8fabe602c64a7,backing_fmt=raw /opt/stack/data/nova/instances/901fe741-3b2f-472e-b91c-a90c9d4a9c39/disk.rescue {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG nova.compute.manager [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG nova.network.neutron [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7a1b02c698f0ea3c3e662cb1c8d8fabe602c64a7,backing_fmt=raw /opt/stack/data/nova/instances/901fe741-3b2f-472e-b91c-a90c9d4a9c39/disk.rescue" returned: 0 in 0.062s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "7a1b02c698f0ea3c3e662cb1c8d8fabe602c64a7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.298s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG nova.objects.instance [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lazy-loading 'migration_context' on Instance uuid 901fe741-3b2f-472e-b91c-a90c9d4a9c39 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:13:43 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 23:13:43 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Start _get_guest_xml network_info=[{"id": "f2f08b69-eb49-4a38-9357-36420ee797d6", "address": "fa:16:3e:44:c6:dd", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "vif_mac": "fa:16:3e:44:c6:dd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f08b69-eb", "ovs_interfaceid": "f2f08b69-eb49-4a38-9357-36420ee797d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '68115d6f-2d48-4dc1-9ced-c499459c5fc0', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '610aa83b-f013-4048-8aad-8aae0235a4ad', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fNiWyvpJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '901fe741-3b2f-472e-b91c-a90c9d4a9c39', 'attached_at': '', 'detached_at': '', 'volume_id': '9c962ff1-98b5-48ca-bbce-dd40c372a3c4', 'serial': '9c962ff1-98b5-48ca-bbce-dd40c372a3c4'}, 'volume_type': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG nova.objects.instance [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lazy-loading 'resources' on Instance uuid 901fe741-3b2f-472e-b91c-a90c9d4a9c39 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG nova.compute.manager [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG nova.objects.instance [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lazy-loading 'numa_topology' on Instance uuid 901fe741-3b2f-472e-b91c-a90c9d4a9c39 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:13:43 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:13:43 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:13:43 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG nova.objects.instance [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lazy-loading 'vcpu_model' on Instance uuid 901fe741-3b2f-472e-b91c-a90c9d4a9c39 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fNiWyvpJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:13:43 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:13:43 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:13:43 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:13:43 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:13:43 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 23:13:43 user nova-compute[72766]: DEBUG nova.policy [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fff2f6e64733493f905c23b2e15d4161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2329e260514d818d5af10aeeda498d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be31923-88f5-435c-b987-4db37a747413]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = fNiWyvpJ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 14 23:13:43 user nova-compute[72766]: node.name = iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4
Aug 14 23:13:43 user nova-compute[72766]: node.tpgt = -1
Aug 14 23:13:43 user nova-compute[72766]: node.startup = automatic
Aug 14 23:13:43 user nova-compute[72766]: node.leading_login = No
Aug 14 23:13:43 user nova-compute[72766]: iface.iscsi_ifacename = default
Aug 14 23:13:43 user nova-compute[72766]: iface.net_ifacename = <empty>
Aug 14 23:13:43 user nova-compute[72766]: iface.ipaddress = <empty>
Aug 14 23:13:43 user nova-compute[72766]: iface.prefix_len = 0
Aug 14 23:13:43 user nova-compute[72766]: iface.hwaddress = <empty>
Aug 14 23:13:43 user nova-compute[72766]: iface.transport_name = tcp
Aug 14 23:13:43 user nova-compute[72766]: iface.initiatorname = <empty>
Aug 14 23:13:43 user nova-compute[72766]: iface.state = <empty>
Aug 14 23:13:43 user nova-compute[72766]: iface.vlan_id = 0
Aug 14 23:13:43 user nova-compute[72766]: iface.vlan_priority = 0
Aug 14 23:13:43 user nova-compute[72766]: iface.vlan_state = <empty>
Aug 14 23:13:43 user nova-compute[72766]: iface.iface_num = 0
Aug 14 23:13:43 user nova-compute[72766]: iface.mtu = 0
Aug 14 23:13:43 user nova-compute[72766]: iface.port = 0
Aug 14 23:13:43 user nova-compute[72766]: iface.bootproto = <empty>
Aug 14 23:13:43 user nova-compute[72766]: iface.subnet_mask = <empty>
Aug 14 23:13:43 user nova-compute[72766]: iface.gateway = <empty>
Aug 14 23:13:43 user nova-compute[72766]: iface.dhcp_alt_client_id_state = <empty>
Aug 14 23:13:43 user nova-compute[72766]: iface.dhcp_alt_client_id = <empty>
Aug 14 23:13:43 user nova-compute[72766]: iface.dhcp_dns = <empty>
Aug 14 23:13:43 user nova-compute[72766]: iface.dhcp_learn_iqn = <empty>
Aug 14 23:13:43 user nova-compute[72766]: iface.dhcp_req_vendor_id_state = <empty>
Aug 14 23:13:43 user nova-compute[72766]: iface.dhcp_vendor_id_state = <empty>
Aug 14 23:13:43 user nova-compute[72766]: iface.dhcp_vendor_id = <empty>
Aug 14 23:13:43 user nova-compute[72766]: iface.dhcp_slp_da = <empty>
Aug 14 23:13:43 user nova-compute[72766]: iface.fragmentation = <empty>
Aug 14 23:13:43 user nova-compute[72766]: iface.gratuitous_arp = <empty>
Aug 14 23:13:43 user nova-compute[72766]: iface.incoming_forwarding = <empty>
Aug 14 23:13:43 user nova-compute[72766]: iface.tos_state = <empty>
Aug 14 23:13:43 user nova-compute[72766]: iface.tos = 0
Aug 14 23:13:43 user nova-compute[72766]: iface.ttl = 0
Aug 14 23:13:43 user nova-compute[72766]: iface.delayed_ack = <empty>
Aug 14 23:13:43 user nova-compute[72766]: iface.tcp_nagle = <empty>
Aug 14 23:13:43 user nova-compute[72766]: iface.tcp_wsf_state = <empty>
Aug 14 23:13:43 user nova-compute[72766]: iface.tcp_wsf = 0
Aug 14 23:13:43 user nova-compute[72766]: iface.tcp_timer_scale = 0
Aug 14 23:13:43 user nova-compute[72766]: iface.tcp_timestamp = <empty>
Aug 14 23:13:43 user nova-compute[72766]: iface.redirect = <empty>
Aug 14 23:13:43 user nova-compute[72766]: iface.def_task_mgmt_timeout = 0
Aug 14 23:13:43 user nova-compute[72766]: iface.header_digest = <empty>
Aug 14 23:13:43 user nova-compute[72766]: iface.data_digest = <empty>
Aug 14 23:13:43 user nova-compute[72766]: iface.immediate_data = <empty>
Aug 14 23:13:43 user nova-compute[72766]: iface.initial_r2t = <empty>
Aug 14 23:13:43 user nova-compute[72766]: iface.data_seq_inorder = <empty>
Aug 14 23:13:43 user nova-compute[72766]: iface.data_pdu_inorder = <empty>
Aug 14 23:13:43 user nova-compute[72766]: iface.erl = 0
Aug 14 23:13:43 user nova-compute[72766]: iface.max_receive_data_len = 0
Aug 14 23:13:43 user nova-compute[72766]: iface.first_burst_len = 0
Aug 14 23:13:43 user nova-compute[72766]: iface.max_outstanding_r2t = 0
Aug 14 23:13:43 user nova-compute[72766]: iface.max_burst_len = 0
Aug 14 23:13:43 user nova-compute[72766]: iface.chap_auth = <empty>
Aug 14 23:13:43 user nova-compute[72766]: iface.bidi_chap = <empty>
Aug 14 23:13:43 user nova-compute[72766]: iface.strict_login_compliance = <empty>
Aug 14 23:13:43 user nova-compute[72766]: iface.discovery_auth = <empty>
Aug 14 23:13:43 user nova-compute[72766]: iface.discovery_logout = <empty>
Aug 14 23:13:43 user nova-compute[72766]: node.discovery_address = <empty>
Aug 14 23:13:43 user nova-compute[72766]: node.discovery_port = 0
Aug 14 23:13:43 user nova-compute[72766]: node.discovery_type = static
Aug 14 23:13:43 user nova-compute[72766]: node.session.initial_cmdsn = 0
Aug 14 23:13:43 user nova-compute[72766]: node.session.initial_login_retry_max = 8
Aug 14 23:13:43 user nova-compute[72766]: node.session.xmit_thread_priority = -20
Aug 14 23:13:43 user nova-compute[72766]: node.session.cmds_max = 128
Aug 14 23:13:43 user nova-compute[72766]: node.session.queue_depth = 32
Aug 14 23:13:43 user nova-compute[72766]: node.session.nr_sessions = 1
Aug 14 23:13:43 user nova-compute[72766]: node.session.auth.authmethod = CHAP
Aug 14 23:13:43 user nova-compute[72766]: node.session.auth.username = fNiWyvpJ
Aug 14 23:13:43 user nova-compute[72766]: node.session.auth.password = ***
Aug 14 23:13:43 user nova-compute[72766]: node.session.auth.username_in = <empty>
Aug 14 23:13:43 user nova-compute[72766]: node.session.auth.password_in = <empty>
Aug 14 23:13:43 user nova-compute[72766]: node.session.auth.chap_algs = MD5
Aug 14 23:13:43 user nova-compute[72766]: node.session.timeo.replacement_timeout = 120
Aug 14 23:13:43 user nova-compute[72766]: node.session.err_timeo.abort_timeout = 15
Aug 14 23:13:43 user nova-compute[72766]: node.session.err_timeo.lu_reset_timeout = 30
Aug 14 23:13:43 user nova-compute[72766]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 14 23:13:43 user nova-compute[72766]: node.session.err_timeo.host_reset_timeout = 60
Aug 14 23:13:43 user nova-compute[72766]: node.session.iscsi.FastAbort = Yes
Aug 14 23:13:43 user nova-compute[72766]: node.session.iscsi.InitialR2T = No
Aug 14 23:13:43 user nova-compute[72766]: node.session.iscsi.ImmediateData = Yes
Aug 14 23:13:43 user nova-compute[72766]: node.session.iscsi.FirstBurstLength = 262144
Aug 14 23:13:43 user nova-compute[72766]: node.session.iscsi.MaxBurstLength = 16776192
Aug 14 23:13:43 user nova-compute[72766]: node.session.iscsi.DefaultTime2Retain = 0
Aug 14 23:13:43 user nova-compute[72766]: node.session.iscsi.DefaultTime2Wait = 2
Aug 14 23:13:43 user nova-compute[72766]: node.session.iscsi.MaxConnections = 1
Aug 14 23:13:43 user nova-compute[72766]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 14 23:13:43 user nova-compute[72766]: node.session.iscsi.ERL = 0
Aug 14 23:13:43 user nova-compute[72766]: node.session.scan = manual
Aug 14 23:13:43 user nova-compute[72766]: node.session.reopen_max = 0
Aug 14 23:13:43 user nova-compute[72766]: node.conn[0].address = 172.16.0.220
Aug 14 23:13:43 user nova-compute[72766]: node.conn[0].port = 3260
Aug 14 23:13:43 user nova-compute[72766]: node.conn[0].startup = manual
Aug 14 23:13:43 user nova-compute[72766]: node.conn[0].tcp.window_size = 524288
Aug 14 23:13:43 user nova-compute[72766]: node.conn[0].tcp.type_of_service = 0
Aug 14 23:13:43 user nova-compute[72766]: node.conn[0].timeo.logout_timeout = 15
Aug 14 23:13:43 user nova-compute[72766]: node.conn[0].timeo.login_timeout = 15
Aug 14 23:13:43 user nova-compute[72766]: node.conn[0].timeo.auth_timeout = 45
Aug 14 23:13:43 user nova-compute[72766]: node.conn[0].timeo.noop_out_interval = 5
Aug 14 23:13:43 user nova-compute[72766]: node.conn[0].timeo.noop_out_timeout = 5
Aug 14 23:13:43 user nova-compute[72766]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 14 23:13:43 user nova-compute[72766]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 14 23:13:43 user nova-compute[72766]: node.conn[0].iscsi.HeaderDigest = None
Aug 14 23:13:43 user nova-compute[72766]: node.conn[0].iscsi.DataDigest = None
Aug 14 23:13:43 user nova-compute[72766]: node.conn[0].iscsi.IFMarker = No
Aug 14 23:13:43 user nova-compute[72766]: node.conn[0].iscsi.OFMarker = No
Aug 14 23:13:43 user nova-compute[72766]: # END RECORD
Aug 14 23:13:43 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01a7cf2-655b-4238-bd46-cc982201e132]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3b452a-a74d-41e3-8796-b180808727f5]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fNiWyvpJ {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG nova.compute.manager [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 23:13:43 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Creating image(s)
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Acquiring lock "/opt/stack/data/nova/instances/c45186c1-193e-4d52-a09b-aa8d18195c8e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "/opt/stack/data/nova/instances/c45186c1-193e-4d52-a09b-aa8d18195c8e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "/opt/stack/data/nova/instances/c45186c1-193e-4d52-a09b-aa8d18195c8e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Acquiring lock "347b00b853126ef1357b8f02601e6ca6a1afc796" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "347b00b853126ef1357b8f02601e6ca6a1afc796" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fNiWyvpJ" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2034e015-574b-4406-9b59-9eee1d3e0de8]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fNiWyvpJ'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a2da9c-9f40-456c-bda9-bbbc86240fd7]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d5971a-d033-49de-bf27-0b8b36827681]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:13:43 user nova-compute[72766]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)
Aug 14 23:13:43 user nova-compute[72766]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8 (non-flash)
Aug 14 23:13:43 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:13:43 user nova-compute[72766]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)
Aug 14 23:13:43 user nova-compute[72766]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8 (non-flash)
Aug 14 23:13:43 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.179s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] HCTL ('33', '0', '0', 0) found on session 37 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 23:13:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:44 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/347b00b853126ef1357b8f02601e6ca6a1afc796.part --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:44 user nova-compute[72766]: DEBUG nova.network.neutron [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Successfully created port: 32417a5a-a445-4b76-b308-0d3b5180ac94 {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 23:13:44 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:44 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6eb5a84-fc51-4b6c-b3f5-b8e19e40b0e9]: (4, ('0 0 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:13:44 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Searching for a device in session 37 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:13:44 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fNiWyvpJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 23:13:44 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.941s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:13:44 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] <== connect_volume: return (943ms) {'type': 'block', 'scsi_wwn': '26664646432366231', 'path': '/dev/sdb'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:13:44 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664646432366231', 'path': '/dev/sdb'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 23:13:44 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/347b00b853126ef1357b8f02601e6ca6a1afc796.part --force-share --output=json" returned: 0 in 0.195s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:44 user nova-compute[72766]: DEBUG nova.virt.images [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] 5e8f2884-6cbc-494e-9311-8ce44f1ffd4b was qcow2, converting to raw {{(pid=72766) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 23:13:44 user nova-compute[72766]: DEBUG nova.privsep.utils [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72766) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 23:13:44 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/347b00b853126ef1357b8f02601e6ca6a1afc796.part /opt/stack/data/nova/instances/_base/347b00b853126ef1357b8f02601e6ca6a1afc796.converted {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:44 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:11:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-952087033',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-952087033',id=31,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:12:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3725c4b1cd78403f9628c8af9f8e5cc5',ramdisk_id='',reservation_id='r-4s8wi2wt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-86235447',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:12:15Z,user_data=None,user_id='32e61321c50d4af28adeab72811a3f86',uuid=901fe741-3b2f-472e-b91c-a90c9d4a9c39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2f08b69-eb49-4a38-9357-36420ee797d6", "address": "fa:16:3e:44:c6:dd", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "vif_mac": "fa:16:3e:44:c6:dd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f08b69-eb", "ovs_interfaceid": "f2f08b69-eb49-4a38-9357-36420ee797d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:13:44 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Converting VIF {"id": "f2f08b69-eb49-4a38-9357-36420ee797d6", "address": "fa:16:3e:44:c6:dd", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "vif_mac": "fa:16:3e:44:c6:dd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f08b69-eb", "ovs_interfaceid": "f2f08b69-eb49-4a38-9357-36420ee797d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:13:44 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:c6:dd,bridge_name='br-int',has_traffic_filtering=True,id=f2f08b69-eb49-4a38-9357-36420ee797d6,network=Network(f4efdeee-d89b-45e5-b0d9-b45573564e9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2f08b69-eb') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:13:44 user nova-compute[72766]: DEBUG nova.objects.instance [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lazy-loading 'pci_devices' on Instance uuid 901fe741-3b2f-472e-b91c-a90c9d4a9c39 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:13:44 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:13:44 user nova-compute[72766]:   <uuid>901fe741-3b2f-472e-b91c-a90c9d4a9c39</uuid>
Aug 14 23:13:44 user nova-compute[72766]:   <name>instance-0000001f</name>
Aug 14 23:13:44 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:13:44 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:13:44 user nova-compute[72766]:   <metadata>
Aug 14 23:13:44 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:13:44 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:13:44 user nova-compute[72766]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-952087033</nova:name>
Aug 14 23:13:44 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:13:43</nova:creationTime>
Aug 14 23:13:44 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:13:44 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:13:44 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:13:44 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:13:44 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:13:44 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:13:44 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:13:44 user nova-compute[72766]:       <nova:owner>
Aug 14 23:13:44 user nova-compute[72766]:         <nova:user uuid="32e61321c50d4af28adeab72811a3f86">tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member</nova:user>
Aug 14 23:13:44 user nova-compute[72766]:         <nova:project uuid="3725c4b1cd78403f9628c8af9f8e5cc5">tempest-ServerBootFromVolumeStableRescueTest-86235447</nova:project>
Aug 14 23:13:44 user nova-compute[72766]:       </nova:owner>
Aug 14 23:13:44 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 23:13:44 user nova-compute[72766]:       <nova:ports>
Aug 14 23:13:44 user nova-compute[72766]:         <nova:port uuid="f2f08b69-eb49-4a38-9357-36420ee797d6">
Aug 14 23:13:44 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 23:13:44 user nova-compute[72766]:         </nova:port>
Aug 14 23:13:44 user nova-compute[72766]:       </nova:ports>
Aug 14 23:13:44 user nova-compute[72766]:     </nova:instance>
Aug 14 23:13:44 user nova-compute[72766]:   </metadata>
Aug 14 23:13:44 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:13:44 user nova-compute[72766]:     <system>
Aug 14 23:13:44 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:13:44 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:13:44 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:13:44 user nova-compute[72766]:       <entry name="serial">901fe741-3b2f-472e-b91c-a90c9d4a9c39</entry>
Aug 14 23:13:44 user nova-compute[72766]:       <entry name="uuid">901fe741-3b2f-472e-b91c-a90c9d4a9c39</entry>
Aug 14 23:13:44 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:13:44 user nova-compute[72766]:     </system>
Aug 14 23:13:44 user nova-compute[72766]:   </sysinfo>
Aug 14 23:13:44 user nova-compute[72766]:   <os>
Aug 14 23:13:44 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:13:44 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:13:44 user nova-compute[72766]:   </os>
Aug 14 23:13:44 user nova-compute[72766]:   <features>
Aug 14 23:13:44 user nova-compute[72766]:     <acpi/>
Aug 14 23:13:44 user nova-compute[72766]:     <apic/>
Aug 14 23:13:44 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:13:44 user nova-compute[72766]:   </features>
Aug 14 23:13:44 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:13:44 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:13:44 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:13:44 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:13:44 user nova-compute[72766]:   </clock>
Aug 14 23:13:44 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:13:44 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:13:44 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:13:44 user nova-compute[72766]:   </cpu>
Aug 14 23:13:44 user nova-compute[72766]:   <devices>
Aug 14 23:13:44 user nova-compute[72766]:     <disk type="block" device="disk">
Aug 14 23:13:44 user nova-compute[72766]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:13:44 user nova-compute[72766]:       <source dev="/dev/sdb"/>
Aug 14 23:13:44 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:13:44 user nova-compute[72766]:       <serial>9c962ff1-98b5-48ca-bbce-dd40c372a3c4</serial>
Aug 14 23:13:44 user nova-compute[72766]:     </disk>
Aug 14 23:13:44 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 23:13:44 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 23:13:44 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/901fe741-3b2f-472e-b91c-a90c9d4a9c39/disk.rescue"/>
Aug 14 23:13:44 user nova-compute[72766]:       <target dev="vdb" bus="virtio"/>
Aug 14 23:13:44 user nova-compute[72766]:       <boot order="1"/>
Aug 14 23:13:44 user nova-compute[72766]:     </disk>
Aug 14 23:13:44 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:13:44 user nova-compute[72766]:       <mac address="fa:16:3e:44:c6:dd"/>
Aug 14 23:13:44 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:13:44 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:13:44 user nova-compute[72766]:       <target dev="tapf2f08b69-eb"/>
Aug 14 23:13:44 user nova-compute[72766]:     </interface>
Aug 14 23:13:44 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:13:44 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/901fe741-3b2f-472e-b91c-a90c9d4a9c39/console.log" append="off"/>
Aug 14 23:13:44 user nova-compute[72766]:     </serial>
Aug 14 23:13:44 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:13:44 user nova-compute[72766]:     <video>
Aug 14 23:13:44 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:13:44 user nova-compute[72766]:     </video>
Aug 14 23:13:44 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:13:44 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:13:44 user nova-compute[72766]:     </rng>
Aug 14 23:13:44 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:13:44 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:13:44 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:13:44 user nova-compute[72766]:     </memballoon>
Aug 14 23:13:44 user nova-compute[72766]:   </devices>
Aug 14 23:13:44 user nova-compute[72766]: </domain>
Aug 14 23:13:44 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:13:44 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Instance destroyed successfully.
Aug 14 23:13:45 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:13:45 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:13:45 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] No VIF found with MAC fa:16:3e:44:c6:dd, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:13:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/347b00b853126ef1357b8f02601e6ca6a1afc796.part /opt/stack/data/nova/instances/_base/347b00b853126ef1357b8f02601e6ca6a1afc796.converted" returned: 0 in 0.995s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/347b00b853126ef1357b8f02601e6ca6a1afc796.converted --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/347b00b853126ef1357b8f02601e6ca6a1afc796.converted --force-share --output=json" returned: 0 in 0.204s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "347b00b853126ef1357b8f02601e6ca6a1afc796" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.251s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:13:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/347b00b853126ef1357b8f02601e6ca6a1afc796 --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:45 user nova-compute[72766]: DEBUG nova.network.neutron [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Successfully updated port: 32417a5a-a445-4b76-b308-0d3b5180ac94 {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 23:13:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Acquiring lock "refresh_cache-c45186c1-193e-4d52-a09b-aa8d18195c8e" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:13:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Acquired lock "refresh_cache-c45186c1-193e-4d52-a09b-aa8d18195c8e" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:13:45 user nova-compute[72766]: DEBUG nova.network.neutron [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:13:45 user nova-compute[72766]: DEBUG nova.compute.manager [req-50f3d4e1-109e-48f8-9710-3c370968f34c req-5ba50770-8261-425c-be1d-430ac1566bb7 service nova] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Received event network-changed-32417a5a-a445-4b76-b308-0d3b5180ac94 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:13:45 user nova-compute[72766]: DEBUG nova.compute.manager [req-50f3d4e1-109e-48f8-9710-3c370968f34c req-5ba50770-8261-425c-be1d-430ac1566bb7 service nova] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Refreshing instance network info cache due to event network-changed-32417a5a-a445-4b76-b308-0d3b5180ac94. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:13:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-50f3d4e1-109e-48f8-9710-3c370968f34c req-5ba50770-8261-425c-be1d-430ac1566bb7 service nova] Acquiring lock "refresh_cache-c45186c1-193e-4d52-a09b-aa8d18195c8e" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:13:45 user nova-compute[72766]: DEBUG nova.network.neutron [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquiring lock "31504941-0f9e-4ebd-b992-3b08a4aef25a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "31504941-0f9e-4ebd-b992-3b08a4aef25a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/347b00b853126ef1357b8f02601e6ca6a1afc796 --force-share --output=json" returned: 0 in 0.209s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Acquiring lock "347b00b853126ef1357b8f02601e6ca6a1afc796" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "347b00b853126ef1357b8f02601e6ca6a1afc796" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/347b00b853126ef1357b8f02601e6ca6a1afc796 --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG nova.compute.manager [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 23:13:46 user nova-compute[72766]: INFO nova.compute.claims [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Claim successful on node user
Aug 14 23:13:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/347b00b853126ef1357b8f02601e6ca6a1afc796 --force-share --output=json" returned: 0 in 0.195s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/347b00b853126ef1357b8f02601e6ca6a1afc796,backing_fmt=raw /opt/stack/data/nova/instances/c45186c1-193e-4d52-a09b-aa8d18195c8e/disk 1073741824 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/347b00b853126ef1357b8f02601e6ca6a1afc796,backing_fmt=raw /opt/stack/data/nova/instances/c45186c1-193e-4d52-a09b-aa8d18195c8e/disk 1073741824" returned: 0 in 0.051s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "347b00b853126ef1357b8f02601e6ca6a1afc796" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/347b00b853126ef1357b8f02601e6ca6a1afc796 --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG nova.network.neutron [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Updating instance_info_cache with network_info: [{"id": "32417a5a-a445-4b76-b308-0d3b5180ac94", "address": "fa:16:3e:ee:f9:d5", "network": {"id": "52ed808b-c840-47a7-aa8f-8055fd7bd1ef", "bridge": "br-int", "label": "tempest-TestStampPattern-1964150399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2329e260514d818d5af10aeeda498d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32417a5a-a4", "ovs_interfaceid": "32417a5a-a445-4b76-b308-0d3b5180ac94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Releasing lock "refresh_cache-c45186c1-193e-4d52-a09b-aa8d18195c8e" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG nova.compute.manager [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Instance network_info: |[{"id": "32417a5a-a445-4b76-b308-0d3b5180ac94", "address": "fa:16:3e:ee:f9:d5", "network": {"id": "52ed808b-c840-47a7-aa8f-8055fd7bd1ef", "bridge": "br-int", "label": "tempest-TestStampPattern-1964150399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2329e260514d818d5af10aeeda498d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32417a5a-a4", "ovs_interfaceid": "32417a5a-a445-4b76-b308-0d3b5180ac94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-50f3d4e1-109e-48f8-9710-3c370968f34c req-5ba50770-8261-425c-be1d-430ac1566bb7 service nova] Acquired lock "refresh_cache-c45186c1-193e-4d52-a09b-aa8d18195c8e" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG nova.network.neutron [req-50f3d4e1-109e-48f8-9710-3c370968f34c req-5ba50770-8261-425c-be1d-430ac1566bb7 service nova] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Refreshing network info cache for port 32417a5a-a445-4b76-b308-0d3b5180ac94 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/347b00b853126ef1357b8f02601e6ca6a1afc796 --force-share --output=json" returned: 0 in 0.183s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG nova.objects.instance [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lazy-loading 'migration_context' on Instance uuid c45186c1-193e-4d52-a09b-aa8d18195c8e {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Ensure instance console log exists: /opt/stack/data/nova/instances/c45186c1-193e-4d52-a09b-aa8d18195c8e/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Start _get_guest_xml network_info=[{"id": "32417a5a-a445-4b76-b308-0d3b5180ac94", "address": "fa:16:3e:ee:f9:d5", "network": {"id": "52ed808b-c840-47a7-aa8f-8055fd7bd1ef", "bridge": "br-int", "label": "tempest-TestStampPattern-1964150399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2329e260514d818d5af10aeeda498d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32417a5a-a4", "ovs_interfaceid": "32417a5a-a445-4b76-b308-0d3b5180ac94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='5519f11cc370ae31efa51431e4c7e3c5',container_format='bare',created_at=2023-08-14T23:13:35Z,direct_url=<?>,disk_format='qcow2',id=5e8f2884-6cbc-494e-9311-8ce44f1ffd4b,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-374117881',owner='bc2329e260514d818d5af10aeeda498d',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-14T23:13:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5e8f2884-6cbc-494e-9311-8ce44f1ffd4b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:13:46 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:13:46 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:13:46 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='5519f11cc370ae31efa51431e4c7e3c5',container_format='bare',created_at=2023-08-14T23:13:35Z,direct_url=<?>,disk_format='qcow2',id=5e8f2884-6cbc-494e-9311-8ce44f1ffd4b,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-374117881',owner='bc2329e260514d818d5af10aeeda498d',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-14T23:13:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1611717760',display_name='tempest-TestStampPattern-server-1611717760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1611717760',id=32,image_ref='5e8f2884-6cbc-494e-9311-8ce44f1ffd4b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpGwryUjtUrIoGUKk7UpA8gUykO9BhQbyJGpTNe51F8rSj8f9y24+iZRMzUrsprfERcHUFXZuW+wemEEJyvytSmT2p4zUjOXLeubfjibHmStVi+yhSgVVjf4UvXDmxC4g==',key_name='tempest-TestStampPattern-979334588',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc2329e260514d818d5af10aeeda498d',ramdisk_id='',reservation_id='r-6ixtvj9s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='9ec72ed8-0c33-4e70-ae88-d7571c84de2a',image_min_disk='1',image_min_ram='0',image_owner_id='bc2329e260514d818d5af10aeeda498d',image_owner_project_name='tempest-TestStampPattern-1250368372',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1250368372-project-member',image_user_id='fff2f6e64733493f905c23b2e15d4161',network_allocated='True',owner_project_name='tempest-TestStampPattern-1250368372',owner_user_name='tempest-TestStampPattern-1250368372-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:13:43Z,user_data=None,user_id='fff2f6e64733493f905c23b2e15d4161',uuid=c45186c1-193e-4d52-a09b-aa8d18195c8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32417a5a-a445-4b76-b308-0d3b5180ac94", "address": "fa:16:3e:ee:f9:d5", "network": {"id": "52ed808b-c840-47a7-aa8f-8055fd7bd1ef", "bridge": "br-int", "label": "tempest-TestStampPattern-1964150399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2329e260514d818d5af10aeeda498d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32417a5a-a4", "ovs_interfaceid": "32417a5a-a445-4b76-b308-0d3b5180ac94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Converting VIF {"id": "32417a5a-a445-4b76-b308-0d3b5180ac94", "address": "fa:16:3e:ee:f9:d5", "network": {"id": "52ed808b-c840-47a7-aa8f-8055fd7bd1ef", "bridge": "br-int", "label": "tempest-TestStampPattern-1964150399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2329e260514d818d5af10aeeda498d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32417a5a-a4", "ovs_interfaceid": "32417a5a-a445-4b76-b308-0d3b5180ac94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:f9:d5,bridge_name='br-int',has_traffic_filtering=True,id=32417a5a-a445-4b76-b308-0d3b5180ac94,network=Network(52ed808b-c840-47a7-aa8f-8055fd7bd1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32417a5a-a4') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG nova.objects.instance [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lazy-loading 'pci_devices' on Instance uuid c45186c1-193e-4d52-a09b-aa8d18195c8e {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:13:46 user nova-compute[72766]:   <uuid>c45186c1-193e-4d52-a09b-aa8d18195c8e</uuid>
Aug 14 23:13:46 user nova-compute[72766]:   <name>instance-00000020</name>
Aug 14 23:13:46 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:13:46 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:13:46 user nova-compute[72766]:   <metadata>
Aug 14 23:13:46 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:13:46 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:13:46 user nova-compute[72766]:       <nova:name>tempest-TestStampPattern-server-1611717760</nova:name>
Aug 14 23:13:46 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:13:46</nova:creationTime>
Aug 14 23:13:46 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:13:46 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:13:46 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:13:46 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:13:46 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:13:46 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:13:46 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:13:46 user nova-compute[72766]:       <nova:owner>
Aug 14 23:13:46 user nova-compute[72766]:         <nova:user uuid="fff2f6e64733493f905c23b2e15d4161">tempest-TestStampPattern-1250368372-project-member</nova:user>
Aug 14 23:13:46 user nova-compute[72766]:         <nova:project uuid="bc2329e260514d818d5af10aeeda498d">tempest-TestStampPattern-1250368372</nova:project>
Aug 14 23:13:46 user nova-compute[72766]:       </nova:owner>
Aug 14 23:13:46 user nova-compute[72766]:       <nova:root type="image" uuid="5e8f2884-6cbc-494e-9311-8ce44f1ffd4b"/>
Aug 14 23:13:46 user nova-compute[72766]:       <nova:ports>
Aug 14 23:13:46 user nova-compute[72766]:         <nova:port uuid="32417a5a-a445-4b76-b308-0d3b5180ac94">
Aug 14 23:13:46 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 23:13:46 user nova-compute[72766]:         </nova:port>
Aug 14 23:13:46 user nova-compute[72766]:       </nova:ports>
Aug 14 23:13:46 user nova-compute[72766]:     </nova:instance>
Aug 14 23:13:46 user nova-compute[72766]:   </metadata>
Aug 14 23:13:46 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:13:46 user nova-compute[72766]:     <system>
Aug 14 23:13:46 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:13:46 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:13:46 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:13:46 user nova-compute[72766]:       <entry name="serial">c45186c1-193e-4d52-a09b-aa8d18195c8e</entry>
Aug 14 23:13:46 user nova-compute[72766]:       <entry name="uuid">c45186c1-193e-4d52-a09b-aa8d18195c8e</entry>
Aug 14 23:13:46 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:13:46 user nova-compute[72766]:     </system>
Aug 14 23:13:46 user nova-compute[72766]:   </sysinfo>
Aug 14 23:13:46 user nova-compute[72766]:   <os>
Aug 14 23:13:46 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:13:46 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:13:46 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:13:46 user nova-compute[72766]:   </os>
Aug 14 23:13:46 user nova-compute[72766]:   <features>
Aug 14 23:13:46 user nova-compute[72766]:     <acpi/>
Aug 14 23:13:46 user nova-compute[72766]:     <apic/>
Aug 14 23:13:46 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:13:46 user nova-compute[72766]:   </features>
Aug 14 23:13:46 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:13:46 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:13:46 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:13:46 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:13:46 user nova-compute[72766]:   </clock>
Aug 14 23:13:46 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:13:46 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:13:46 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:13:46 user nova-compute[72766]:   </cpu>
Aug 14 23:13:46 user nova-compute[72766]:   <devices>
Aug 14 23:13:46 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 23:13:46 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 23:13:46 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/c45186c1-193e-4d52-a09b-aa8d18195c8e/disk"/>
Aug 14 23:13:46 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:13:46 user nova-compute[72766]:     </disk>
Aug 14 23:13:46 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:13:46 user nova-compute[72766]:       <mac address="fa:16:3e:ee:f9:d5"/>
Aug 14 23:13:46 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:13:46 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:13:46 user nova-compute[72766]:       <target dev="tap32417a5a-a4"/>
Aug 14 23:13:46 user nova-compute[72766]:     </interface>
Aug 14 23:13:46 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:13:46 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/c45186c1-193e-4d52-a09b-aa8d18195c8e/console.log" append="off"/>
Aug 14 23:13:46 user nova-compute[72766]:     </serial>
Aug 14 23:13:46 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:13:46 user nova-compute[72766]:     <video>
Aug 14 23:13:46 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:13:46 user nova-compute[72766]:     </video>
Aug 14 23:13:46 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:13:46 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:13:46 user nova-compute[72766]:     </rng>
Aug 14 23:13:46 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:13:46 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:13:46 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:13:46 user nova-compute[72766]:     </memballoon>
Aug 14 23:13:46 user nova-compute[72766]:   </devices>
Aug 14 23:13:46 user nova-compute[72766]: </domain>
Aug 14 23:13:46 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1611717760',display_name='tempest-TestStampPattern-server-1611717760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1611717760',id=32,image_ref='5e8f2884-6cbc-494e-9311-8ce44f1ffd4b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpGwryUjtUrIoGUKk7UpA8gUykO9BhQbyJGpTNe51F8rSj8f9y24+iZRMzUrsprfERcHUFXZuW+wemEEJyvytSmT2p4zUjOXLeubfjibHmStVi+yhSgVVjf4UvXDmxC4g==',key_name='tempest-TestStampPattern-979334588',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc2329e260514d818d5af10aeeda498d',ramdisk_id='',reservation_id='r-6ixtvj9s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='9ec72ed8-0c33-4e70-ae88-d7571c84de2a',image_min_disk='1',image_min_ram='0',image_owner_id='bc2329e260514d818d5af10aeeda498d',image_owner_project_name='tempest-TestStampPattern-1250368372',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1250368372-project-member',image_user_id='fff2f6e64733493f905c23b2e15d4161',network_allocated='True',owner_project_name='tempest-TestStampPattern-1250368372',owner_user_name='tempest-TestStampPattern-1250368372-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:13:43Z,user_data=None,user_id='fff2f6e64733493f905c23b2e15d4161',uuid=c45186c1-193e-4d52-a09b-aa8d18195c8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32417a5a-a445-4b76-b308-0d3b5180ac94", "address": "fa:16:3e:ee:f9:d5", "network": {"id": "52ed808b-c840-47a7-aa8f-8055fd7bd1ef", "bridge": "br-int", "label": "tempest-TestStampPattern-1964150399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2329e260514d818d5af10aeeda498d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32417a5a-a4", "ovs_interfaceid": "32417a5a-a445-4b76-b308-0d3b5180ac94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Converting VIF {"id": "32417a5a-a445-4b76-b308-0d3b5180ac94", "address": "fa:16:3e:ee:f9:d5", "network": {"id": "52ed808b-c840-47a7-aa8f-8055fd7bd1ef", "bridge": "br-int", "label": "tempest-TestStampPattern-1964150399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2329e260514d818d5af10aeeda498d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32417a5a-a4", "ovs_interfaceid": "32417a5a-a445-4b76-b308-0d3b5180ac94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:f9:d5,bridge_name='br-int',has_traffic_filtering=True,id=32417a5a-a445-4b76-b308-0d3b5180ac94,network=Network(52ed808b-c840-47a7-aa8f-8055fd7bd1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32417a5a-a4') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG os_vif [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:f9:d5,bridge_name='br-int',has_traffic_filtering=True,id=32417a5a-a445-4b76-b308-0d3b5180ac94,network=Network(52ed808b-c840-47a7-aa8f-8055fd7bd1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32417a5a-a4') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32417a5a-a4, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap32417a5a-a4, col_values=(('external_ids', {'iface-id': '32417a5a-a445-4b76-b308-0d3b5180ac94', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:f9:d5', 'vm-uuid': 'c45186c1-193e-4d52-a09b-aa8d18195c8e'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:46 user nova-compute[72766]: INFO os_vif [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:f9:d5,bridge_name='br-int',has_traffic_filtering=True,id=32417a5a-a445-4b76-b308-0d3b5180ac94,network=Network(52ed808b-c840-47a7-aa8f-8055fd7bd1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32417a5a-a4')
Aug 14 23:13:46 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] No VIF found with MAC fa:16:3e:ee:f9:d5, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.568s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG nova.compute.manager [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG nova.compute.manager [req-d1cab82b-eb47-4373-9158-26fb4b87a445 req-7fc87157-0c15-4e53-9231-0136a97a4b39 service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Received event network-vif-plugged-f2f08b69-eb49-4a38-9357-36420ee797d6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d1cab82b-eb47-4373-9158-26fb4b87a445 req-7fc87157-0c15-4e53-9231-0136a97a4b39 service nova] Acquiring lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d1cab82b-eb47-4373-9158-26fb4b87a445 req-7fc87157-0c15-4e53-9231-0136a97a4b39 service nova] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d1cab82b-eb47-4373-9158-26fb4b87a445 req-7fc87157-0c15-4e53-9231-0136a97a4b39 service nova] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG nova.compute.manager [req-d1cab82b-eb47-4373-9158-26fb4b87a445 req-7fc87157-0c15-4e53-9231-0136a97a4b39 service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] No waiting events found dispatching network-vif-plugged-f2f08b69-eb49-4a38-9357-36420ee797d6 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:13:46 user nova-compute[72766]: WARNING nova.compute.manager [req-d1cab82b-eb47-4373-9158-26fb4b87a445 req-7fc87157-0c15-4e53-9231-0136a97a4b39 service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Received unexpected event network-vif-plugged-f2f08b69-eb49-4a38-9357-36420ee797d6 for instance with vm_state active and task_state rescuing.
Aug 14 23:13:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG nova.compute.manager [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 23:13:46 user nova-compute[72766]: DEBUG nova.network.neutron [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 23:13:46 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 23:13:46 user nova-compute[72766]: DEBUG nova.compute.manager [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 23:13:47 user nova-compute[72766]: DEBUG nova.policy [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7a41813929144571a3306300dbf6f485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b1dd09415664f1aa0b0dbdeeb4b8d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 23:13:47 user nova-compute[72766]: DEBUG nova.compute.manager [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 23:13:47 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 23:13:47 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Creating image(s)
Aug 14 23:13:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquiring lock "/opt/stack/data/nova/instances/31504941-0f9e-4ebd-b992-3b08a4aef25a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:13:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "/opt/stack/data/nova/instances/31504941-0f9e-4ebd-b992-3b08a4aef25a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:13:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "/opt/stack/data/nova/instances/31504941-0f9e-4ebd-b992-3b08a4aef25a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:13:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.194s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquiring lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:13:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:13:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:47 user nova-compute[72766]: DEBUG nova.network.neutron [req-50f3d4e1-109e-48f8-9710-3c370968f34c req-5ba50770-8261-425c-be1d-430ac1566bb7 service nova] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Updated VIF entry in instance network info cache for port 32417a5a-a445-4b76-b308-0d3b5180ac94. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:13:47 user nova-compute[72766]: DEBUG nova.network.neutron [req-50f3d4e1-109e-48f8-9710-3c370968f34c req-5ba50770-8261-425c-be1d-430ac1566bb7 service nova] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Updating instance_info_cache with network_info: [{"id": "32417a5a-a445-4b76-b308-0d3b5180ac94", "address": "fa:16:3e:ee:f9:d5", "network": {"id": "52ed808b-c840-47a7-aa8f-8055fd7bd1ef", "bridge": "br-int", "label": "tempest-TestStampPattern-1964150399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2329e260514d818d5af10aeeda498d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32417a5a-a4", "ovs_interfaceid": "32417a5a-a445-4b76-b308-0d3b5180ac94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:13:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-50f3d4e1-109e-48f8-9710-3c370968f34c req-5ba50770-8261-425c-be1d-430ac1566bb7 service nova] Releasing lock "refresh_cache-c45186c1-193e-4d52-a09b-aa8d18195c8e" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:13:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.190s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/31504941-0f9e-4ebd-b992-3b08a4aef25a/disk 1073741824 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/31504941-0f9e-4ebd-b992-3b08a4aef25a/disk 1073741824" returned: 0 in 0.057s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:13:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.193s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:47 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Checking if we can resize image /opt/stack/data/nova/instances/31504941-0f9e-4ebd-b992-3b08a4aef25a/disk. size=1073741824 {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 23:13:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31504941-0f9e-4ebd-b992-3b08a4aef25a/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:47 user nova-compute[72766]: DEBUG nova.network.neutron [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Successfully created port: 563bceb6-8712-4058-b0fb-ef8c5cf64d1d {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 23:13:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31504941-0f9e-4ebd-b992-3b08a4aef25a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:47 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Cannot resize image /opt/stack/data/nova/instances/31504941-0f9e-4ebd-b992-3b08a4aef25a/disk to a smaller size. {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 23:13:47 user nova-compute[72766]: DEBUG nova.objects.instance [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lazy-loading 'migration_context' on Instance uuid 31504941-0f9e-4ebd-b992-3b08a4aef25a {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:13:47 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 23:13:47 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Ensure instance console log exists: /opt/stack/data/nova/instances/31504941-0f9e-4ebd-b992-3b08a4aef25a/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 23:13:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:13:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:13:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:13:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:48 user nova-compute[72766]: DEBUG nova.compute.manager [req-205d9cd0-1f39-43d3-97f0-e141a6589e0b req-081a950c-6cbd-4899-9cc8-db69ed9251db service nova] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Received event network-vif-plugged-32417a5a-a445-4b76-b308-0d3b5180ac94 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:13:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-205d9cd0-1f39-43d3-97f0-e141a6589e0b req-081a950c-6cbd-4899-9cc8-db69ed9251db service nova] Acquiring lock "c45186c1-193e-4d52-a09b-aa8d18195c8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:13:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-205d9cd0-1f39-43d3-97f0-e141a6589e0b req-081a950c-6cbd-4899-9cc8-db69ed9251db service nova] Lock "c45186c1-193e-4d52-a09b-aa8d18195c8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:13:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-205d9cd0-1f39-43d3-97f0-e141a6589e0b req-081a950c-6cbd-4899-9cc8-db69ed9251db service nova] Lock "c45186c1-193e-4d52-a09b-aa8d18195c8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:13:48 user nova-compute[72766]: DEBUG nova.compute.manager [req-205d9cd0-1f39-43d3-97f0-e141a6589e0b req-081a950c-6cbd-4899-9cc8-db69ed9251db service nova] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] No waiting events found dispatching network-vif-plugged-32417a5a-a445-4b76-b308-0d3b5180ac94 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:13:48 user nova-compute[72766]: WARNING nova.compute.manager [req-205d9cd0-1f39-43d3-97f0-e141a6589e0b req-081a950c-6cbd-4899-9cc8-db69ed9251db service nova] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Received unexpected event network-vif-plugged-32417a5a-a445-4b76-b308-0d3b5180ac94 for instance with vm_state building and task_state spawning.
Aug 14 23:13:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:48 user nova-compute[72766]: DEBUG nova.network.neutron [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Successfully updated port: 563bceb6-8712-4058-b0fb-ef8c5cf64d1d {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 23:13:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquiring lock "refresh_cache-31504941-0f9e-4ebd-b992-3b08a4aef25a" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:13:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquired lock "refresh_cache-31504941-0f9e-4ebd-b992-3b08a4aef25a" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:13:48 user nova-compute[72766]: DEBUG nova.network.neutron [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:13:48 user nova-compute[72766]: DEBUG nova.network.neutron [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 23:13:48 user nova-compute[72766]: DEBUG nova.compute.manager [req-4eb0657f-1750-42ad-b6dc-c045669ba493 req-a22f8ae6-e805-4872-a4c9-bd1c16fee44c service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Received event network-vif-plugged-f2f08b69-eb49-4a38-9357-36420ee797d6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:13:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-4eb0657f-1750-42ad-b6dc-c045669ba493 req-a22f8ae6-e805-4872-a4c9-bd1c16fee44c service nova] Acquiring lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:13:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-4eb0657f-1750-42ad-b6dc-c045669ba493 req-a22f8ae6-e805-4872-a4c9-bd1c16fee44c service nova] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:13:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-4eb0657f-1750-42ad-b6dc-c045669ba493 req-a22f8ae6-e805-4872-a4c9-bd1c16fee44c service nova] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:13:48 user nova-compute[72766]: DEBUG nova.compute.manager [req-4eb0657f-1750-42ad-b6dc-c045669ba493 req-a22f8ae6-e805-4872-a4c9-bd1c16fee44c service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] No waiting events found dispatching network-vif-plugged-f2f08b69-eb49-4a38-9357-36420ee797d6 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:13:48 user nova-compute[72766]: WARNING nova.compute.manager [req-4eb0657f-1750-42ad-b6dc-c045669ba493 req-a22f8ae6-e805-4872-a4c9-bd1c16fee44c service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Received unexpected event network-vif-plugged-f2f08b69-eb49-4a38-9357-36420ee797d6 for instance with vm_state active and task_state rescuing.
Aug 14 23:13:48 user nova-compute[72766]: DEBUG nova.compute.manager [req-4eb0657f-1750-42ad-b6dc-c045669ba493 req-a22f8ae6-e805-4872-a4c9-bd1c16fee44c service nova] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Received event network-changed-563bceb6-8712-4058-b0fb-ef8c5cf64d1d {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:13:48 user nova-compute[72766]: DEBUG nova.compute.manager [req-4eb0657f-1750-42ad-b6dc-c045669ba493 req-a22f8ae6-e805-4872-a4c9-bd1c16fee44c service nova] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Refreshing instance network info cache due to event network-changed-563bceb6-8712-4058-b0fb-ef8c5cf64d1d. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:13:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-4eb0657f-1750-42ad-b6dc-c045669ba493 req-a22f8ae6-e805-4872-a4c9-bd1c16fee44c service nova] Acquiring lock "refresh_cache-31504941-0f9e-4ebd-b992-3b08a4aef25a" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:13:48 user nova-compute[72766]: DEBUG nova.network.neutron [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Updating instance_info_cache with network_info: [{"id": "563bceb6-8712-4058-b0fb-ef8c5cf64d1d", "address": "fa:16:3e:4f:80:98", "network": {"id": "b375da9b-b613-4a88-a262-962f959597b9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-462508113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1dd09415664f1aa0b0dbdeeb4b8d32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap563bceb6-87", "ovs_interfaceid": "563bceb6-8712-4058-b0fb-ef8c5cf64d1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:13:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Releasing lock "refresh_cache-31504941-0f9e-4ebd-b992-3b08a4aef25a" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:13:48 user nova-compute[72766]: DEBUG nova.compute.manager [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Instance network_info: |[{"id": "563bceb6-8712-4058-b0fb-ef8c5cf64d1d", "address": "fa:16:3e:4f:80:98", "network": {"id": "b375da9b-b613-4a88-a262-962f959597b9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-462508113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1dd09415664f1aa0b0dbdeeb4b8d32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap563bceb6-87", "ovs_interfaceid": "563bceb6-8712-4058-b0fb-ef8c5cf64d1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 23:13:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-4eb0657f-1750-42ad-b6dc-c045669ba493 req-a22f8ae6-e805-4872-a4c9-bd1c16fee44c service nova] Acquired lock "refresh_cache-31504941-0f9e-4ebd-b992-3b08a4aef25a" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:13:48 user nova-compute[72766]: DEBUG nova.network.neutron [req-4eb0657f-1750-42ad-b6dc-c045669ba493 req-a22f8ae6-e805-4872-a4c9-bd1c16fee44c service nova] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Refreshing network info cache for port 563bceb6-8712-4058-b0fb-ef8c5cf64d1d {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:13:48 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Start _get_guest_xml network_info=[{"id": "563bceb6-8712-4058-b0fb-ef8c5cf64d1d", "address": "fa:16:3e:4f:80:98", "network": {"id": "b375da9b-b613-4a88-a262-962f959597b9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-462508113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1dd09415664f1aa0b0dbdeeb4b8d32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap563bceb6-87", "ovs_interfaceid": "563bceb6-8712-4058-b0fb-ef8c5cf64d1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd2900d30-2c4c-4d57-9135-d45564c0c596'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:13:48 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:13:48 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:13:48 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:13:48 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:13:48 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:13:48 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:13:48 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:13:48 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:13:48 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:13:48 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:13:48 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:13:48 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:13:48 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:13:48 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:13:48 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:13:48 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:13:48 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:13:48 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:13:48 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:13:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1602261622',display_name='tempest-AttachVolumeTestJSON-server-1602261622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1602261622',id=33,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3YhERppPyCOH4gsQJfBOOTkAM5iXhIPotQUZcWkUP6EIQSOUhP7OAdRj0j7jwUEyk4pdeP4QiY9D/yPspRPyMd4tcj8BIp98Vtbi0BX9Nu6Gpgw1XvZ/PobzDK3tDJSQ==',key_name='tempest-keypair-1482276693',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b1dd09415664f1aa0b0dbdeeb4b8d32',ramdisk_id='',reservation_id='r-y99pkhnc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-716158533',owner_user_name='tempest-AttachVolumeTestJSON-716158533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:13:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a41813929144571a3306300dbf6f485',uuid=31504941-0f9e-4ebd-b992-3b08a4aef25a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "563bceb6-8712-4058-b0fb-ef8c5cf64d1d", "address": "fa:16:3e:4f:80:98", "network": {"id": "b375da9b-b613-4a88-a262-962f959597b9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-462508113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1dd09415664f1aa0b0dbdeeb4b8d32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap563bceb6-87", "ovs_interfaceid": "563bceb6-8712-4058-b0fb-ef8c5cf64d1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:13:48 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Converting VIF {"id": "563bceb6-8712-4058-b0fb-ef8c5cf64d1d", "address": "fa:16:3e:4f:80:98", "network": {"id": "b375da9b-b613-4a88-a262-962f959597b9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-462508113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1dd09415664f1aa0b0dbdeeb4b8d32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap563bceb6-87", "ovs_interfaceid": "563bceb6-8712-4058-b0fb-ef8c5cf64d1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:13:48 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:80:98,bridge_name='br-int',has_traffic_filtering=True,id=563bceb6-8712-4058-b0fb-ef8c5cf64d1d,network=Network(b375da9b-b613-4a88-a262-962f959597b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap563bceb6-87') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:13:48 user nova-compute[72766]: DEBUG nova.objects.instance [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lazy-loading 'pci_devices' on Instance uuid 31504941-0f9e-4ebd-b992-3b08a4aef25a {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:13:49 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:13:49 user nova-compute[72766]:   <uuid>31504941-0f9e-4ebd-b992-3b08a4aef25a</uuid>
Aug 14 23:13:49 user nova-compute[72766]:   <name>instance-00000021</name>
Aug 14 23:13:49 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:13:49 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:13:49 user nova-compute[72766]:   <metadata>
Aug 14 23:13:49 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:13:49 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:13:49 user nova-compute[72766]:       <nova:name>tempest-AttachVolumeTestJSON-server-1602261622</nova:name>
Aug 14 23:13:49 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:13:48</nova:creationTime>
Aug 14 23:13:49 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:13:49 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:13:49 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:13:49 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:13:49 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:13:49 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:13:49 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:13:49 user nova-compute[72766]:       <nova:owner>
Aug 14 23:13:49 user nova-compute[72766]:         <nova:user uuid="7a41813929144571a3306300dbf6f485">tempest-AttachVolumeTestJSON-716158533-project-member</nova:user>
Aug 14 23:13:49 user nova-compute[72766]:         <nova:project uuid="3b1dd09415664f1aa0b0dbdeeb4b8d32">tempest-AttachVolumeTestJSON-716158533</nova:project>
Aug 14 23:13:49 user nova-compute[72766]:       </nova:owner>
Aug 14 23:13:49 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 23:13:49 user nova-compute[72766]:       <nova:ports>
Aug 14 23:13:49 user nova-compute[72766]:         <nova:port uuid="563bceb6-8712-4058-b0fb-ef8c5cf64d1d">
Aug 14 23:13:49 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 23:13:49 user nova-compute[72766]:         </nova:port>
Aug 14 23:13:49 user nova-compute[72766]:       </nova:ports>
Aug 14 23:13:49 user nova-compute[72766]:     </nova:instance>
Aug 14 23:13:49 user nova-compute[72766]:   </metadata>
Aug 14 23:13:49 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:13:49 user nova-compute[72766]:     <system>
Aug 14 23:13:49 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:13:49 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:13:49 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:13:49 user nova-compute[72766]:       <entry name="serial">31504941-0f9e-4ebd-b992-3b08a4aef25a</entry>
Aug 14 23:13:49 user nova-compute[72766]:       <entry name="uuid">31504941-0f9e-4ebd-b992-3b08a4aef25a</entry>
Aug 14 23:13:49 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:13:49 user nova-compute[72766]:     </system>
Aug 14 23:13:49 user nova-compute[72766]:   </sysinfo>
Aug 14 23:13:49 user nova-compute[72766]:   <os>
Aug 14 23:13:49 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:13:49 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:13:49 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:13:49 user nova-compute[72766]:   </os>
Aug 14 23:13:49 user nova-compute[72766]:   <features>
Aug 14 23:13:49 user nova-compute[72766]:     <acpi/>
Aug 14 23:13:49 user nova-compute[72766]:     <apic/>
Aug 14 23:13:49 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:13:49 user nova-compute[72766]:   </features>
Aug 14 23:13:49 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:13:49 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:13:49 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:13:49 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:13:49 user nova-compute[72766]:   </clock>
Aug 14 23:13:49 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:13:49 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:13:49 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:13:49 user nova-compute[72766]:   </cpu>
Aug 14 23:13:49 user nova-compute[72766]:   <devices>
Aug 14 23:13:49 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 23:13:49 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 23:13:49 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/31504941-0f9e-4ebd-b992-3b08a4aef25a/disk"/>
Aug 14 23:13:49 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:13:49 user nova-compute[72766]:     </disk>
Aug 14 23:13:49 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:13:49 user nova-compute[72766]:       <mac address="fa:16:3e:4f:80:98"/>
Aug 14 23:13:49 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:13:49 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:13:49 user nova-compute[72766]:       <target dev="tap563bceb6-87"/>
Aug 14 23:13:49 user nova-compute[72766]:     </interface>
Aug 14 23:13:49 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:13:49 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/31504941-0f9e-4ebd-b992-3b08a4aef25a/console.log" append="off"/>
Aug 14 23:13:49 user nova-compute[72766]:     </serial>
Aug 14 23:13:49 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:13:49 user nova-compute[72766]:     <video>
Aug 14 23:13:49 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:13:49 user nova-compute[72766]:     </video>
Aug 14 23:13:49 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:13:49 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:13:49 user nova-compute[72766]:     </rng>
Aug 14 23:13:49 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:13:49 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:13:49 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:13:49 user nova-compute[72766]:     </memballoon>
Aug 14 23:13:49 user nova-compute[72766]:   </devices>
Aug 14 23:13:49 user nova-compute[72766]: </domain>
Aug 14 23:13:49 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:13:49 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:13:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1602261622',display_name='tempest-AttachVolumeTestJSON-server-1602261622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1602261622',id=33,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3YhERppPyCOH4gsQJfBOOTkAM5iXhIPotQUZcWkUP6EIQSOUhP7OAdRj0j7jwUEyk4pdeP4QiY9D/yPspRPyMd4tcj8BIp98Vtbi0BX9Nu6Gpgw1XvZ/PobzDK3tDJSQ==',key_name='tempest-keypair-1482276693',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b1dd09415664f1aa0b0dbdeeb4b8d32',ramdisk_id='',reservation_id='r-y99pkhnc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-716158533',owner_user_name='tempest-AttachVolumeTestJSON-716158533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:13:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a41813929144571a3306300dbf6f485',uuid=31504941-0f9e-4ebd-b992-3b08a4aef25a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "563bceb6-8712-4058-b0fb-ef8c5cf64d1d", "address": "fa:16:3e:4f:80:98", "network": {"id": "b375da9b-b613-4a88-a262-962f959597b9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-462508113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1dd09415664f1aa0b0dbdeeb4b8d32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap563bceb6-87", "ovs_interfaceid": "563bceb6-8712-4058-b0fb-ef8c5cf64d1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:13:49 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Converting VIF {"id": "563bceb6-8712-4058-b0fb-ef8c5cf64d1d", "address": "fa:16:3e:4f:80:98", "network": {"id": "b375da9b-b613-4a88-a262-962f959597b9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-462508113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1dd09415664f1aa0b0dbdeeb4b8d32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap563bceb6-87", "ovs_interfaceid": "563bceb6-8712-4058-b0fb-ef8c5cf64d1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:13:49 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:80:98,bridge_name='br-int',has_traffic_filtering=True,id=563bceb6-8712-4058-b0fb-ef8c5cf64d1d,network=Network(b375da9b-b613-4a88-a262-962f959597b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap563bceb6-87') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:13:49 user nova-compute[72766]: DEBUG os_vif [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:80:98,bridge_name='br-int',has_traffic_filtering=True,id=563bceb6-8712-4058-b0fb-ef8c5cf64d1d,network=Network(b375da9b-b613-4a88-a262-962f959597b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap563bceb6-87') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:13:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:13:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:13:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap563bceb6-87, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:13:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap563bceb6-87, col_values=(('external_ids', {'iface-id': '563bceb6-8712-4058-b0fb-ef8c5cf64d1d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:80:98', 'vm-uuid': '31504941-0f9e-4ebd-b992-3b08a4aef25a'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:13:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:13:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:49 user nova-compute[72766]: INFO os_vif [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:80:98,bridge_name='br-int',has_traffic_filtering=True,id=563bceb6-8712-4058-b0fb-ef8c5cf64d1d,network=Network(b375da9b-b613-4a88-a262-962f959597b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap563bceb6-87')
Aug 14 23:13:49 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:13:49 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] No VIF found with MAC fa:16:3e:4f:80:98, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:13:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:49 user nova-compute[72766]: DEBUG nova.network.neutron [req-4eb0657f-1750-42ad-b6dc-c045669ba493 req-a22f8ae6-e805-4872-a4c9-bd1c16fee44c service nova] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Updated VIF entry in instance network info cache for port 563bceb6-8712-4058-b0fb-ef8c5cf64d1d. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:13:49 user nova-compute[72766]: DEBUG nova.network.neutron [req-4eb0657f-1750-42ad-b6dc-c045669ba493 req-a22f8ae6-e805-4872-a4c9-bd1c16fee44c service nova] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Updating instance_info_cache with network_info: [{"id": "563bceb6-8712-4058-b0fb-ef8c5cf64d1d", "address": "fa:16:3e:4f:80:98", "network": {"id": "b375da9b-b613-4a88-a262-962f959597b9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-462508113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1dd09415664f1aa0b0dbdeeb4b8d32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap563bceb6-87", "ovs_interfaceid": "563bceb6-8712-4058-b0fb-ef8c5cf64d1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:13:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-4eb0657f-1750-42ad-b6dc-c045669ba493 req-a22f8ae6-e805-4872-a4c9-bd1c16fee44c service nova] Releasing lock "refresh_cache-31504941-0f9e-4ebd-b992-3b08a4aef25a" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:13:49 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Removed pending event for 901fe741-3b2f-472e-b91c-a90c9d4a9c39 due to event {{(pid=72766) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 23:13:49 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054829.900224, 901fe741-3b2f-472e-b91c-a90c9d4a9c39 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:13:49 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] VM Resumed (Lifecycle Event)
Aug 14 23:13:49 user nova-compute[72766]: DEBUG nova.compute.manager [None req-7fb5a0eb-6625-4b27-b7dc-bcee59e8bc22 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:13:49 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:13:49 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:13:49 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 23:13:49 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054829.9040418, 901fe741-3b2f-472e-b91c-a90c9d4a9c39 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:13:49 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] VM Started (Lifecycle Event)
Aug 14 23:13:49 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:13:49 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:13:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:50 user nova-compute[72766]: DEBUG nova.compute.manager [req-d8d013a4-a076-4c02-909b-c81b6834b470 req-f18fa6df-b207-4244-b99c-aae2499abb51 service nova] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Received event network-vif-plugged-32417a5a-a445-4b76-b308-0d3b5180ac94 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:13:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d8d013a4-a076-4c02-909b-c81b6834b470 req-f18fa6df-b207-4244-b99c-aae2499abb51 service nova] Acquiring lock "c45186c1-193e-4d52-a09b-aa8d18195c8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:13:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d8d013a4-a076-4c02-909b-c81b6834b470 req-f18fa6df-b207-4244-b99c-aae2499abb51 service nova] Lock "c45186c1-193e-4d52-a09b-aa8d18195c8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:13:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d8d013a4-a076-4c02-909b-c81b6834b470 req-f18fa6df-b207-4244-b99c-aae2499abb51 service nova] Lock "c45186c1-193e-4d52-a09b-aa8d18195c8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:13:50 user nova-compute[72766]: DEBUG nova.compute.manager [req-d8d013a4-a076-4c02-909b-c81b6834b470 req-f18fa6df-b207-4244-b99c-aae2499abb51 service nova] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] No waiting events found dispatching network-vif-plugged-32417a5a-a445-4b76-b308-0d3b5180ac94 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:13:50 user nova-compute[72766]: WARNING nova.compute.manager [req-d8d013a4-a076-4c02-909b-c81b6834b470 req-f18fa6df-b207-4244-b99c-aae2499abb51 service nova] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Received unexpected event network-vif-plugged-32417a5a-a445-4b76-b308-0d3b5180ac94 for instance with vm_state building and task_state spawning.
Aug 14 23:13:50 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054830.471207, c45186c1-193e-4d52-a09b-aa8d18195c8e => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:13:50 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] VM Resumed (Lifecycle Event)
Aug 14 23:13:50 user nova-compute[72766]: DEBUG nova.compute.manager [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:13:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 23:13:50 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:13:50 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Instance spawned successfully.
Aug 14 23:13:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 23:13:50 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:13:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:13:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:13:50 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:13:50 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054830.4752073, c45186c1-193e-4d52-a09b-aa8d18195c8e => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:13:50 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] VM Started (Lifecycle Event)
Aug 14 23:13:50 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:13:50 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:13:50 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:13:50 user nova-compute[72766]: INFO nova.compute.manager [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Took 7.02 seconds to spawn the instance on the hypervisor.
Aug 14 23:13:50 user nova-compute[72766]: DEBUG nova.compute.manager [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:13:50 user nova-compute[72766]: INFO nova.compute.manager [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Took 8.13 seconds to build instance.
Aug 14 23:13:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b5fcae6e-8668-4e2c-a368-159b0de2b8ba tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "c45186c1-193e-4d52-a09b-aa8d18195c8e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.231s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:13:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:52 user nova-compute[72766]: DEBUG nova.compute.manager [req-18ba6811-58ee-430d-b136-34a3e7d1dd13 req-5761cf62-4a27-46cc-8dda-4035fcc7b50a service nova] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Received event network-vif-plugged-563bceb6-8712-4058-b0fb-ef8c5cf64d1d {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:13:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-18ba6811-58ee-430d-b136-34a3e7d1dd13 req-5761cf62-4a27-46cc-8dda-4035fcc7b50a service nova] Acquiring lock "31504941-0f9e-4ebd-b992-3b08a4aef25a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:13:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-18ba6811-58ee-430d-b136-34a3e7d1dd13 req-5761cf62-4a27-46cc-8dda-4035fcc7b50a service nova] Lock "31504941-0f9e-4ebd-b992-3b08a4aef25a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:13:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-18ba6811-58ee-430d-b136-34a3e7d1dd13 req-5761cf62-4a27-46cc-8dda-4035fcc7b50a service nova] Lock "31504941-0f9e-4ebd-b992-3b08a4aef25a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:13:52 user nova-compute[72766]: DEBUG nova.compute.manager [req-18ba6811-58ee-430d-b136-34a3e7d1dd13 req-5761cf62-4a27-46cc-8dda-4035fcc7b50a service nova] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] No waiting events found dispatching network-vif-plugged-563bceb6-8712-4058-b0fb-ef8c5cf64d1d {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:13:52 user nova-compute[72766]: WARNING nova.compute.manager [req-18ba6811-58ee-430d-b136-34a3e7d1dd13 req-5761cf62-4a27-46cc-8dda-4035fcc7b50a service nova] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Received unexpected event network-vif-plugged-563bceb6-8712-4058-b0fb-ef8c5cf64d1d for instance with vm_state building and task_state spawning.
Aug 14 23:13:52 user nova-compute[72766]: DEBUG nova.compute.manager [req-18ba6811-58ee-430d-b136-34a3e7d1dd13 req-5761cf62-4a27-46cc-8dda-4035fcc7b50a service nova] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Received event network-vif-plugged-563bceb6-8712-4058-b0fb-ef8c5cf64d1d {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:13:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-18ba6811-58ee-430d-b136-34a3e7d1dd13 req-5761cf62-4a27-46cc-8dda-4035fcc7b50a service nova] Acquiring lock "31504941-0f9e-4ebd-b992-3b08a4aef25a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:13:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-18ba6811-58ee-430d-b136-34a3e7d1dd13 req-5761cf62-4a27-46cc-8dda-4035fcc7b50a service nova] Lock "31504941-0f9e-4ebd-b992-3b08a4aef25a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:13:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-18ba6811-58ee-430d-b136-34a3e7d1dd13 req-5761cf62-4a27-46cc-8dda-4035fcc7b50a service nova] Lock "31504941-0f9e-4ebd-b992-3b08a4aef25a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:13:52 user nova-compute[72766]: DEBUG nova.compute.manager [req-18ba6811-58ee-430d-b136-34a3e7d1dd13 req-5761cf62-4a27-46cc-8dda-4035fcc7b50a service nova] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] No waiting events found dispatching network-vif-plugged-563bceb6-8712-4058-b0fb-ef8c5cf64d1d {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:13:52 user nova-compute[72766]: WARNING nova.compute.manager [req-18ba6811-58ee-430d-b136-34a3e7d1dd13 req-5761cf62-4a27-46cc-8dda-4035fcc7b50a service nova] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Received unexpected event network-vif-plugged-563bceb6-8712-4058-b0fb-ef8c5cf64d1d for instance with vm_state building and task_state spawning.
Aug 14 23:13:52 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054832.764218, 31504941-0f9e-4ebd-b992-3b08a4aef25a => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:13:52 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] VM Resumed (Lifecycle Event)
Aug 14 23:13:52 user nova-compute[72766]: DEBUG nova.compute.manager [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:13:52 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 23:13:52 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Instance spawned successfully.
Aug 14 23:13:52 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 23:13:52 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:13:52 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:13:52 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:13:52 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:13:52 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:13:52 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:13:52 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:13:52 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:13:52 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:13:52 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054832.7656496, 31504941-0f9e-4ebd-b992-3b08a4aef25a => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:13:52 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] VM Started (Lifecycle Event)
Aug 14 23:13:52 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:13:52 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:13:52 user nova-compute[72766]: INFO nova.compute.manager [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Took 5.87 seconds to spawn the instance on the hypervisor.
Aug 14 23:13:52 user nova-compute[72766]: DEBUG nova.compute.manager [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:13:52 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:13:52 user nova-compute[72766]: INFO nova.compute.manager [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Took 6.84 seconds to build instance.
Aug 14 23:13:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-77c51371-0486-47ef-8463-0470c042d520 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "31504941-0f9e-4ebd-b992-3b08a4aef25a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.996s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:13:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:13:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-970a0469-e1bc-40ee-bef5-a7a10a7deeac tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Acquiring lock "88009c57-377b-4636-ba54-1945c1bc7928" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:13:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-970a0469-e1bc-40ee-bef5-a7a10a7deeac tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lock "88009c57-377b-4636-ba54-1945c1bc7928" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:13:55 user nova-compute[72766]: INFO nova.compute.manager [None req-970a0469-e1bc-40ee-bef5-a7a10a7deeac tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Detaching volume 0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8
Aug 14 23:13:55 user nova-compute[72766]: INFO nova.virt.block_device [None req-970a0469-e1bc-40ee-bef5-a7a10a7deeac tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Attempting to driver detach volume 0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8 from mountpoint /dev/vdb
Aug 14 23:13:55 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-970a0469-e1bc-40ee-bef5-a7a10a7deeac tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Attempting to detach device vdb from instance 88009c57-377b-4636-ba54-1945c1bc7928 from the persistent domain config. {{(pid=72766) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 23:13:55 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-970a0469-e1bc-40ee-bef5-a7a10a7deeac tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 23:13:55 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:13:55 user nova-compute[72766]:   <source dev="/dev/sdc"/>
Aug 14 23:13:55 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:13:55 user nova-compute[72766]:   <serial>0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8</serial>
Aug 14 23:13:55 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 23:13:55 user nova-compute[72766]: </disk>
Aug 14 23:13:55 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 23:13:55 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-970a0469-e1bc-40ee-bef5-a7a10a7deeac tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Successfully detached device vdb from instance 88009c57-377b-4636-ba54-1945c1bc7928 from the persistent domain config.
Aug 14 23:13:55 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-970a0469-e1bc-40ee-bef5-a7a10a7deeac tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 88009c57-377b-4636-ba54-1945c1bc7928 from the live domain config. {{(pid=72766) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 23:13:55 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-970a0469-e1bc-40ee-bef5-a7a10a7deeac tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 23:13:55 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:13:55 user nova-compute[72766]:   <source dev="/dev/sdc"/>
Aug 14 23:13:55 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:13:55 user nova-compute[72766]:   <serial>0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8</serial>
Aug 14 23:13:55 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 23:13:55 user nova-compute[72766]: </disk>
Aug 14 23:13:55 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 23:13:55 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Received event <DeviceRemovedEvent: 1692054835.8551662, 88009c57-377b-4636-ba54-1945c1bc7928 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72766) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 23:13:55 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-970a0469-e1bc-40ee-bef5-a7a10a7deeac tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 88009c57-377b-4636-ba54-1945c1bc7928 {{(pid=72766) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 23:13:55 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-970a0469-e1bc-40ee-bef5-a7a10a7deeac tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Successfully detached device vdb from instance 88009c57-377b-4636-ba54-1945c1bc7928 from the live domain config.
Aug 14 23:13:55 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-970a0469-e1bc-40ee-bef5-a7a10a7deeac tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:13:55 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-970a0469-e1bc-40ee-bef5-a7a10a7deeac tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QluUxPrj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:13:55 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-970a0469-e1bc-40ee-bef5-a7a10a7deeac tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:13:55 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-970a0469-e1bc-40ee-bef5-a7a10a7deeac tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:13:55 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-970a0469-e1bc-40ee-bef5-a7a10a7deeac tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:13:55 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-970a0469-e1bc-40ee-bef5-a7a10a7deeac tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:13:55 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:55 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:55 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fe943d-66a6-488e-9d45-b750fade1cd9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:13:55 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:55 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:55 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[624bb364-e059-4dc4-aa8b-9b891b021291]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:13:55 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-970a0469-e1bc-40ee-bef5-a7a10a7deeac tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:13:55 user nova-compute[72766]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)
Aug 14 23:13:55 user nova-compute[72766]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8 (non-flash)
Aug 14 23:13:55 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:13:55 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-970a0469-e1bc-40ee-bef5-a7a10a7deeac tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:13:55 user nova-compute[72766]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)
Aug 14 23:13:55 user nova-compute[72766]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8 (non-flash)
Aug 14 23:13:55 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:13:55 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-970a0469-e1bc-40ee-bef5-a7a10a7deeac tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff1543df5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8'): ({'sdc'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:13:55 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-970a0469-e1bc-40ee-bef5-a7a10a7deeac tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Removing single pathed devices sdc {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:13:55 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:55 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:55 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c947b4-7d3a-4d1c-b3bb-374030565fff]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:13:55 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:55 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:55 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[35dbe498-fc4c-4825-8811-34c8484c0c5c]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:13:55 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-970a0469-e1bc-40ee-bef5-a7a10a7deeac tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Flushing IO for device /dev/sdc {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:13:55 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:55 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:55 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f129ff-8f67-4dd5-be85-8fdfb28087cb]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:13:55 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-970a0469-e1bc-40ee-bef5-a7a10a7deeac tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:13:55 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:56 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b449699-cb29-4cb0-bb3e-2a552c112e3a]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:13:56 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-970a0469-e1bc-40ee-bef5-a7a10a7deeac tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:13:56 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-970a0469-e1bc-40ee-bef5-a7a10a7deeac tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] SCSI volumes sdc have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:13:56 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-970a0469-e1bc-40ee-bef5-a7a10a7deeac tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:13:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:56 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2c8d0d-7225-43d4-bfd1-e10866a3ca06]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:13:56 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-970a0469-e1bc-40ee-bef5-a7a10a7deeac tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:13:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8 -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:56 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a1a1fc-4c28-4c8e-880e-9604c94d6dd0]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:13:56 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-970a0469-e1bc-40ee-bef5-a7a10a7deeac tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8, portal: 172.16.0.220,3260]
Aug 14 23:13:56 user nova-compute[72766]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8, portal: 172.16.0.220,3260] successful.
Aug 14 23:13:56 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:13:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8 -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:13:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a70eb9e-b8b0-4d87-8482-0432ee7fdeb8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:13:56 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71011c5-3ea5-4dfa-b244-f33d6dec1146]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:13:56 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-970a0469-e1bc-40ee-bef5-a7a10a7deeac tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:13:56 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-970a0469-e1bc-40ee-bef5-a7a10a7deeac tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:13:56 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-970a0469-e1bc-40ee-bef5-a7a10a7deeac tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] <== disconnect_volume: return (297ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:13:56 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-970a0469-e1bc-40ee-bef5-a7a10a7deeac tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:13:56 user nova-compute[72766]: DEBUG nova.objects.instance [None req-970a0469-e1bc-40ee-bef5-a7a10a7deeac tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lazy-loading 'flavor' on Instance uuid 88009c57-377b-4636-ba54-1945c1bc7928 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:13:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-970a0469-e1bc-40ee-bef5-a7a10a7deeac tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lock "88009c57-377b-4636-ba54-1945c1bc7928" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.821s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:13:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:14:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:14:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:14:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:14:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:14:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:14:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:14:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:14:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:14:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:14:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:14:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:14:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:14:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:14:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:14:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:14:27 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:14:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:14:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:14:29 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:14:30 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:14:30 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:14:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-83084ccc-8e55-43dc-9a37-ffcb35a10922" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:14:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-83084ccc-8e55-43dc-9a37-ffcb35a10922" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:14:30 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:14:31 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Updating instance_info_cache with network_info: [{"id": "cbbf0086-17e4-41a5-8893-cf8657faf6e5", "address": "fa:16:3e:22:4b:22", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbbf0086-17", "ovs_interfaceid": "cbbf0086-17e4-41a5-8893-cf8657faf6e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:14:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-83084ccc-8e55-43dc-9a37-ffcb35a10922" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:14:31 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:14:31 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:14:31 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:14:31 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:14:31 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:14:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:14:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:14:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:14:31 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:14:31 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:14:31 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:14:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/901fe741-3b2f-472e-b91c-a90c9d4a9c39/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:14:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/901fe741-3b2f-472e-b91c-a90c9d4a9c39/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:14:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/901fe741-3b2f-472e-b91c-a90c9d4a9c39/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:14:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/901fe741-3b2f-472e-b91c-a90c9d4a9c39/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:14:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c45186c1-193e-4d52-a09b-aa8d18195c8e/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:14:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c45186c1-193e-4d52-a09b-aa8d18195c8e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:14:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c45186c1-193e-4d52-a09b-aa8d18195c8e/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:14:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c45186c1-193e-4d52-a09b-aa8d18195c8e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:14:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:14:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:14:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:14:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:14:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:14:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:14:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:14:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:14:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:14:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:14:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:14:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:14:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88009c57-377b-4636-ba54-1945c1bc7928/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:14:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88009c57-377b-4636-ba54-1945c1bc7928/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:14:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88009c57-377b-4636-ba54-1945c1bc7928/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:14:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:14:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88009c57-377b-4636-ba54-1945c1bc7928/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:14:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31504941-0f9e-4ebd-b992-3b08a4aef25a/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:14:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:14:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31504941-0f9e-4ebd-b992-3b08a4aef25a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:14:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31504941-0f9e-4ebd-b992-3b08a4aef25a/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:14:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31504941-0f9e-4ebd-b992-3b08a4aef25a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:14:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:14:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:14:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:14:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:14:35 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:14:35 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:14:35 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=7680MB free_disk=25.025623321533203GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:14:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:14:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:14:35 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 3ff300ff-34fd-4e94-9d2d-681fb133ba32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:14:35 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance cbcf7851-e6f7-4f46-97cc-d773286ccddf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:14:35 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 83084ccc-8e55-43dc-9a37-ffcb35a10922 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:14:35 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 71970b47-b09b-4492-9d99-a2be8b3b2042 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:14:35 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 9ec72ed8-0c33-4e70-ae88-d7571c84de2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:14:35 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 88009c57-377b-4636-ba54-1945c1bc7928 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:14:35 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 901fe741-3b2f-472e-b91c-a90c9d4a9c39 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:14:35 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance c45186c1-193e-4d52-a09b-aa8d18195c8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:14:35 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 31504941-0f9e-4ebd-b992-3b08a4aef25a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:14:35 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:14:35 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:14:35 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:14:35 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:14:35 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:14:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.449s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:14:37 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:14:37 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:14:37 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:14:39 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:14:39 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:14:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:14:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-26ec45c3-3b4c-4e6f-82b9-97c3e156302e tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Acquiring lock "88009c57-377b-4636-ba54-1945c1bc7928" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:14:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-26ec45c3-3b4c-4e6f-82b9-97c3e156302e tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lock "88009c57-377b-4636-ba54-1945c1bc7928" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:14:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-26ec45c3-3b4c-4e6f-82b9-97c3e156302e tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Acquiring lock "88009c57-377b-4636-ba54-1945c1bc7928-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:14:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-26ec45c3-3b4c-4e6f-82b9-97c3e156302e tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lock "88009c57-377b-4636-ba54-1945c1bc7928-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:14:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-26ec45c3-3b4c-4e6f-82b9-97c3e156302e tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lock "88009c57-377b-4636-ba54-1945c1bc7928-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:14:45 user nova-compute[72766]: INFO nova.compute.manager [None req-26ec45c3-3b4c-4e6f-82b9-97c3e156302e tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Terminating instance
Aug 14 23:14:45 user nova-compute[72766]: DEBUG nova.compute.manager [None req-26ec45c3-3b4c-4e6f-82b9-97c3e156302e tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:14:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:14:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:14:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:14:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:14:45 user nova-compute[72766]: DEBUG nova.compute.manager [req-3c31c6f1-1935-4588-b261-03ae742d2556 req-f86dc426-d710-462e-bb89-244a7523e903 service nova] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Received event network-vif-unplugged-e2f51f15-395f-4f23-b946-0da2eef80a35 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:14:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-3c31c6f1-1935-4588-b261-03ae742d2556 req-f86dc426-d710-462e-bb89-244a7523e903 service nova] Acquiring lock "88009c57-377b-4636-ba54-1945c1bc7928-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:14:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-3c31c6f1-1935-4588-b261-03ae742d2556 req-f86dc426-d710-462e-bb89-244a7523e903 service nova] Lock "88009c57-377b-4636-ba54-1945c1bc7928-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:14:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-3c31c6f1-1935-4588-b261-03ae742d2556 req-f86dc426-d710-462e-bb89-244a7523e903 service nova] Lock "88009c57-377b-4636-ba54-1945c1bc7928-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:14:45 user nova-compute[72766]: DEBUG nova.compute.manager [req-3c31c6f1-1935-4588-b261-03ae742d2556 req-f86dc426-d710-462e-bb89-244a7523e903 service nova] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] No waiting events found dispatching network-vif-unplugged-e2f51f15-395f-4f23-b946-0da2eef80a35 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:14:45 user nova-compute[72766]: DEBUG nova.compute.manager [req-3c31c6f1-1935-4588-b261-03ae742d2556 req-f86dc426-d710-462e-bb89-244a7523e903 service nova] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Received event network-vif-unplugged-e2f51f15-395f-4f23-b946-0da2eef80a35 for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:14:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:14:46 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Instance destroyed successfully.
Aug 14 23:14:46 user nova-compute[72766]: DEBUG nova.objects.instance [None req-26ec45c3-3b4c-4e6f-82b9-97c3e156302e tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lazy-loading 'resources' on Instance uuid 88009c57-377b-4636-ba54-1945c1bc7928 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:14:46 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-26ec45c3-3b4c-4e6f-82b9-97c3e156302e tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:10:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-846513150',display_name='tempest-TestServerVolumeAttachmentScenario-server-846513150',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-846513150',id=29,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAX/APmKrGrsBogrrV45YBTtFKQrrmIRSmv0NInnv5Gc1zMcYNTFgMpDzY0RUIDZ+fYjFWMy9wJUsBWFv8ayakIu0+uEg2jeXzf2LlQCzx4kxsYhIIbU3S59akGehku0vA==',key_name='tempest-keypair-1252254229',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:10:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4877b20c8c2a4034923a341600e1d69f',ramdisk_id='',reservation_id='r-p6clntjk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-878359931',owner_user_name='tempest-TestServerVolumeAttachmentScenario-878359931-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:10:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55a41318297e40a886cd9b3a2364ea28',uuid=88009c57-377b-4636-ba54-1945c1bc7928,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2f51f15-395f-4f23-b946-0da2eef80a35", "address": "fa:16:3e:72:6d:7f", "network": {"id": "d68d40ee-41e8-4e08-a00d-fc9c322c578a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1597134173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4877b20c8c2a4034923a341600e1d69f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f51f15-39", "ovs_interfaceid": "e2f51f15-395f-4f23-b946-0da2eef80a35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:14:46 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-26ec45c3-3b4c-4e6f-82b9-97c3e156302e tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Converting VIF {"id": "e2f51f15-395f-4f23-b946-0da2eef80a35", "address": "fa:16:3e:72:6d:7f", "network": {"id": "d68d40ee-41e8-4e08-a00d-fc9c322c578a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1597134173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4877b20c8c2a4034923a341600e1d69f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2f51f15-39", "ovs_interfaceid": "e2f51f15-395f-4f23-b946-0da2eef80a35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:14:46 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-26ec45c3-3b4c-4e6f-82b9-97c3e156302e tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:6d:7f,bridge_name='br-int',has_traffic_filtering=True,id=e2f51f15-395f-4f23-b946-0da2eef80a35,network=Network(d68d40ee-41e8-4e08-a00d-fc9c322c578a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2f51f15-39') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:14:46 user nova-compute[72766]: DEBUG os_vif [None req-26ec45c3-3b4c-4e6f-82b9-97c3e156302e tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:6d:7f,bridge_name='br-int',has_traffic_filtering=True,id=e2f51f15-395f-4f23-b946-0da2eef80a35,network=Network(d68d40ee-41e8-4e08-a00d-fc9c322c578a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2f51f15-39') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:14:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:14:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2f51f15-39, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:14:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:14:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:14:46 user nova-compute[72766]: INFO os_vif [None req-26ec45c3-3b4c-4e6f-82b9-97c3e156302e tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:6d:7f,bridge_name='br-int',has_traffic_filtering=True,id=e2f51f15-395f-4f23-b946-0da2eef80a35,network=Network(d68d40ee-41e8-4e08-a00d-fc9c322c578a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2f51f15-39')
Aug 14 23:14:46 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-26ec45c3-3b4c-4e6f-82b9-97c3e156302e tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Deleting instance files /opt/stack/data/nova/instances/88009c57-377b-4636-ba54-1945c1bc7928_del
Aug 14 23:14:46 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-26ec45c3-3b4c-4e6f-82b9-97c3e156302e tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Deletion of /opt/stack/data/nova/instances/88009c57-377b-4636-ba54-1945c1bc7928_del complete
Aug 14 23:14:46 user nova-compute[72766]: INFO nova.compute.manager [None req-26ec45c3-3b4c-4e6f-82b9-97c3e156302e tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 14 23:14:46 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-26ec45c3-3b4c-4e6f-82b9-97c3e156302e tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:14:46 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:14:46 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:14:47 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:14:47 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Took 0.92 seconds to deallocate network for instance.
Aug 14 23:14:47 user nova-compute[72766]: DEBUG nova.compute.manager [req-80279e88-13a7-44d9-8960-1fa1f56a4aa5 req-428124a4-4581-4531-8d6a-937b9efef3f6 service nova] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Received event network-vif-deleted-e2f51f15-395f-4f23-b946-0da2eef80a35 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:14:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-26ec45c3-3b4c-4e6f-82b9-97c3e156302e tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:14:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-26ec45c3-3b4c-4e6f-82b9-97c3e156302e tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:14:47 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-26ec45c3-3b4c-4e6f-82b9-97c3e156302e tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:14:47 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-26ec45c3-3b4c-4e6f-82b9-97c3e156302e tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:14:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-26ec45c3-3b4c-4e6f-82b9-97c3e156302e tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.272s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:14:47 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-26ec45c3-3b4c-4e6f-82b9-97c3e156302e tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Deleted allocations for instance 88009c57-377b-4636-ba54-1945c1bc7928
Aug 14 23:14:48 user nova-compute[72766]: DEBUG nova.compute.manager [req-8f782a78-7bb1-41a8-a047-41aee99d5329 req-932d11bd-dfd0-40e7-bf58-2f1155331277 service nova] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Received event network-vif-plugged-e2f51f15-395f-4f23-b946-0da2eef80a35 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:14:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8f782a78-7bb1-41a8-a047-41aee99d5329 req-932d11bd-dfd0-40e7-bf58-2f1155331277 service nova] Acquiring lock "88009c57-377b-4636-ba54-1945c1bc7928-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:14:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8f782a78-7bb1-41a8-a047-41aee99d5329 req-932d11bd-dfd0-40e7-bf58-2f1155331277 service nova] Lock "88009c57-377b-4636-ba54-1945c1bc7928-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:14:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8f782a78-7bb1-41a8-a047-41aee99d5329 req-932d11bd-dfd0-40e7-bf58-2f1155331277 service nova] Lock "88009c57-377b-4636-ba54-1945c1bc7928-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:14:48 user nova-compute[72766]: DEBUG nova.compute.manager [req-8f782a78-7bb1-41a8-a047-41aee99d5329 req-932d11bd-dfd0-40e7-bf58-2f1155331277 service nova] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] No waiting events found dispatching network-vif-plugged-e2f51f15-395f-4f23-b946-0da2eef80a35 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:14:48 user nova-compute[72766]: WARNING nova.compute.manager [req-8f782a78-7bb1-41a8-a047-41aee99d5329 req-932d11bd-dfd0-40e7-bf58-2f1155331277 service nova] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Received unexpected event network-vif-plugged-e2f51f15-395f-4f23-b946-0da2eef80a35 for instance with vm_state deleted and task_state None.
Aug 14 23:14:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-26ec45c3-3b4c-4e6f-82b9-97c3e156302e tempest-TestServerVolumeAttachmentScenario-878359931 tempest-TestServerVolumeAttachmentScenario-878359931-project-member] Lock "88009c57-377b-4636-ba54-1945c1bc7928" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.634s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:14:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:14:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:14:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:14:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:14:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:14:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:14:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:15:01 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692054886.360659, 88009c57-377b-4636-ba54-1945c1bc7928 => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:15:01 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] VM Stopped (Lifecycle Event)
Aug 14 23:15:01 user nova-compute[72766]: DEBUG nova.compute.manager [None req-e94c198d-b355-45a4-8926-2466079c7e26 None None] [instance: 88009c57-377b-4636-ba54-1945c1bc7928] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:15:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:06 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:15:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquiring lock "34998d61-8b57-453c-a16c-5bb7a2b2c96c" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:15:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "34998d61-8b57-453c-a16c-5bb7a2b2c96c" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:15:07 user nova-compute[72766]: INFO nova.compute.manager [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Unshelving
Aug 14 23:15:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:15:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:15:07 user nova-compute[72766]: DEBUG nova.objects.instance [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lazy-loading 'pci_requests' on Instance uuid 34998d61-8b57-453c-a16c-5bb7a2b2c96c {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:15:07 user nova-compute[72766]: DEBUG nova.objects.instance [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lazy-loading 'numa_topology' on Instance uuid 34998d61-8b57-453c-a16c-5bb7a2b2c96c {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:15:07 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 23:15:07 user nova-compute[72766]: INFO nova.compute.claims [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Claim successful on node user
Aug 14 23:15:07 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:15:07 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:15:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.406s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:15:07 user nova-compute[72766]: INFO nova.network.neutron [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Updating port d75b30b8-130a-44f8-b342-28a13e78fcd1 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 14 23:15:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquiring lock "refresh_cache-34998d61-8b57-453c-a16c-5bb7a2b2c96c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:15:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquired lock "refresh_cache-34998d61-8b57-453c-a16c-5bb7a2b2c96c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:15:08 user nova-compute[72766]: DEBUG nova.network.neutron [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:15:08 user nova-compute[72766]: DEBUG nova.compute.manager [req-97abffa1-dddd-41d3-a2b1-c0d9fa43d45c req-fedd9034-73af-4379-a09e-0a07fa2158b5 service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Received event network-changed-d75b30b8-130a-44f8-b342-28a13e78fcd1 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:15:08 user nova-compute[72766]: DEBUG nova.compute.manager [req-97abffa1-dddd-41d3-a2b1-c0d9fa43d45c req-fedd9034-73af-4379-a09e-0a07fa2158b5 service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Refreshing instance network info cache due to event network-changed-d75b30b8-130a-44f8-b342-28a13e78fcd1. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:15:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-97abffa1-dddd-41d3-a2b1-c0d9fa43d45c req-fedd9034-73af-4379-a09e-0a07fa2158b5 service nova] Acquiring lock "refresh_cache-34998d61-8b57-453c-a16c-5bb7a2b2c96c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:15:08 user nova-compute[72766]: DEBUG nova.network.neutron [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Updating instance_info_cache with network_info: [{"id": "d75b30b8-130a-44f8-b342-28a13e78fcd1", "address": "fa:16:3e:b3:d6:8a", "network": {"id": "ed86b27c-3e64-4c0a-8824-9bf68068058a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-506861998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f36bd126bda43c6971bccdef2b1da91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd75b30b8-13", "ovs_interfaceid": "d75b30b8-130a-44f8-b342-28a13e78fcd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:15:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Releasing lock "refresh_cache-34998d61-8b57-453c-a16c-5bb7a2b2c96c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:15:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 23:15:08 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Creating image(s)
Aug 14 23:15:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquiring lock "/opt/stack/data/nova/instances/34998d61-8b57-453c-a16c-5bb7a2b2c96c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:15:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "/opt/stack/data/nova/instances/34998d61-8b57-453c-a16c-5bb7a2b2c96c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:15:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "/opt/stack/data/nova/instances/34998d61-8b57-453c-a16c-5bb7a2b2c96c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:15:08 user nova-compute[72766]: DEBUG nova.objects.instance [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lazy-loading 'trusted_certs' on Instance uuid 34998d61-8b57-453c-a16c-5bb7a2b2c96c {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:15:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-97abffa1-dddd-41d3-a2b1-c0d9fa43d45c req-fedd9034-73af-4379-a09e-0a07fa2158b5 service nova] Acquired lock "refresh_cache-34998d61-8b57-453c-a16c-5bb7a2b2c96c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:15:08 user nova-compute[72766]: DEBUG nova.network.neutron [req-97abffa1-dddd-41d3-a2b1-c0d9fa43d45c req-fedd9034-73af-4379-a09e-0a07fa2158b5 service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Refreshing network info cache for port d75b30b8-130a-44f8-b342-28a13e78fcd1 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:15:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquiring lock "b2a3b78714e4106c70ce176722cdc74f1d77dcc7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:15:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "b2a3b78714e4106c70ce176722cdc74f1d77dcc7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:15:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2a3b78714e4106c70ce176722cdc74f1d77dcc7.part --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2a3b78714e4106c70ce176722cdc74f1d77dcc7.part --force-share --output=json" returned: 0 in 0.176s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:10 user nova-compute[72766]: DEBUG nova.virt.images [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] 56d0796d-81d0-4dd4-b6ff-221b8452e7cd was qcow2, converting to raw {{(pid=72766) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 23:15:10 user nova-compute[72766]: DEBUG nova.privsep.utils [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72766) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 23:15:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b2a3b78714e4106c70ce176722cdc74f1d77dcc7.part /opt/stack/data/nova/instances/_base/b2a3b78714e4106c70ce176722cdc74f1d77dcc7.converted {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b2a3b78714e4106c70ce176722cdc74f1d77dcc7.part /opt/stack/data/nova/instances/_base/b2a3b78714e4106c70ce176722cdc74f1d77dcc7.converted" returned: 0 in 0.210s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2a3b78714e4106c70ce176722cdc74f1d77dcc7.converted --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2a3b78714e4106c70ce176722cdc74f1d77dcc7.converted --force-share --output=json" returned: 0 in 0.172s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "b2a3b78714e4106c70ce176722cdc74f1d77dcc7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.740s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:15:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2a3b78714e4106c70ce176722cdc74f1d77dcc7 --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:10 user nova-compute[72766]: DEBUG nova.network.neutron [req-97abffa1-dddd-41d3-a2b1-c0d9fa43d45c req-fedd9034-73af-4379-a09e-0a07fa2158b5 service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Updated VIF entry in instance network info cache for port d75b30b8-130a-44f8-b342-28a13e78fcd1. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:15:10 user nova-compute[72766]: DEBUG nova.network.neutron [req-97abffa1-dddd-41d3-a2b1-c0d9fa43d45c req-fedd9034-73af-4379-a09e-0a07fa2158b5 service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Updating instance_info_cache with network_info: [{"id": "d75b30b8-130a-44f8-b342-28a13e78fcd1", "address": "fa:16:3e:b3:d6:8a", "network": {"id": "ed86b27c-3e64-4c0a-8824-9bf68068058a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-506861998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f36bd126bda43c6971bccdef2b1da91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd75b30b8-13", "ovs_interfaceid": "d75b30b8-130a-44f8-b342-28a13e78fcd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:15:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-97abffa1-dddd-41d3-a2b1-c0d9fa43d45c req-fedd9034-73af-4379-a09e-0a07fa2158b5 service nova] Releasing lock "refresh_cache-34998d61-8b57-453c-a16c-5bb7a2b2c96c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:15:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2a3b78714e4106c70ce176722cdc74f1d77dcc7 --force-share --output=json" returned: 0 in 0.176s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquiring lock "b2a3b78714e4106c70ce176722cdc74f1d77dcc7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:15:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "b2a3b78714e4106c70ce176722cdc74f1d77dcc7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:15:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2a3b78714e4106c70ce176722cdc74f1d77dcc7 --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2a3b78714e4106c70ce176722cdc74f1d77dcc7 --force-share --output=json" returned: 0 in 0.175s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b2a3b78714e4106c70ce176722cdc74f1d77dcc7,backing_fmt=raw /opt/stack/data/nova/instances/34998d61-8b57-453c-a16c-5bb7a2b2c96c/disk 1073741824 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b2a3b78714e4106c70ce176722cdc74f1d77dcc7,backing_fmt=raw /opt/stack/data/nova/instances/34998d61-8b57-453c-a16c-5bb7a2b2c96c/disk 1073741824" returned: 0 in 0.048s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "b2a3b78714e4106c70ce176722cdc74f1d77dcc7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:15:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2a3b78714e4106c70ce176722cdc74f1d77dcc7 --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2a3b78714e4106c70ce176722cdc74f1d77dcc7 --force-share --output=json" returned: 0 in 0.169s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:11 user nova-compute[72766]: DEBUG nova.objects.instance [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lazy-loading 'migration_context' on Instance uuid 34998d61-8b57-453c-a16c-5bb7a2b2c96c {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:15:11 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Rebasing disk image.
Aug 14 23:15:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.173s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb -F raw /opt/stack/data/nova/instances/34998d61-8b57-453c-a16c-5bb7a2b2c96c/disk {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb -F raw /opt/stack/data/nova/instances/34998d61-8b57-453c-a16c-5bb7a2b2c96c/disk" returned: 0 in 2.044s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:13 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 23:15:13 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Ensure instance console log exists: /opt/stack/data/nova/instances/34998d61-8b57-453c-a16c-5bb7a2b2c96c/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 23:15:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:15:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:15:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:15:13 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Start _get_guest_xml network_info=[{"id": "d75b30b8-130a-44f8-b342-28a13e78fcd1", "address": "fa:16:3e:b3:d6:8a", "network": {"id": "ed86b27c-3e64-4c0a-8824-9bf68068058a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-506861998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f36bd126bda43c6971bccdef2b1da91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd75b30b8-13", "ovs_interfaceid": "d75b30b8-130a-44f8-b342-28a13e78fcd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='0351f4052846a930265bd726d332760d',container_format='bare',created_at=2023-08-14T23:13:15Z,direct_url=<?>,disk_format='qcow2',id=56d0796d-81d0-4dd4-b6ff-221b8452e7cd,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-573188518-shelved',owner='3f36bd126bda43c6971bccdef2b1da91',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-14T23:13:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd2900d30-2c4c-4d57-9135-d45564c0c596'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:15:13 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:15:13 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:15:13 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:15:13 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:15:13 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:15:13 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:15:13 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:15:13 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0351f4052846a930265bd726d332760d',container_format='bare',created_at=2023-08-14T23:13:15Z,direct_url=<?>,disk_format='qcow2',id=56d0796d-81d0-4dd4-b6ff-221b8452e7cd,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-573188518-shelved',owner='3f36bd126bda43c6971bccdef2b1da91',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-14T23:13:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:15:13 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:15:13 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:15:13 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:15:13 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:15:13 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:15:13 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:15:13 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:15:13 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:15:13 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:15:13 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:15:13 user nova-compute[72766]: DEBUG nova.objects.instance [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lazy-loading 'vcpu_model' on Instance uuid 34998d61-8b57-453c-a16c-5bb7a2b2c96c {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:15:13 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T23:11:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-573188518',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-573188518',id=30,image_ref='56d0796d-81d0-4dd4-b6ff-221b8452e7cd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2040959384',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:11:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3f36bd126bda43c6971bccdef2b1da91',ramdisk_id='',reservation_id='r-wzdhb2yu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1828708750',owner_user_name='tempest-AttachVolumeShelveTestJSON-1828708750-project-member',shelved_at='2023-08-14T23:13:18.678459',shelved_host='user',shelved_image_id='56d0796d-81d0-4dd4-b6ff-221b8452e7cd'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:15:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb167893135e4073928a60630ae7720c',uuid=34998d61-8b57-453c-a16c-5bb7a2b2c96c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d75b30b8-130a-44f8-b342-28a13e78fcd1", "address": "fa:16:3e:b3:d6:8a", "network": {"id": "ed86b27c-3e64-4c0a-8824-9bf68068058a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-506861998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f36bd126bda43c6971bccdef2b1da91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd75b30b8-13", "ovs_interfaceid": "d75b30b8-130a-44f8-b342-28a13e78fcd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:15:13 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Converting VIF {"id": "d75b30b8-130a-44f8-b342-28a13e78fcd1", "address": "fa:16:3e:b3:d6:8a", "network": {"id": "ed86b27c-3e64-4c0a-8824-9bf68068058a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-506861998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f36bd126bda43c6971bccdef2b1da91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd75b30b8-13", "ovs_interfaceid": "d75b30b8-130a-44f8-b342-28a13e78fcd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:15:13 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:d6:8a,bridge_name='br-int',has_traffic_filtering=True,id=d75b30b8-130a-44f8-b342-28a13e78fcd1,network=Network(ed86b27c-3e64-4c0a-8824-9bf68068058a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd75b30b8-13') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:15:13 user nova-compute[72766]: DEBUG nova.objects.instance [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lazy-loading 'pci_devices' on Instance uuid 34998d61-8b57-453c-a16c-5bb7a2b2c96c {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:15:13 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:15:13 user nova-compute[72766]:   <uuid>34998d61-8b57-453c-a16c-5bb7a2b2c96c</uuid>
Aug 14 23:15:13 user nova-compute[72766]:   <name>instance-0000001e</name>
Aug 14 23:15:13 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:15:13 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:15:13 user nova-compute[72766]:   <metadata>
Aug 14 23:15:13 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:15:13 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:15:13 user nova-compute[72766]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-573188518</nova:name>
Aug 14 23:15:13 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:15:13</nova:creationTime>
Aug 14 23:15:13 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:15:13 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:15:13 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:15:13 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:15:13 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:15:13 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:15:13 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:15:13 user nova-compute[72766]:       <nova:owner>
Aug 14 23:15:13 user nova-compute[72766]:         <nova:user uuid="fb167893135e4073928a60630ae7720c">tempest-AttachVolumeShelveTestJSON-1828708750-project-member</nova:user>
Aug 14 23:15:13 user nova-compute[72766]:         <nova:project uuid="3f36bd126bda43c6971bccdef2b1da91">tempest-AttachVolumeShelveTestJSON-1828708750</nova:project>
Aug 14 23:15:13 user nova-compute[72766]:       </nova:owner>
Aug 14 23:15:13 user nova-compute[72766]:       <nova:root type="image" uuid="56d0796d-81d0-4dd4-b6ff-221b8452e7cd"/>
Aug 14 23:15:13 user nova-compute[72766]:       <nova:ports>
Aug 14 23:15:13 user nova-compute[72766]:         <nova:port uuid="d75b30b8-130a-44f8-b342-28a13e78fcd1">
Aug 14 23:15:13 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 23:15:13 user nova-compute[72766]:         </nova:port>
Aug 14 23:15:13 user nova-compute[72766]:       </nova:ports>
Aug 14 23:15:13 user nova-compute[72766]:     </nova:instance>
Aug 14 23:15:13 user nova-compute[72766]:   </metadata>
Aug 14 23:15:13 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:15:13 user nova-compute[72766]:     <system>
Aug 14 23:15:13 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:15:13 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:15:13 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:15:13 user nova-compute[72766]:       <entry name="serial">34998d61-8b57-453c-a16c-5bb7a2b2c96c</entry>
Aug 14 23:15:13 user nova-compute[72766]:       <entry name="uuid">34998d61-8b57-453c-a16c-5bb7a2b2c96c</entry>
Aug 14 23:15:13 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:15:13 user nova-compute[72766]:     </system>
Aug 14 23:15:13 user nova-compute[72766]:   </sysinfo>
Aug 14 23:15:13 user nova-compute[72766]:   <os>
Aug 14 23:15:13 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:15:13 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:15:13 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:15:13 user nova-compute[72766]:   </os>
Aug 14 23:15:13 user nova-compute[72766]:   <features>
Aug 14 23:15:13 user nova-compute[72766]:     <acpi/>
Aug 14 23:15:13 user nova-compute[72766]:     <apic/>
Aug 14 23:15:13 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:15:13 user nova-compute[72766]:   </features>
Aug 14 23:15:13 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:15:13 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:15:13 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:15:13 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:15:13 user nova-compute[72766]:   </clock>
Aug 14 23:15:13 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:15:13 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:15:13 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:15:13 user nova-compute[72766]:   </cpu>
Aug 14 23:15:13 user nova-compute[72766]:   <devices>
Aug 14 23:15:13 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 23:15:13 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 23:15:13 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/34998d61-8b57-453c-a16c-5bb7a2b2c96c/disk"/>
Aug 14 23:15:13 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:15:13 user nova-compute[72766]:     </disk>
Aug 14 23:15:13 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:15:13 user nova-compute[72766]:       <mac address="fa:16:3e:b3:d6:8a"/>
Aug 14 23:15:13 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:15:13 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:15:13 user nova-compute[72766]:       <target dev="tapd75b30b8-13"/>
Aug 14 23:15:13 user nova-compute[72766]:     </interface>
Aug 14 23:15:13 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:15:13 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/34998d61-8b57-453c-a16c-5bb7a2b2c96c/console.log" append="off"/>
Aug 14 23:15:13 user nova-compute[72766]:     </serial>
Aug 14 23:15:13 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:15:13 user nova-compute[72766]:     <video>
Aug 14 23:15:13 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:15:13 user nova-compute[72766]:     </video>
Aug 14 23:15:13 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:15:13 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:15:13 user nova-compute[72766]:     </rng>
Aug 14 23:15:13 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:15:13 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:15:13 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:15:13 user nova-compute[72766]:     </memballoon>
Aug 14 23:15:13 user nova-compute[72766]:   </devices>
Aug 14 23:15:13 user nova-compute[72766]: </domain>
Aug 14 23:15:13 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:15:13 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T23:11:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-573188518',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-573188518',id=30,image_ref='56d0796d-81d0-4dd4-b6ff-221b8452e7cd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2040959384',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:11:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3f36bd126bda43c6971bccdef2b1da91',ramdisk_id='',reservation_id='r-wzdhb2yu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1828708750',owner_user_name='tempest-AttachVolumeShelveTestJSON-1828708750-project-member',shelved_at='2023-08-14T23:13:18.678459',shelved_host='user',shelved_image_id='56d0796d-81d0-4dd4-b6ff-221b8452e7cd'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:15:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb167893135e4073928a60630ae7720c',uuid=34998d61-8b57-453c-a16c-5bb7a2b2c96c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d75b30b8-130a-44f8-b342-28a13e78fcd1", "address": "fa:16:3e:b3:d6:8a", "network": {"id": "ed86b27c-3e64-4c0a-8824-9bf68068058a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-506861998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f36bd126bda43c6971bccdef2b1da91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd75b30b8-13", "ovs_interfaceid": "d75b30b8-130a-44f8-b342-28a13e78fcd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:15:13 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Converting VIF {"id": "d75b30b8-130a-44f8-b342-28a13e78fcd1", "address": "fa:16:3e:b3:d6:8a", "network": {"id": "ed86b27c-3e64-4c0a-8824-9bf68068058a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-506861998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f36bd126bda43c6971bccdef2b1da91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd75b30b8-13", "ovs_interfaceid": "d75b30b8-130a-44f8-b342-28a13e78fcd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:15:13 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:d6:8a,bridge_name='br-int',has_traffic_filtering=True,id=d75b30b8-130a-44f8-b342-28a13e78fcd1,network=Network(ed86b27c-3e64-4c0a-8824-9bf68068058a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd75b30b8-13') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:15:13 user nova-compute[72766]: DEBUG os_vif [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:d6:8a,bridge_name='br-int',has_traffic_filtering=True,id=d75b30b8-130a-44f8-b342-28a13e78fcd1,network=Network(ed86b27c-3e64-4c0a-8824-9bf68068058a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd75b30b8-13') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:15:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:15:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:15:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd75b30b8-13, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:15:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd75b30b8-13, col_values=(('external_ids', {'iface-id': 'd75b30b8-130a-44f8-b342-28a13e78fcd1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:d6:8a', 'vm-uuid': '34998d61-8b57-453c-a16c-5bb7a2b2c96c'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:15:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:15:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:13 user nova-compute[72766]: INFO os_vif [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:d6:8a,bridge_name='br-int',has_traffic_filtering=True,id=d75b30b8-130a-44f8-b342-28a13e78fcd1,network=Network(ed86b27c-3e64-4c0a-8824-9bf68068058a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd75b30b8-13')
Aug 14 23:15:13 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:15:13 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] No VIF found with MAC fa:16:3e:b3:d6:8a, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:15:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:15 user nova-compute[72766]: DEBUG nova.compute.manager [req-fe52f690-8cd2-45e7-ab29-6469740c7a09 req-479fd242-da65-4638-b143-1aa2a44c8e01 service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Received event network-vif-plugged-d75b30b8-130a-44f8-b342-28a13e78fcd1 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:15:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-fe52f690-8cd2-45e7-ab29-6469740c7a09 req-479fd242-da65-4638-b143-1aa2a44c8e01 service nova] Acquiring lock "34998d61-8b57-453c-a16c-5bb7a2b2c96c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:15:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-fe52f690-8cd2-45e7-ab29-6469740c7a09 req-479fd242-da65-4638-b143-1aa2a44c8e01 service nova] Lock "34998d61-8b57-453c-a16c-5bb7a2b2c96c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:15:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-fe52f690-8cd2-45e7-ab29-6469740c7a09 req-479fd242-da65-4638-b143-1aa2a44c8e01 service nova] Lock "34998d61-8b57-453c-a16c-5bb7a2b2c96c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:15:15 user nova-compute[72766]: DEBUG nova.compute.manager [req-fe52f690-8cd2-45e7-ab29-6469740c7a09 req-479fd242-da65-4638-b143-1aa2a44c8e01 service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] No waiting events found dispatching network-vif-plugged-d75b30b8-130a-44f8-b342-28a13e78fcd1 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:15:15 user nova-compute[72766]: WARNING nova.compute.manager [req-fe52f690-8cd2-45e7-ab29-6469740c7a09 req-479fd242-da65-4638-b143-1aa2a44c8e01 service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Received unexpected event network-vif-plugged-d75b30b8-130a-44f8-b342-28a13e78fcd1 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 14 23:15:15 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:15 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:17 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054917.1062794, 34998d61-8b57-453c-a16c-5bb7a2b2c96c => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:15:17 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] VM Resumed (Lifecycle Event)
Aug 14 23:15:17 user nova-compute[72766]: DEBUG nova.compute.manager [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:15:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 23:15:17 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Instance spawned successfully.
Aug 14 23:15:17 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:15:17 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:15:17 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:15:17 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054917.1068192, 34998d61-8b57-453c-a16c-5bb7a2b2c96c => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:15:17 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] VM Started (Lifecycle Event)
Aug 14 23:15:17 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:15:17 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:15:17 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:15:17 user nova-compute[72766]: DEBUG nova.compute.manager [req-d2e35c1b-ab66-4ce8-99cb-73e92798d1cd req-830dad31-c3b4-4f4a-ac1c-cbf13d4bc0e7 service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Received event network-vif-plugged-d75b30b8-130a-44f8-b342-28a13e78fcd1 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:15:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d2e35c1b-ab66-4ce8-99cb-73e92798d1cd req-830dad31-c3b4-4f4a-ac1c-cbf13d4bc0e7 service nova] Acquiring lock "34998d61-8b57-453c-a16c-5bb7a2b2c96c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:15:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d2e35c1b-ab66-4ce8-99cb-73e92798d1cd req-830dad31-c3b4-4f4a-ac1c-cbf13d4bc0e7 service nova] Lock "34998d61-8b57-453c-a16c-5bb7a2b2c96c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:15:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d2e35c1b-ab66-4ce8-99cb-73e92798d1cd req-830dad31-c3b4-4f4a-ac1c-cbf13d4bc0e7 service nova] Lock "34998d61-8b57-453c-a16c-5bb7a2b2c96c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:15:17 user nova-compute[72766]: DEBUG nova.compute.manager [req-d2e35c1b-ab66-4ce8-99cb-73e92798d1cd req-830dad31-c3b4-4f4a-ac1c-cbf13d4bc0e7 service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] No waiting events found dispatching network-vif-plugged-d75b30b8-130a-44f8-b342-28a13e78fcd1 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:15:17 user nova-compute[72766]: WARNING nova.compute.manager [req-d2e35c1b-ab66-4ce8-99cb-73e92798d1cd req-830dad31-c3b4-4f4a-ac1c-cbf13d4bc0e7 service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Received unexpected event network-vif-plugged-d75b30b8-130a-44f8-b342-28a13e78fcd1 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 14 23:15:17 user nova-compute[72766]: DEBUG nova.compute.manager [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:15:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5ca30f1d-6adf-4535-9b9a-465235130aa9 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "34998d61-8b57-453c-a16c-5bb7a2b2c96c" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.259s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:15:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:27 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:15:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:15:29 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:15:30 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:15:30 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:15:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:15:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:15:30 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:15:30 user nova-compute[72766]: INFO nova.compute.manager [None req-48b52bdd-aada-4fdf-b147-e29e8eec2998 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Unrescuing
Aug 14 23:15:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-48b52bdd-aada-4fdf-b147-e29e8eec2998 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "refresh_cache-901fe741-3b2f-472e-b91c-a90c9d4a9c39" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:15:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-48b52bdd-aada-4fdf-b147-e29e8eec2998 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquired lock "refresh_cache-901fe741-3b2f-472e-b91c-a90c9d4a9c39" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:15:30 user nova-compute[72766]: DEBUG nova.network.neutron [None req-48b52bdd-aada-4fdf-b147-e29e8eec2998 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:15:31 user nova-compute[72766]: DEBUG nova.network.neutron [None req-48b52bdd-aada-4fdf-b147-e29e8eec2998 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Updating instance_info_cache with network_info: [{"id": "f2f08b69-eb49-4a38-9357-36420ee797d6", "address": "fa:16:3e:44:c6:dd", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f08b69-eb", "ovs_interfaceid": "f2f08b69-eb49-4a38-9357-36420ee797d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:15:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-48b52bdd-aada-4fdf-b147-e29e8eec2998 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Releasing lock "refresh_cache-901fe741-3b2f-472e-b91c-a90c9d4a9c39" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:15:31 user nova-compute[72766]: DEBUG nova.objects.instance [None req-48b52bdd-aada-4fdf-b147-e29e8eec2998 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lazy-loading 'flavor' on Instance uuid 901fe741-3b2f-472e-b91c-a90c9d4a9c39 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:15:31 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Updating instance_info_cache with network_info: [{"id": "0df45a26-6026-4baa-bdaa-a761d2d3c2a6", "address": "fa:16:3e:89:96:a5", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0df45a26-60", "ovs_interfaceid": "0df45a26-6026-4baa-bdaa-a761d2d3c2a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:15:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:15:31 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:15:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:31 user nova-compute[72766]: DEBUG nova.compute.manager [req-d3277a2b-64f2-4cfa-a68d-6a40d4f412c2 req-36e7a4f1-ead4-430a-a4e6-18071b8f8b27 service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Received event network-vif-unplugged-f2f08b69-eb49-4a38-9357-36420ee797d6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:15:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d3277a2b-64f2-4cfa-a68d-6a40d4f412c2 req-36e7a4f1-ead4-430a-a4e6-18071b8f8b27 service nova] Acquiring lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:15:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d3277a2b-64f2-4cfa-a68d-6a40d4f412c2 req-36e7a4f1-ead4-430a-a4e6-18071b8f8b27 service nova] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:15:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d3277a2b-64f2-4cfa-a68d-6a40d4f412c2 req-36e7a4f1-ead4-430a-a4e6-18071b8f8b27 service nova] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:15:31 user nova-compute[72766]: DEBUG nova.compute.manager [req-d3277a2b-64f2-4cfa-a68d-6a40d4f412c2 req-36e7a4f1-ead4-430a-a4e6-18071b8f8b27 service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] No waiting events found dispatching network-vif-unplugged-f2f08b69-eb49-4a38-9357-36420ee797d6 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:15:31 user nova-compute[72766]: WARNING nova.compute.manager [req-d3277a2b-64f2-4cfa-a68d-6a40d4f412c2 req-36e7a4f1-ead4-430a-a4e6-18071b8f8b27 service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Received unexpected event network-vif-unplugged-f2f08b69-eb49-4a38-9357-36420ee797d6 for instance with vm_state rescued and task_state unrescuing.
Aug 14 23:15:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:31 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:15:31 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:15:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:15:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:15:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:15:31 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:15:32 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:32 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:32 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:32 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:32 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Instance destroyed successfully.
Aug 14 23:15:32 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:32 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:32 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:32 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:32 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:32 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-7e51fdca-2625-4a9e-9771-5cf2126e7e00 req-9c9cca3e-c083-47d6-b16d-085830811e0b service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Received event network-vif-plugged-f2f08b69-eb49-4a38-9357-36420ee797d6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:15:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7e51fdca-2625-4a9e-9771-5cf2126e7e00 req-9c9cca3e-c083-47d6-b16d-085830811e0b service nova] Acquiring lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:15:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7e51fdca-2625-4a9e-9771-5cf2126e7e00 req-9c9cca3e-c083-47d6-b16d-085830811e0b service nova] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:15:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7e51fdca-2625-4a9e-9771-5cf2126e7e00 req-9c9cca3e-c083-47d6-b16d-085830811e0b service nova] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:15:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-7e51fdca-2625-4a9e-9771-5cf2126e7e00 req-9c9cca3e-c083-47d6-b16d-085830811e0b service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] No waiting events found dispatching network-vif-plugged-f2f08b69-eb49-4a38-9357-36420ee797d6 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:15:33 user nova-compute[72766]: WARNING nova.compute.manager [req-7e51fdca-2625-4a9e-9771-5cf2126e7e00 req-9c9cca3e-c083-47d6-b16d-085830811e0b service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Received unexpected event network-vif-plugged-f2f08b69-eb49-4a38-9357-36420ee797d6 for instance with vm_state rescued and task_state unrescuing.
Aug 14 23:15:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-7e51fdca-2625-4a9e-9771-5cf2126e7e00 req-9c9cca3e-c083-47d6-b16d-085830811e0b service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Received event network-vif-plugged-f2f08b69-eb49-4a38-9357-36420ee797d6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:15:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7e51fdca-2625-4a9e-9771-5cf2126e7e00 req-9c9cca3e-c083-47d6-b16d-085830811e0b service nova] Acquiring lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:15:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7e51fdca-2625-4a9e-9771-5cf2126e7e00 req-9c9cca3e-c083-47d6-b16d-085830811e0b service nova] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:15:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7e51fdca-2625-4a9e-9771-5cf2126e7e00 req-9c9cca3e-c083-47d6-b16d-085830811e0b service nova] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:15:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-7e51fdca-2625-4a9e-9771-5cf2126e7e00 req-9c9cca3e-c083-47d6-b16d-085830811e0b service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] No waiting events found dispatching network-vif-plugged-f2f08b69-eb49-4a38-9357-36420ee797d6 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:15:33 user nova-compute[72766]: WARNING nova.compute.manager [req-7e51fdca-2625-4a9e-9771-5cf2126e7e00 req-9c9cca3e-c083-47d6-b16d-085830811e0b service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Received unexpected event network-vif-plugged-f2f08b69-eb49-4a38-9357-36420ee797d6 for instance with vm_state rescued and task_state unrescuing.
Aug 14 23:15:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-7e51fdca-2625-4a9e-9771-5cf2126e7e00 req-9c9cca3e-c083-47d6-b16d-085830811e0b service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Received event network-vif-plugged-f2f08b69-eb49-4a38-9357-36420ee797d6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:15:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7e51fdca-2625-4a9e-9771-5cf2126e7e00 req-9c9cca3e-c083-47d6-b16d-085830811e0b service nova] Acquiring lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:15:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7e51fdca-2625-4a9e-9771-5cf2126e7e00 req-9c9cca3e-c083-47d6-b16d-085830811e0b service nova] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:15:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7e51fdca-2625-4a9e-9771-5cf2126e7e00 req-9c9cca3e-c083-47d6-b16d-085830811e0b service nova] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:15:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-7e51fdca-2625-4a9e-9771-5cf2126e7e00 req-9c9cca3e-c083-47d6-b16d-085830811e0b service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] No waiting events found dispatching network-vif-plugged-f2f08b69-eb49-4a38-9357-36420ee797d6 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:15:33 user nova-compute[72766]: WARNING nova.compute.manager [req-7e51fdca-2625-4a9e-9771-5cf2126e7e00 req-9c9cca3e-c083-47d6-b16d-085830811e0b service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Received unexpected event network-vif-plugged-f2f08b69-eb49-4a38-9357-36420ee797d6 for instance with vm_state rescued and task_state unrescuing.
Aug 14 23:15:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-7e51fdca-2625-4a9e-9771-5cf2126e7e00 req-9c9cca3e-c083-47d6-b16d-085830811e0b service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Received event network-vif-unplugged-f2f08b69-eb49-4a38-9357-36420ee797d6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:15:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7e51fdca-2625-4a9e-9771-5cf2126e7e00 req-9c9cca3e-c083-47d6-b16d-085830811e0b service nova] Acquiring lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:15:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7e51fdca-2625-4a9e-9771-5cf2126e7e00 req-9c9cca3e-c083-47d6-b16d-085830811e0b service nova] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:15:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7e51fdca-2625-4a9e-9771-5cf2126e7e00 req-9c9cca3e-c083-47d6-b16d-085830811e0b service nova] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:15:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-7e51fdca-2625-4a9e-9771-5cf2126e7e00 req-9c9cca3e-c083-47d6-b16d-085830811e0b service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] No waiting events found dispatching network-vif-unplugged-f2f08b69-eb49-4a38-9357-36420ee797d6 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:15:33 user nova-compute[72766]: WARNING nova.compute.manager [req-7e51fdca-2625-4a9e-9771-5cf2126e7e00 req-9c9cca3e-c083-47d6-b16d-085830811e0b service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Received unexpected event network-vif-unplugged-f2f08b69-eb49-4a38-9357-36420ee797d6 for instance with vm_state rescued and task_state unrescuing.
Aug 14 23:15:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-7e51fdca-2625-4a9e-9771-5cf2126e7e00 req-9c9cca3e-c083-47d6-b16d-085830811e0b service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Received event network-vif-plugged-f2f08b69-eb49-4a38-9357-36420ee797d6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:15:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7e51fdca-2625-4a9e-9771-5cf2126e7e00 req-9c9cca3e-c083-47d6-b16d-085830811e0b service nova] Acquiring lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:15:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7e51fdca-2625-4a9e-9771-5cf2126e7e00 req-9c9cca3e-c083-47d6-b16d-085830811e0b service nova] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:15:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7e51fdca-2625-4a9e-9771-5cf2126e7e00 req-9c9cca3e-c083-47d6-b16d-085830811e0b service nova] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:15:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-7e51fdca-2625-4a9e-9771-5cf2126e7e00 req-9c9cca3e-c083-47d6-b16d-085830811e0b service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] No waiting events found dispatching network-vif-plugged-f2f08b69-eb49-4a38-9357-36420ee797d6 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:15:33 user nova-compute[72766]: WARNING nova.compute.manager [req-7e51fdca-2625-4a9e-9771-5cf2126e7e00 req-9c9cca3e-c083-47d6-b16d-085830811e0b service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Received unexpected event network-vif-plugged-f2f08b69-eb49-4a38-9357-36420ee797d6 for instance with vm_state rescued and task_state unrescuing.
Aug 14 23:15:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-7e51fdca-2625-4a9e-9771-5cf2126e7e00 req-9c9cca3e-c083-47d6-b16d-085830811e0b service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Received event network-vif-plugged-f2f08b69-eb49-4a38-9357-36420ee797d6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:15:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7e51fdca-2625-4a9e-9771-5cf2126e7e00 req-9c9cca3e-c083-47d6-b16d-085830811e0b service nova] Acquiring lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:15:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7e51fdca-2625-4a9e-9771-5cf2126e7e00 req-9c9cca3e-c083-47d6-b16d-085830811e0b service nova] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:15:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7e51fdca-2625-4a9e-9771-5cf2126e7e00 req-9c9cca3e-c083-47d6-b16d-085830811e0b service nova] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:15:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-7e51fdca-2625-4a9e-9771-5cf2126e7e00 req-9c9cca3e-c083-47d6-b16d-085830811e0b service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] No waiting events found dispatching network-vif-plugged-f2f08b69-eb49-4a38-9357-36420ee797d6 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:15:33 user nova-compute[72766]: WARNING nova.compute.manager [req-7e51fdca-2625-4a9e-9771-5cf2126e7e00 req-9c9cca3e-c083-47d6-b16d-085830811e0b service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Received unexpected event network-vif-plugged-f2f08b69-eb49-4a38-9357-36420ee797d6 for instance with vm_state rescued and task_state unrescuing.
Aug 14 23:15:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:15:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:15:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c45186c1-193e-4d52-a09b-aa8d18195c8e/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c45186c1-193e-4d52-a09b-aa8d18195c8e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c45186c1-193e-4d52-a09b-aa8d18195c8e/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:34 user nova-compute[72766]: DEBUG nova.compute.manager [req-2662c305-c683-4173-a72d-473a209f23b5 req-63f62c14-2f94-41bd-880e-1ea4d5eefc85 service nova] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Received event network-changed-32417a5a-a445-4b76-b308-0d3b5180ac94 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:15:34 user nova-compute[72766]: DEBUG nova.compute.manager [req-2662c305-c683-4173-a72d-473a209f23b5 req-63f62c14-2f94-41bd-880e-1ea4d5eefc85 service nova] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Refreshing instance network info cache due to event network-changed-32417a5a-a445-4b76-b308-0d3b5180ac94. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:15:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2662c305-c683-4173-a72d-473a209f23b5 req-63f62c14-2f94-41bd-880e-1ea4d5eefc85 service nova] Acquiring lock "refresh_cache-c45186c1-193e-4d52-a09b-aa8d18195c8e" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:15:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2662c305-c683-4173-a72d-473a209f23b5 req-63f62c14-2f94-41bd-880e-1ea4d5eefc85 service nova] Acquired lock "refresh_cache-c45186c1-193e-4d52-a09b-aa8d18195c8e" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:15:34 user nova-compute[72766]: DEBUG nova.network.neutron [req-2662c305-c683-4173-a72d-473a209f23b5 req-63f62c14-2f94-41bd-880e-1ea4d5eefc85 service nova] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Refreshing network info cache for port 32417a5a-a445-4b76-b308-0d3b5180ac94 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:15:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c45186c1-193e-4d52-a09b-aa8d18195c8e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Acquiring lock "c45186c1-193e-4d52-a09b-aa8d18195c8e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:15:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "c45186c1-193e-4d52-a09b-aa8d18195c8e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:15:34 user nova-compute[72766]: DEBUG nova.objects.instance [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lazy-loading 'flavor' on Instance uuid c45186c1-193e-4d52-a09b-aa8d18195c8e {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:15:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "c45186c1-193e-4d52-a09b-aa8d18195c8e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:15:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:34 user nova-compute[72766]: DEBUG nova.network.neutron [req-2662c305-c683-4173-a72d-473a209f23b5 req-63f62c14-2f94-41bd-880e-1ea4d5eefc85 service nova] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Updated VIF entry in instance network info cache for port 32417a5a-a445-4b76-b308-0d3b5180ac94. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:15:34 user nova-compute[72766]: DEBUG nova.network.neutron [req-2662c305-c683-4173-a72d-473a209f23b5 req-63f62c14-2f94-41bd-880e-1ea4d5eefc85 service nova] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Updating instance_info_cache with network_info: [{"id": "32417a5a-a445-4b76-b308-0d3b5180ac94", "address": "fa:16:3e:ee:f9:d5", "network": {"id": "52ed808b-c840-47a7-aa8f-8055fd7bd1ef", "bridge": "br-int", "label": "tempest-TestStampPattern-1964150399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2329e260514d818d5af10aeeda498d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32417a5a-a4", "ovs_interfaceid": "32417a5a-a445-4b76-b308-0d3b5180ac94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:15:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2662c305-c683-4173-a72d-473a209f23b5 req-63f62c14-2f94-41bd-880e-1ea4d5eefc85 service nova] Releasing lock "refresh_cache-c45186c1-193e-4d52-a09b-aa8d18195c8e" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:15:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Acquiring lock "c45186c1-193e-4d52-a09b-aa8d18195c8e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:15:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "c45186c1-193e-4d52-a09b-aa8d18195c8e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:15:34 user nova-compute[72766]: INFO nova.compute.manager [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Attaching volume d661ff3a-ed2e-446b-a44c-1467f27ab2ac to /dev/vdb
Aug 14 23:15:34 user nova-compute[72766]: DEBUG os_brick.utils [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:15:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:34 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e9b05a-07a5-45e1-9708-cb04a8fb1897]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:34 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[41db9b9b-0112-4500-9a11-ca5169ecf714]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:34 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8991c975-4450-4076-a128-38002b658ac9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:34 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d253634c-1578-4b43-88bb-cca612259248]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:15:34 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 23:15:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:15:34 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 23:15:34 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4aa61ab-d419-4244-9ade-8d4a6a8ae8aa]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:34 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 23:15:34 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 23:15:34 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 23:15:34 user nova-compute[72766]: DEBUG os_brick.utils [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:15:34 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Updating existing volume attachment record: cc7d6905-6932-46ff-bebe-0dd552a5edaa {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 23:15:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31504941-0f9e-4ebd-b992-3b08a4aef25a/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:35 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Removed pending event for 901fe741-3b2f-472e-b91c-a90c9d4a9c39 due to event {{(pid=72766) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 23:15:35 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054935.5021346, 901fe741-3b2f-472e-b91c-a90c9d4a9c39 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:15:35 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] VM Resumed (Lifecycle Event)
Aug 14 23:15:35 user nova-compute[72766]: DEBUG nova.compute.manager [None req-48b52bdd-aada-4fdf-b147-e29e8eec2998 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:15:35 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:15:35 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:15:35 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 14 23:15:35 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692054935.5074382, 901fe741-3b2f-472e-b91c-a90c9d4a9c39 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:15:35 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] VM Started (Lifecycle Event)
Aug 14 23:15:35 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:15:35 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:15:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31504941-0f9e-4ebd-b992-3b08a4aef25a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31504941-0f9e-4ebd-b992-3b08a4aef25a/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:35 user nova-compute[72766]: DEBUG nova.compute.manager [req-9504efe5-2cdf-4a4e-b460-a29d61ec27a3 req-c51e63f1-6424-4633-a7f8-0aa0f13b0b8e service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Received event network-vif-plugged-f2f08b69-eb49-4a38-9357-36420ee797d6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:15:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9504efe5-2cdf-4a4e-b460-a29d61ec27a3 req-c51e63f1-6424-4633-a7f8-0aa0f13b0b8e service nova] Acquiring lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:15:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9504efe5-2cdf-4a4e-b460-a29d61ec27a3 req-c51e63f1-6424-4633-a7f8-0aa0f13b0b8e service nova] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:15:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9504efe5-2cdf-4a4e-b460-a29d61ec27a3 req-c51e63f1-6424-4633-a7f8-0aa0f13b0b8e service nova] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:15:35 user nova-compute[72766]: DEBUG nova.compute.manager [req-9504efe5-2cdf-4a4e-b460-a29d61ec27a3 req-c51e63f1-6424-4633-a7f8-0aa0f13b0b8e service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] No waiting events found dispatching network-vif-plugged-f2f08b69-eb49-4a38-9357-36420ee797d6 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:15:35 user nova-compute[72766]: WARNING nova.compute.manager [req-9504efe5-2cdf-4a4e-b460-a29d61ec27a3 req-c51e63f1-6424-4633-a7f8-0aa0f13b0b8e service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Received unexpected event network-vif-plugged-f2f08b69-eb49-4a38-9357-36420ee797d6 for instance with vm_state active and task_state None.
Aug 14 23:15:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31504941-0f9e-4ebd-b992-3b08a4aef25a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34998d61-8b57-453c-a16c-5bb7a2b2c96c/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:36 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34998d61-8b57-453c-a16c-5bb7a2b2c96c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:36 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34998d61-8b57-453c-a16c-5bb7a2b2c96c/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:36 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34998d61-8b57-453c-a16c-5bb7a2b2c96c/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:36 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:36 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:36 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:36 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:37 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:15:37 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:15:37 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=7894MB free_disk=25.026561737060547GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:15:37 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:15:37 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:15:37 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 3ff300ff-34fd-4e94-9d2d-681fb133ba32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:15:37 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance cbcf7851-e6f7-4f46-97cc-d773286ccddf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:15:37 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 83084ccc-8e55-43dc-9a37-ffcb35a10922 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:15:37 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 71970b47-b09b-4492-9d99-a2be8b3b2042 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:15:37 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 9ec72ed8-0c33-4e70-ae88-d7571c84de2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:15:37 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 901fe741-3b2f-472e-b91c-a90c9d4a9c39 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:15:37 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance c45186c1-193e-4d52-a09b-aa8d18195c8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:15:37 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 31504941-0f9e-4ebd-b992-3b08a4aef25a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:15:37 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 34998d61-8b57-453c-a16c-5bb7a2b2c96c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:15:37 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:15:37 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:15:37 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:15:37 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:15:37 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:15:37 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.562s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:15:37 user nova-compute[72766]: DEBUG nova.compute.manager [req-fcd02e6f-cd4e-4071-93af-577b22694833 req-cad3e827-ea64-411f-80ba-870cf544efc8 service nova] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Received event network-changed-563bceb6-8712-4058-b0fb-ef8c5cf64d1d {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:15:37 user nova-compute[72766]: DEBUG nova.compute.manager [req-fcd02e6f-cd4e-4071-93af-577b22694833 req-cad3e827-ea64-411f-80ba-870cf544efc8 service nova] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Refreshing instance network info cache due to event network-changed-563bceb6-8712-4058-b0fb-ef8c5cf64d1d. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:15:37 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-fcd02e6f-cd4e-4071-93af-577b22694833 req-cad3e827-ea64-411f-80ba-870cf544efc8 service nova] Acquiring lock "refresh_cache-31504941-0f9e-4ebd-b992-3b08a4aef25a" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:15:37 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-fcd02e6f-cd4e-4071-93af-577b22694833 req-cad3e827-ea64-411f-80ba-870cf544efc8 service nova] Acquired lock "refresh_cache-31504941-0f9e-4ebd-b992-3b08a4aef25a" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:15:37 user nova-compute[72766]: DEBUG nova.network.neutron [req-fcd02e6f-cd4e-4071-93af-577b22694833 req-cad3e827-ea64-411f-80ba-870cf544efc8 service nova] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Refreshing network info cache for port 563bceb6-8712-4058-b0fb-ef8c5cf64d1d {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:15:38 user nova-compute[72766]: DEBUG nova.network.neutron [req-fcd02e6f-cd4e-4071-93af-577b22694833 req-cad3e827-ea64-411f-80ba-870cf544efc8 service nova] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Updated VIF entry in instance network info cache for port 563bceb6-8712-4058-b0fb-ef8c5cf64d1d. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:15:38 user nova-compute[72766]: DEBUG nova.network.neutron [req-fcd02e6f-cd4e-4071-93af-577b22694833 req-cad3e827-ea64-411f-80ba-870cf544efc8 service nova] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Updating instance_info_cache with network_info: [{"id": "563bceb6-8712-4058-b0fb-ef8c5cf64d1d", "address": "fa:16:3e:4f:80:98", "network": {"id": "b375da9b-b613-4a88-a262-962f959597b9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-462508113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1dd09415664f1aa0b0dbdeeb4b8d32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap563bceb6-87", "ovs_interfaceid": "563bceb6-8712-4058-b0fb-ef8c5cf64d1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:15:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-fcd02e6f-cd4e-4071-93af-577b22694833 req-cad3e827-ea64-411f-80ba-870cf544efc8 service nova] Releasing lock "refresh_cache-31504941-0f9e-4ebd-b992-3b08a4aef25a" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:15:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:38 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:15:38 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:15:38 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:15:38 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:15:38 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:15:38 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:15:39 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquiring lock "31504941-0f9e-4ebd-b992-3b08a4aef25a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:15:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "31504941-0f9e-4ebd-b992-3b08a4aef25a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:15:42 user nova-compute[72766]: DEBUG nova.objects.instance [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lazy-loading 'flavor' on Instance uuid 31504941-0f9e-4ebd-b992-3b08a4aef25a {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:15:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "31504941-0f9e-4ebd-b992-3b08a4aef25a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:15:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquiring lock "31504941-0f9e-4ebd-b992-3b08a4aef25a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:15:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "31504941-0f9e-4ebd-b992-3b08a4aef25a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:15:43 user nova-compute[72766]: INFO nova.compute.manager [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Attaching volume 95afa147-690b-480f-beca-33e38b0a9b1a to /dev/vdb
Aug 14 23:15:43 user nova-compute[72766]: DEBUG os_brick.utils [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:15:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:43 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41c2495-4441-4372-ab97-f6c02bb81f1f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:43 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[438a7318-81c3-420f-8476-09540f3b50dc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:43 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f884182-e681-40e3-bf5b-24a9b74bccd0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:43 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8640e6-dbf4-4674-867d-2527c92f8a47]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:15:43 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 23:15:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:15:43 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 23:15:43 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadc4d18-84d0-4a14-becb-4c473287051f]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:43 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 23:15:43 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 23:15:43 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 23:15:43 user nova-compute[72766]: DEBUG os_brick.utils [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:15:43 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Updating existing volume attachment record: a57819ac-da9f-4451-a2fa-49e998cdccb5 {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 23:15:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vejgIJWR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:15:44 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:15:44 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:15:44 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:15:44 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:15:44 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 23:15:44 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c0b3cd-419f-4732-af85-36d2ceee0c71]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 23:15:44 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[70852456-e79f-49a2-96c7-dabd181bc2af]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac] added
Aug 14 23:15:44 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8196d583-df08-4b03-9f4d-952641934d83]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[624597bc-9d20-4639-b2c6-4fd3c4b8d409]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vejgIJWR {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vejgIJWR" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58bf903-5c13-4515-a9d6-433bc9d5c23e]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vejgIJWR'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0bef99e-ee74-4d79-9c28-723eb8d7e390]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff08c64-f0b1-4717-bc79-6891f5fe2c39]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:15:44 user nova-compute[72766]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)
Aug 14 23:15:44 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:15:44 user nova-compute[72766]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)
Aug 14 23:15:44 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[729bc0db-9171-4ce1-be1f-f51e10f8d3f1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac, portal: 172.16.0.220,3260]
Aug 14 23:15:44 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac, portal: 172.16.0.220,3260] successful.
Aug 14 23:15:44 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[81076f43-01b5-4f1c-af0a-af863c48f127]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[936e0915-ba4d-4dd8-9415-16637fb0b352]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:15:44 user nova-compute[72766]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)
Aug 14 23:15:44 user nova-compute[72766]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac (non-flash)
Aug 14 23:15:44 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:15:44 user nova-compute[72766]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)
Aug 14 23:15:44 user nova-compute[72766]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac (non-flash)
Aug 14 23:15:44 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d23d082-c42a-40bf-a7dc-993721793b2d]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:15:44 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vejgIJWR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 23:15:45 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:15:45 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '26137353130313935', 'path': '/dev/sdc'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:15:45 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137353130313935', 'path': '/dev/sdc'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 23:15:45 user nova-compute[72766]: DEBUG nova.objects.instance [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lazy-loading 'flavor' on Instance uuid c45186c1-193e-4d52-a09b-aa8d18195c8e {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:15:45 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 23:15:45 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:15:45 user nova-compute[72766]:   <source dev="/dev/sdc"/>
Aug 14 23:15:45 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:15:45 user nova-compute[72766]:   <serial>d661ff3a-ed2e-446b-a44c-1467f27ab2ac</serial>
Aug 14 23:15:45 user nova-compute[72766]: </disk>
Aug 14 23:15:45 user nova-compute[72766]:  {{(pid=72766) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 23:15:46 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:15:46 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:15:46 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] No VIF found with MAC fa:16:3e:ee:f9:d5, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:15:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-e50304bd-ed93-4a48-bacc-f9a3f37cc105 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "c45186c1-193e-4d52-a09b-aa8d18195c8e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.622s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:15:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5eae263a-7329-4dbf-894e-7837127045c4 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Acquiring lock "c45186c1-193e-4d52-a09b-aa8d18195c8e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:15:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5eae263a-7329-4dbf-894e-7837127045c4 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "c45186c1-193e-4d52-a09b-aa8d18195c8e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:15:47 user nova-compute[72766]: INFO nova.compute.manager [None req-5eae263a-7329-4dbf-894e-7837127045c4 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Detaching volume d661ff3a-ed2e-446b-a44c-1467f27ab2ac
Aug 14 23:15:47 user nova-compute[72766]: INFO nova.virt.block_device [None req-5eae263a-7329-4dbf-894e-7837127045c4 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Attempting to driver detach volume d661ff3a-ed2e-446b-a44c-1467f27ab2ac from mountpoint /dev/vdb
Aug 14 23:15:48 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-5eae263a-7329-4dbf-894e-7837127045c4 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Attempting to detach device vdb from instance c45186c1-193e-4d52-a09b-aa8d18195c8e from the persistent domain config. {{(pid=72766) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-5eae263a-7329-4dbf-894e-7837127045c4 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 23:15:48 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:15:48 user nova-compute[72766]:   <source dev="/dev/sdc"/>
Aug 14 23:15:48 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:15:48 user nova-compute[72766]:   <serial>d661ff3a-ed2e-446b-a44c-1467f27ab2ac</serial>
Aug 14 23:15:48 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 23:15:48 user nova-compute[72766]: </disk>
Aug 14 23:15:48 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 23:15:48 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-5eae263a-7329-4dbf-894e-7837127045c4 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Successfully detached device vdb from instance c45186c1-193e-4d52-a09b-aa8d18195c8e from the persistent domain config.
Aug 14 23:15:48 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-5eae263a-7329-4dbf-894e-7837127045c4 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c45186c1-193e-4d52-a09b-aa8d18195c8e from the live domain config. {{(pid=72766) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-5eae263a-7329-4dbf-894e-7837127045c4 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 23:15:48 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:15:48 user nova-compute[72766]:   <source dev="/dev/sdc"/>
Aug 14 23:15:48 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:15:48 user nova-compute[72766]:   <serial>d661ff3a-ed2e-446b-a44c-1467f27ab2ac</serial>
Aug 14 23:15:48 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 23:15:48 user nova-compute[72766]: </disk>
Aug 14 23:15:48 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Received event <DeviceRemovedEvent: 1692054948.4752, c45186c1-193e-4d52-a09b-aa8d18195c8e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72766) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-5eae263a-7329-4dbf-894e-7837127045c4 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c45186c1-193e-4d52-a09b-aa8d18195c8e {{(pid=72766) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 23:15:48 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-5eae263a-7329-4dbf-894e-7837127045c4 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Successfully detached device vdb from instance c45186c1-193e-4d52-a09b-aa8d18195c8e from the live domain config.
Aug 14 23:15:48 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5eae263a-7329-4dbf-894e-7837127045c4 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eae263a-7329-4dbf-894e-7837127045c4 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vejgIJWR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:15:48 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-5eae263a-7329-4dbf-894e-7837127045c4 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:15:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-5eae263a-7329-4dbf-894e-7837127045c4 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-5eae263a-7329-4dbf-894e-7837127045c4 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eae263a-7329-4dbf-894e-7837127045c4 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1ef384-61e6-450d-bf5e-0989adda2a16]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc08dcd4-db37-4e68-a81f-155b53600aef]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eae263a-7329-4dbf-894e-7837127045c4 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:15:48 user nova-compute[72766]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)
Aug 14 23:15:48 user nova-compute[72766]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac (non-flash)
Aug 14 23:15:48 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eae263a-7329-4dbf-894e-7837127045c4 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:15:48 user nova-compute[72766]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)
Aug 14 23:15:48 user nova-compute[72766]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac (non-flash)
Aug 14 23:15:48 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eae263a-7329-4dbf-894e-7837127045c4 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff15434a5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac'): ({'sdc'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-5eae263a-7329-4dbf-894e-7837127045c4 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Removing single pathed devices sdc {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bee7128-cc55-40b8-9a83-75b625254ab0]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca19ffe4-3ae2-4ca7-b833-443372786438]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-5eae263a-7329-4dbf-894e-7837127045c4 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Flushing IO for device /dev/sdc {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dbc1de8-22c9-48fd-8605-e786e096fbea]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-5eae263a-7329-4dbf-894e-7837127045c4 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa11e797-19ef-4c0a-a493-d789edc3811b]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-5eae263a-7329-4dbf-894e-7837127045c4 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-5eae263a-7329-4dbf-894e-7837127045c4 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] SCSI volumes sdc have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eae263a-7329-4dbf-894e-7837127045c4 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7015f7-655b-40a0-bc89-2bc1c173805c]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eae263a-7329-4dbf-894e-7837127045c4 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f7dd64-d770-4647-86fe-c140c9c4f694]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eae263a-7329-4dbf-894e-7837127045c4 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac, portal: 172.16.0.220,3260]
Aug 14 23:15:48 user nova-compute[72766]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac, portal: 172.16.0.220,3260] successful.
Aug 14 23:15:48 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d661ff3a-ed2e-446b-a44c-1467f27ab2ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[368b77af-e932-473c-a9ba-5b0e2701ad24]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eae263a-7329-4dbf-894e-7837127045c4 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-5eae263a-7329-4dbf-894e-7837127045c4 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eae263a-7329-4dbf-894e-7837127045c4 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] <== disconnect_volume: return (324ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:15:48 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5eae263a-7329-4dbf-894e-7837127045c4 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:15:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:49 user nova-compute[72766]: DEBUG nova.objects.instance [None req-5eae263a-7329-4dbf-894e-7837127045c4 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lazy-loading 'flavor' on Instance uuid c45186c1-193e-4d52-a09b-aa8d18195c8e {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:15:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5eae263a-7329-4dbf-894e-7837127045c4 tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "c45186c1-193e-4d52-a09b-aa8d18195c8e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.699s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:15:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SKkMipyc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:15:52 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:15:52 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:15:52 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:15:52 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:15:52 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 23:15:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[af296bfb-7a30-405b-ab46-fbdd941b94b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 23:15:52 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9087dd0-5f7a-4ba5-9307-419053674b24]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a] added
Aug 14 23:15:52 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[029f7cbc-1d9e-47ea-ae28-d8d874280e35]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a438ebea-da3c-445d-a3d0-02d5c01726b1]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SKkMipyc {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SKkMipyc" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca8a254-8db1-498d-b3fb-8fc66f749354]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SKkMipyc'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5dcf46-8f88-4914-88f0-cc1ef133f0ba]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f0b099-cd55-450f-97fe-b815200c11c5]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:15:52 user nova-compute[72766]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)
Aug 14 23:15:52 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:15:52 user nova-compute[72766]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)
Aug 14 23:15:52 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2ababe-edb0-443e-a18b-1b475472eadb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a, portal: 172.16.0.220,3260]
Aug 14 23:15:52 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a, portal: 172.16.0.220,3260] successful.
Aug 14 23:15:52 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab6f545-0d8d-4a9c-8283-d9f5c713d479]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[48770397-47fb-4653-81c1-431198f5abee]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:15:52 user nova-compute[72766]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)
Aug 14 23:15:52 user nova-compute[72766]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a (non-flash)
Aug 14 23:15:52 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:15:52 user nova-compute[72766]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)
Aug 14 23:15:52 user nova-compute[72766]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a (non-flash)
Aug 14 23:15:52 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac7296a-2a5b-4771-9c84-6c6d6806b7a2]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:52 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: None {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:15:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:53 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:15:53 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SKkMipyc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 23:15:53 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:15:53 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26564613534373264', 'path': '/dev/sdc'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:15:53 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564613534373264', 'path': '/dev/sdc'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 23:15:53 user nova-compute[72766]: DEBUG nova.objects.instance [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lazy-loading 'flavor' on Instance uuid 31504941-0f9e-4ebd-b992-3b08a4aef25a {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:15:53 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 23:15:53 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:15:53 user nova-compute[72766]:   <source dev="/dev/sdc"/>
Aug 14 23:15:53 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:15:53 user nova-compute[72766]:   <serial>95afa147-690b-480f-beca-33e38b0a9b1a</serial>
Aug 14 23:15:53 user nova-compute[72766]: </disk>
Aug 14 23:15:53 user nova-compute[72766]:  {{(pid=72766) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 23:15:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:15:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:15:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] No VIF found with MAC fa:16:3e:4f:80:98, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:15:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d817bd8b-86ec-463e-9be4-8ac5c9f153e3 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "31504941-0f9e-4ebd-b992-3b08a4aef25a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.339s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:15:55 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquiring lock "31504941-0f9e-4ebd-b992-3b08a4aef25a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:15:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "31504941-0f9e-4ebd-b992-3b08a4aef25a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:15:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:15:58 user nova-compute[72766]: DEBUG nova.objects.instance [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lazy-loading 'flavor' on Instance uuid 31504941-0f9e-4ebd-b992-3b08a4aef25a {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:15:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "31504941-0f9e-4ebd-b992-3b08a4aef25a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:15:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquiring lock "31504941-0f9e-4ebd-b992-3b08a4aef25a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:15:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "31504941-0f9e-4ebd-b992-3b08a4aef25a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:15:58 user nova-compute[72766]: INFO nova.compute.manager [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Attaching volume 73d960ee-59ca-4280-89fd-71da1fbe2b5f to /dev/vdc
Aug 14 23:15:58 user nova-compute[72766]: DEBUG os_brick.utils [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:15:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:58 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b2f8f8-e039-40fc-9212-1ee1dda04da5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:58 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[046bcf25-4975-484d-9e40-cdf2a59895cf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:15:58 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f047a6-0ac5-43f2-90da-2761c5a5e4e6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:58 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[f401f024-32eb-4b10-90c1-2e368df5fe6d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:15:59 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 23:15:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:15:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:15:59 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 23:15:59 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab9a727-32d3-4807-9127-3912775dc83c]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:15:59 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 23:15:59 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 23:15:59 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 23:15:59 user nova-compute[72766]: DEBUG os_brick.utils [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:15:59 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Updating existing volume attachment record: 427850d0-d891-4b2c-be3a-f9a8e1e9fd61 {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 23:15:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:16:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:16:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ufrvpBhH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:16:08 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:16:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:16:08 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:16:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:16:08 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 23:16:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa178956-6753-42f1-8c0c-dfd9a00700e2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 23:16:08 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b02ea19-178a-4a6a-a839-edc75287d4c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f] added
Aug 14 23:16:08 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[51cce511-5571-47c1-b0d9-f4e808b87b6c]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[81758b48-62bb-41e5-a4ae-861a2d3eb7e1]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ufrvpBhH {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ufrvpBhH" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fd745c-c276-4164-8cb7-1e64349cdb0a]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ufrvpBhH'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce80621-24c2-4aac-9d6a-38ba8528b640]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89b3976-2a2e-45b2-8aeb-b434ab5c7d35]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:16:08 user nova-compute[72766]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)
Aug 14 23:16:08 user nova-compute[72766]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a (non-flash)
Aug 14 23:16:08 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:16:08 user nova-compute[72766]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)
Aug 14 23:16:08 user nova-compute[72766]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a (non-flash)
Aug 14 23:16:08 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b663857-6c72-4d44-9933-d38369864ac8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f, portal: 172.16.0.220,3260]
Aug 14 23:16:08 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f, portal: 172.16.0.220,3260] successful.
Aug 14 23:16:08 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5a0919-fbf4-41dd-aed3-363d1ddb058d]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b90475-a9fb-4948-97bd-93a1d71d7317]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:16:08 user nova-compute[72766]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)
Aug 14 23:16:08 user nova-compute[72766]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a (non-flash)
Aug 14 23:16:08 user nova-compute[72766]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f (non-flash)
Aug 14 23:16:08 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:16:08 user nova-compute[72766]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)
Aug 14 23:16:08 user nova-compute[72766]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a (non-flash)
Aug 14 23:16:08 user nova-compute[72766]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f (non-flash)
Aug 14 23:16:08 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[26539898-6d54-4091-a9df-89ce4bd6549f]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:16:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ufrvpBhH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 23:16:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:16:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:16:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23536636163353437', 'path': '/dev/sdd'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:16:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536636163353437', 'path': '/dev/sdd'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 23:16:09 user nova-compute[72766]: DEBUG nova.objects.instance [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lazy-loading 'flavor' on Instance uuid 31504941-0f9e-4ebd-b992-3b08a4aef25a {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:16:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 23:16:09 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:16:09 user nova-compute[72766]:   <source dev="/dev/sdd"/>
Aug 14 23:16:09 user nova-compute[72766]:   <target dev="vdc" bus="virtio"/>
Aug 14 23:16:09 user nova-compute[72766]:   <serial>73d960ee-59ca-4280-89fd-71da1fbe2b5f</serial>
Aug 14 23:16:09 user nova-compute[72766]: </disk>
Aug 14 23:16:09 user nova-compute[72766]:  {{(pid=72766) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 23:16:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:16:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:16:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:16:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] No VIF found with MAC fa:16:3e:4f:80:98, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:16:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-91bc2410-5125-4964-8238-b96d10eb6e12 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "31504941-0f9e-4ebd-b992-3b08a4aef25a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.553s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:16:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-96df713a-22e6-4a47-8e33-566f51733ea0 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquiring lock "31504941-0f9e-4ebd-b992-3b08a4aef25a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:16:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-96df713a-22e6-4a47-8e33-566f51733ea0 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "31504941-0f9e-4ebd-b992-3b08a4aef25a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:16:11 user nova-compute[72766]: INFO nova.compute.manager [None req-96df713a-22e6-4a47-8e33-566f51733ea0 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Detaching volume 95afa147-690b-480f-beca-33e38b0a9b1a
Aug 14 23:16:11 user nova-compute[72766]: INFO nova.virt.block_device [None req-96df713a-22e6-4a47-8e33-566f51733ea0 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Attempting to driver detach volume 95afa147-690b-480f-beca-33e38b0a9b1a from mountpoint /dev/vdb
Aug 14 23:16:11 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-96df713a-22e6-4a47-8e33-566f51733ea0 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Attempting to detach device vdb from instance 31504941-0f9e-4ebd-b992-3b08a4aef25a from the persistent domain config. {{(pid=72766) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 23:16:11 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-96df713a-22e6-4a47-8e33-566f51733ea0 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 23:16:11 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:16:11 user nova-compute[72766]:   <source dev="/dev/sdc"/>
Aug 14 23:16:11 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:16:11 user nova-compute[72766]:   <serial>95afa147-690b-480f-beca-33e38b0a9b1a</serial>
Aug 14 23:16:11 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 23:16:11 user nova-compute[72766]: </disk>
Aug 14 23:16:11 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 23:16:11 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-96df713a-22e6-4a47-8e33-566f51733ea0 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Successfully detached device vdb from instance 31504941-0f9e-4ebd-b992-3b08a4aef25a from the persistent domain config.
Aug 14 23:16:11 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-96df713a-22e6-4a47-8e33-566f51733ea0 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 31504941-0f9e-4ebd-b992-3b08a4aef25a from the live domain config. {{(pid=72766) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 23:16:11 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-96df713a-22e6-4a47-8e33-566f51733ea0 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 23:16:11 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:16:11 user nova-compute[72766]:   <source dev="/dev/sdc"/>
Aug 14 23:16:11 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:16:11 user nova-compute[72766]:   <serial>95afa147-690b-480f-beca-33e38b0a9b1a</serial>
Aug 14 23:16:11 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 23:16:11 user nova-compute[72766]: </disk>
Aug 14 23:16:11 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 23:16:11 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Received event <DeviceRemovedEvent: 1692054971.8468528, 31504941-0f9e-4ebd-b992-3b08a4aef25a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72766) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 23:16:11 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-96df713a-22e6-4a47-8e33-566f51733ea0 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 31504941-0f9e-4ebd-b992-3b08a4aef25a {{(pid=72766) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 23:16:11 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-96df713a-22e6-4a47-8e33-566f51733ea0 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Successfully detached device vdb from instance 31504941-0f9e-4ebd-b992-3b08a4aef25a from the live domain config.
Aug 14 23:16:11 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96df713a-22e6-4a47-8e33-566f51733ea0 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:16:11 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-96df713a-22e6-4a47-8e33-566f51733ea0 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SKkMipyc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:16:11 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-96df713a-22e6-4a47-8e33-566f51733ea0 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:16:11 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-96df713a-22e6-4a47-8e33-566f51733ea0 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:16:11 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-96df713a-22e6-4a47-8e33-566f51733ea0 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:16:11 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-96df713a-22e6-4a47-8e33-566f51733ea0 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:16:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:16:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:16:11 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bf3147-a0c6-4c79-8329-2255955a0ef6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:16:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:16:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:16:11 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c2205f-0b36-41a0-bad3-4072f564bcdf]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:16:11 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-96df713a-22e6-4a47-8e33-566f51733ea0 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:16:11 user nova-compute[72766]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)
Aug 14 23:16:11 user nova-compute[72766]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a (non-flash)
Aug 14 23:16:11 user nova-compute[72766]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f (non-flash)
Aug 14 23:16:11 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:16:11 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-96df713a-22e6-4a47-8e33-566f51733ea0 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:16:11 user nova-compute[72766]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)
Aug 14 23:16:11 user nova-compute[72766]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a (non-flash)
Aug 14 23:16:11 user nova-compute[72766]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f (non-flash)
Aug 14 23:16:11 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:16:11 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-96df713a-22e6-4a47-8e33-566f51733ea0 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff15420ab00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a'): ({'sdc'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:16:11 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-96df713a-22e6-4a47-8e33-566f51733ea0 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Removing single pathed devices sdc {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:16:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:16:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:16:11 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5505a8-d40d-4111-bdb5-00dcb1b0f7e2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:16:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:16:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:16:11 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9cf960-db18-44a9-90e8-ffd20a55274f]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:16:11 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-96df713a-22e6-4a47-8e33-566f51733ea0 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Flushing IO for device /dev/sdc {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:16:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:16:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:16:11 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c000e2-e44b-4904-927e-7b08000883cc]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:16:11 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-96df713a-22e6-4a47-8e33-566f51733ea0 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:16:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:16:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:16:12 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d0ea1d-8985-4da0-b864-8a147ca460a1]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:16:12 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-96df713a-22e6-4a47-8e33-566f51733ea0 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:16:12 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-96df713a-22e6-4a47-8e33-566f51733ea0 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] SCSI volumes sdc have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:16:12 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-96df713a-22e6-4a47-8e33-566f51733ea0 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:16:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:16:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:16:12 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bec0119-968e-43b6-adcf-17e991f63ec4]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:16:12 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-96df713a-22e6-4a47-8e33-566f51733ea0 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:16:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:16:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:16:12 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[73967ff8-cafb-4cde-a129-7c4b9434ab91]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:16:12 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-96df713a-22e6-4a47-8e33-566f51733ea0 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a, portal: 172.16.0.220,3260]
Aug 14 23:16:12 user nova-compute[72766]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a, portal: 172.16.0.220,3260] successful.
Aug 14 23:16:12 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:16:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:16:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95afa147-690b-480f-beca-33e38b0a9b1a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:16:12 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2b6ce5-40c9-4bd8-a19e-4dabc1e18a7a]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:16:12 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-96df713a-22e6-4a47-8e33-566f51733ea0 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:16:12 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-96df713a-22e6-4a47-8e33-566f51733ea0 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:16:12 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-96df713a-22e6-4a47-8e33-566f51733ea0 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] <== disconnect_volume: return (284ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:16:12 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96df713a-22e6-4a47-8e33-566f51733ea0 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:16:12 user nova-compute[72766]: DEBUG nova.objects.instance [None req-96df713a-22e6-4a47-8e33-566f51733ea0 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lazy-loading 'flavor' on Instance uuid 31504941-0f9e-4ebd-b992-3b08a4aef25a {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:16:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-96df713a-22e6-4a47-8e33-566f51733ea0 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "31504941-0f9e-4ebd-b992-3b08a4aef25a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.687s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:16:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-8bcea61b-2ab3-4d33-9172-98c2a5593706 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquiring lock "31504941-0f9e-4ebd-b992-3b08a4aef25a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:16:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-8bcea61b-2ab3-4d33-9172-98c2a5593706 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "31504941-0f9e-4ebd-b992-3b08a4aef25a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:16:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:16:13 user nova-compute[72766]: INFO nova.compute.manager [None req-8bcea61b-2ab3-4d33-9172-98c2a5593706 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Detaching volume 73d960ee-59ca-4280-89fd-71da1fbe2b5f
Aug 14 23:16:13 user nova-compute[72766]: INFO nova.virt.block_device [None req-8bcea61b-2ab3-4d33-9172-98c2a5593706 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Attempting to driver detach volume 73d960ee-59ca-4280-89fd-71da1fbe2b5f from mountpoint /dev/vdc
Aug 14 23:16:13 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-8bcea61b-2ab3-4d33-9172-98c2a5593706 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Attempting to detach device vdc from instance 31504941-0f9e-4ebd-b992-3b08a4aef25a from the persistent domain config. {{(pid=72766) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 23:16:13 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-8bcea61b-2ab3-4d33-9172-98c2a5593706 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 23:16:13 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:16:13 user nova-compute[72766]:   <source dev="/dev/sdd"/>
Aug 14 23:16:13 user nova-compute[72766]:   <target dev="vdc" bus="virtio"/>
Aug 14 23:16:13 user nova-compute[72766]:   <serial>73d960ee-59ca-4280-89fd-71da1fbe2b5f</serial>
Aug 14 23:16:13 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 14 23:16:13 user nova-compute[72766]: </disk>
Aug 14 23:16:13 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 23:16:13 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-8bcea61b-2ab3-4d33-9172-98c2a5593706 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Successfully detached device vdc from instance 31504941-0f9e-4ebd-b992-3b08a4aef25a from the persistent domain config.
Aug 14 23:16:13 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-8bcea61b-2ab3-4d33-9172-98c2a5593706 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 31504941-0f9e-4ebd-b992-3b08a4aef25a from the live domain config. {{(pid=72766) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 23:16:13 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-8bcea61b-2ab3-4d33-9172-98c2a5593706 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 23:16:13 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:16:13 user nova-compute[72766]:   <source dev="/dev/sdd"/>
Aug 14 23:16:13 user nova-compute[72766]:   <target dev="vdc" bus="virtio"/>
Aug 14 23:16:13 user nova-compute[72766]:   <serial>73d960ee-59ca-4280-89fd-71da1fbe2b5f</serial>
Aug 14 23:16:13 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 14 23:16:13 user nova-compute[72766]: </disk>
Aug 14 23:16:13 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Received event <DeviceRemovedEvent: 1692054974.1813614, 31504941-0f9e-4ebd-b992-3b08a4aef25a => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72766) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-8bcea61b-2ab3-4d33-9172-98c2a5593706 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 31504941-0f9e-4ebd-b992-3b08a4aef25a {{(pid=72766) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 23:16:14 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-8bcea61b-2ab3-4d33-9172-98c2a5593706 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Successfully detached device vdc from instance 31504941-0f9e-4ebd-b992-3b08a4aef25a from the live domain config.
Aug 14 23:16:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bcea61b-2ab3-4d33-9172-98c2a5593706 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcea61b-2ab3-4d33-9172-98c2a5593706 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ufrvpBhH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:16:14 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-8bcea61b-2ab3-4d33-9172-98c2a5593706 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:16:14 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-8bcea61b-2ab3-4d33-9172-98c2a5593706 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-8bcea61b-2ab3-4d33-9172-98c2a5593706 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcea61b-2ab3-4d33-9172-98c2a5593706 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82d5cfd-5a86-4c81-88bc-1b425beaf14e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eed2af3-c3ae-4d71-ab2a-ffee4ae1eafd]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcea61b-2ab3-4d33-9172-98c2a5593706 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:16:14 user nova-compute[72766]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)
Aug 14 23:16:14 user nova-compute[72766]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f (non-flash)
Aug 14 23:16:14 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcea61b-2ab3-4d33-9172-98c2a5593706 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:16:14 user nova-compute[72766]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)
Aug 14 23:16:14 user nova-compute[72766]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f (non-flash)
Aug 14 23:16:14 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcea61b-2ab3-4d33-9172-98c2a5593706 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff154222830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f'): ({'sdd'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-8bcea61b-2ab3-4d33-9172-98c2a5593706 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Removing single pathed devices sdd {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ba2a0a-5d4f-4d67-ad54-fc7c085a90ff]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd566932-61aa-4605-ac79-f10626ba16d8]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-8bcea61b-2ab3-4d33-9172-98c2a5593706 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Flushing IO for device /dev/sdd {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[164f6122-7c5d-4d2b-af2e-25aad77ff25a]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-8bcea61b-2ab3-4d33-9172-98c2a5593706 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c30ca8-683c-42b2-bfc6-9bdcff145306]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-8bcea61b-2ab3-4d33-9172-98c2a5593706 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-8bcea61b-2ab3-4d33-9172-98c2a5593706 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] SCSI volumes sdd have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcea61b-2ab3-4d33-9172-98c2a5593706 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab9a67d-fb85-4805-917e-0db1b698ce68]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcea61b-2ab3-4d33-9172-98c2a5593706 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb3ae8e-eb74-4b1c-936c-8ee158f09451]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcea61b-2ab3-4d33-9172-98c2a5593706 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f, portal: 172.16.0.220,3260]
Aug 14 23:16:14 user nova-compute[72766]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f, portal: 172.16.0.220,3260] successful.
Aug 14 23:16:14 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73d960ee-59ca-4280-89fd-71da1fbe2b5f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e449ad5d-f9de-4b57-aeb0-53b99b7c5c47]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcea61b-2ab3-4d33-9172-98c2a5593706 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-8bcea61b-2ab3-4d33-9172-98c2a5593706 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcea61b-2ab3-4d33-9172-98c2a5593706 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] <== disconnect_volume: return (262ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:16:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bcea61b-2ab3-4d33-9172-98c2a5593706 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:16:15 user nova-compute[72766]: DEBUG nova.objects.instance [None req-8bcea61b-2ab3-4d33-9172-98c2a5593706 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lazy-loading 'flavor' on Instance uuid 31504941-0f9e-4ebd-b992-3b08a4aef25a {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:16:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-8bcea61b-2ab3-4d33-9172-98c2a5593706 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "31504941-0f9e-4ebd-b992-3b08a4aef25a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.566s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:16:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b2058515-d86f-4497-936b-ab9e6f851184 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquiring lock "31504941-0f9e-4ebd-b992-3b08a4aef25a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:16:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b2058515-d86f-4497-936b-ab9e6f851184 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "31504941-0f9e-4ebd-b992-3b08a4aef25a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:16:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b2058515-d86f-4497-936b-ab9e6f851184 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquiring lock "31504941-0f9e-4ebd-b992-3b08a4aef25a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:16:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b2058515-d86f-4497-936b-ab9e6f851184 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "31504941-0f9e-4ebd-b992-3b08a4aef25a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:16:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b2058515-d86f-4497-936b-ab9e6f851184 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "31504941-0f9e-4ebd-b992-3b08a4aef25a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:16:16 user nova-compute[72766]: INFO nova.compute.manager [None req-b2058515-d86f-4497-936b-ab9e6f851184 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Terminating instance
Aug 14 23:16:16 user nova-compute[72766]: DEBUG nova.compute.manager [None req-b2058515-d86f-4497-936b-ab9e6f851184 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:16:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:16:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:16:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:16:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:16:16 user nova-compute[72766]: DEBUG nova.compute.manager [req-ea78294b-5e03-42fa-8a23-8494fa801d1c req-436d3019-79ab-47ee-90d5-43e0a68a008a service nova] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Received event network-vif-unplugged-563bceb6-8712-4058-b0fb-ef8c5cf64d1d {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:16:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ea78294b-5e03-42fa-8a23-8494fa801d1c req-436d3019-79ab-47ee-90d5-43e0a68a008a service nova] Acquiring lock "31504941-0f9e-4ebd-b992-3b08a4aef25a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:16:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ea78294b-5e03-42fa-8a23-8494fa801d1c req-436d3019-79ab-47ee-90d5-43e0a68a008a service nova] Lock "31504941-0f9e-4ebd-b992-3b08a4aef25a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:16:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ea78294b-5e03-42fa-8a23-8494fa801d1c req-436d3019-79ab-47ee-90d5-43e0a68a008a service nova] Lock "31504941-0f9e-4ebd-b992-3b08a4aef25a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:16:16 user nova-compute[72766]: DEBUG nova.compute.manager [req-ea78294b-5e03-42fa-8a23-8494fa801d1c req-436d3019-79ab-47ee-90d5-43e0a68a008a service nova] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] No waiting events found dispatching network-vif-unplugged-563bceb6-8712-4058-b0fb-ef8c5cf64d1d {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:16:16 user nova-compute[72766]: DEBUG nova.compute.manager [req-ea78294b-5e03-42fa-8a23-8494fa801d1c req-436d3019-79ab-47ee-90d5-43e0a68a008a service nova] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Received event network-vif-unplugged-563bceb6-8712-4058-b0fb-ef8c5cf64d1d for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:16:17 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:16:17 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:16:17 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Instance destroyed successfully.
Aug 14 23:16:17 user nova-compute[72766]: DEBUG nova.objects.instance [None req-b2058515-d86f-4497-936b-ab9e6f851184 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lazy-loading 'resources' on Instance uuid 31504941-0f9e-4ebd-b992-3b08a4aef25a {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:16:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-b2058515-d86f-4497-936b-ab9e6f851184 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:13:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1602261622',display_name='tempest-AttachVolumeTestJSON-server-1602261622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1602261622',id=33,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3YhERppPyCOH4gsQJfBOOTkAM5iXhIPotQUZcWkUP6EIQSOUhP7OAdRj0j7jwUEyk4pdeP4QiY9D/yPspRPyMd4tcj8BIp98Vtbi0BX9Nu6Gpgw1XvZ/PobzDK3tDJSQ==',key_name='tempest-keypair-1482276693',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:13:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b1dd09415664f1aa0b0dbdeeb4b8d32',ramdisk_id='',reservation_id='r-y99pkhnc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-716158533',owner_user_name='tempest-AttachVolumeTestJSON-716158533-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:13:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a41813929144571a3306300dbf6f485',uuid=31504941-0f9e-4ebd-b992-3b08a4aef25a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "563bceb6-8712-4058-b0fb-ef8c5cf64d1d", "address": "fa:16:3e:4f:80:98", "network": {"id": "b375da9b-b613-4a88-a262-962f959597b9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-462508113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1dd09415664f1aa0b0dbdeeb4b8d32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap563bceb6-87", "ovs_interfaceid": "563bceb6-8712-4058-b0fb-ef8c5cf64d1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:16:17 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-b2058515-d86f-4497-936b-ab9e6f851184 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Converting VIF {"id": "563bceb6-8712-4058-b0fb-ef8c5cf64d1d", "address": "fa:16:3e:4f:80:98", "network": {"id": "b375da9b-b613-4a88-a262-962f959597b9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-462508113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b1dd09415664f1aa0b0dbdeeb4b8d32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap563bceb6-87", "ovs_interfaceid": "563bceb6-8712-4058-b0fb-ef8c5cf64d1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:16:17 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-b2058515-d86f-4497-936b-ab9e6f851184 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:80:98,bridge_name='br-int',has_traffic_filtering=True,id=563bceb6-8712-4058-b0fb-ef8c5cf64d1d,network=Network(b375da9b-b613-4a88-a262-962f959597b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap563bceb6-87') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:16:17 user nova-compute[72766]: DEBUG os_vif [None req-b2058515-d86f-4497-936b-ab9e6f851184 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:80:98,bridge_name='br-int',has_traffic_filtering=True,id=563bceb6-8712-4058-b0fb-ef8c5cf64d1d,network=Network(b375da9b-b613-4a88-a262-962f959597b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap563bceb6-87') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:16:17 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:16:17 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap563bceb6-87, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:16:17 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:16:17 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:16:17 user nova-compute[72766]: INFO os_vif [None req-b2058515-d86f-4497-936b-ab9e6f851184 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:80:98,bridge_name='br-int',has_traffic_filtering=True,id=563bceb6-8712-4058-b0fb-ef8c5cf64d1d,network=Network(b375da9b-b613-4a88-a262-962f959597b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap563bceb6-87')
Aug 14 23:16:17 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-b2058515-d86f-4497-936b-ab9e6f851184 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Deleting instance files /opt/stack/data/nova/instances/31504941-0f9e-4ebd-b992-3b08a4aef25a_del
Aug 14 23:16:17 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-b2058515-d86f-4497-936b-ab9e6f851184 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Deletion of /opt/stack/data/nova/instances/31504941-0f9e-4ebd-b992-3b08a4aef25a_del complete
Aug 14 23:16:17 user nova-compute[72766]: INFO nova.compute.manager [None req-b2058515-d86f-4497-936b-ab9e6f851184 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 14 23:16:17 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-b2058515-d86f-4497-936b-ab9e6f851184 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:16:17 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:16:17 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:16:18 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:16:18 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Took 1.46 seconds to deallocate network for instance.
Aug 14 23:16:18 user nova-compute[72766]: DEBUG nova.compute.manager [req-43d1495d-54c4-4245-8298-241687758381 req-df49ceb5-fdfc-4b31-af29-b0b6c9c8690b service nova] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Received event network-vif-deleted-563bceb6-8712-4058-b0fb-ef8c5cf64d1d {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:16:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b2058515-d86f-4497-936b-ab9e6f851184 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:16:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b2058515-d86f-4497-936b-ab9e6f851184 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:16:18 user nova-compute[72766]: DEBUG nova.compute.manager [req-943a6bf1-f2ee-4bf6-be2e-d2a146e83a49 req-cae9421b-ec2b-4a5d-9870-dc79ff6e667f service nova] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Received event network-vif-plugged-563bceb6-8712-4058-b0fb-ef8c5cf64d1d {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:16:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-943a6bf1-f2ee-4bf6-be2e-d2a146e83a49 req-cae9421b-ec2b-4a5d-9870-dc79ff6e667f service nova] Acquiring lock "31504941-0f9e-4ebd-b992-3b08a4aef25a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:16:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-943a6bf1-f2ee-4bf6-be2e-d2a146e83a49 req-cae9421b-ec2b-4a5d-9870-dc79ff6e667f service nova] Lock "31504941-0f9e-4ebd-b992-3b08a4aef25a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:16:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-943a6bf1-f2ee-4bf6-be2e-d2a146e83a49 req-cae9421b-ec2b-4a5d-9870-dc79ff6e667f service nova] Lock "31504941-0f9e-4ebd-b992-3b08a4aef25a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:16:18 user nova-compute[72766]: DEBUG nova.compute.manager [req-943a6bf1-f2ee-4bf6-be2e-d2a146e83a49 req-cae9421b-ec2b-4a5d-9870-dc79ff6e667f service nova] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] No waiting events found dispatching network-vif-plugged-563bceb6-8712-4058-b0fb-ef8c5cf64d1d {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:16:18 user nova-compute[72766]: WARNING nova.compute.manager [req-943a6bf1-f2ee-4bf6-be2e-d2a146e83a49 req-cae9421b-ec2b-4a5d-9870-dc79ff6e667f service nova] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Received unexpected event network-vif-plugged-563bceb6-8712-4058-b0fb-ef8c5cf64d1d for instance with vm_state deleted and task_state None.
Aug 14 23:16:19 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-b2058515-d86f-4497-936b-ab9e6f851184 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:16:19 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-b2058515-d86f-4497-936b-ab9e6f851184 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:16:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b2058515-d86f-4497-936b-ab9e6f851184 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.294s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:16:19 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-b2058515-d86f-4497-936b-ab9e6f851184 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Deleted allocations for instance 31504941-0f9e-4ebd-b992-3b08a4aef25a
Aug 14 23:16:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b2058515-d86f-4497-936b-ab9e6f851184 tempest-AttachVolumeTestJSON-716158533 tempest-AttachVolumeTestJSON-716158533-project-member] Lock "31504941-0f9e-4ebd-b992-3b08a4aef25a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.833s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:16:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:16:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:16:29 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:16:30 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:16:30 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:16:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-71970b47-b09b-4492-9d99-a2be8b3b2042" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:16:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-71970b47-b09b-4492-9d99-a2be8b3b2042" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:16:31 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:16:31 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Updating instance_info_cache with network_info: [{"id": "aa623ac3-2e29-46fc-aa95-d6e6e2404758", "address": "fa:16:3e:3b:e1:a4", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa623ac3-2e", "ovs_interfaceid": "aa623ac3-2e29-46fc-aa95-d6e6e2404758", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:16:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-71970b47-b09b-4492-9d99-a2be8b3b2042" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:16:31 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:16:31 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:16:31 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:16:32 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692054977.1486611, 31504941-0f9e-4ebd-b992-3b08a4aef25a => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:16:32 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] VM Stopped (Lifecycle Event)
Aug 14 23:16:32 user nova-compute[72766]: DEBUG nova.compute.manager [None req-4f873518-9a51-4062-9be9-628f590904d7 None None] [instance: 31504941-0f9e-4ebd-b992-3b08a4aef25a] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:16:32 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:16:32 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:16:32 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:16:32 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:16:32 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:16:32 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:16:32 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:16:32 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:16:32 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:16:32 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:16:32 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:16:32 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:16:32 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:16:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c45186c1-193e-4d52-a09b-aa8d18195c8e/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:16:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c45186c1-193e-4d52-a09b-aa8d18195c8e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:16:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c45186c1-193e-4d52-a09b-aa8d18195c8e/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:16:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c45186c1-193e-4d52-a09b-aa8d18195c8e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:16:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:16:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:16:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:16:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:16:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:16:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:16:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:16:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:16:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:16:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:16:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:16:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:16:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34998d61-8b57-453c-a16c-5bb7a2b2c96c/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:16:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34998d61-8b57-453c-a16c-5bb7a2b2c96c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:16:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34998d61-8b57-453c-a16c-5bb7a2b2c96c/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:16:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34998d61-8b57-453c-a16c-5bb7a2b2c96c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:16:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:16:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:16:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:16:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:16:35 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:16:35 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:16:35 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=7901MB free_disk=25.0516357421875GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:16:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:16:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:16:35 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 3ff300ff-34fd-4e94-9d2d-681fb133ba32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:16:35 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance cbcf7851-e6f7-4f46-97cc-d773286ccddf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:16:35 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 83084ccc-8e55-43dc-9a37-ffcb35a10922 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:16:35 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 71970b47-b09b-4492-9d99-a2be8b3b2042 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:16:35 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 9ec72ed8-0c33-4e70-ae88-d7571c84de2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:16:35 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 901fe741-3b2f-472e-b91c-a90c9d4a9c39 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:16:35 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance c45186c1-193e-4d52-a09b-aa8d18195c8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:16:35 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 34998d61-8b57-453c-a16c-5bb7a2b2c96c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:16:35 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:16:35 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:16:35 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Refreshing inventories for resource provider 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 23:16:35 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Updating ProviderTree inventory for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 23:16:35 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Updating inventory in ProviderTree for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 23:16:35 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Refreshing aggregate associations for resource provider 45c8ff08-bf31-4ab6-8452-2e293102f899, aggregates: None {{(pid=72766) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 23:16:35 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Refreshing trait associations for resource provider 45c8ff08-bf31-4ab6-8452-2e293102f899, traits: COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=72766) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 23:16:36 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:16:36 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:16:36 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:16:36 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.654s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:16:37 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:16:38 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:16:38 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:16:38 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:16:38 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:16:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:16:38 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:16:38 user nova-compute[72766]: DEBUG nova.compute.manager [req-d5efeed2-ce6a-4f23-9beb-57b81465d50d req-a76c2e44-403f-42ca-9911-1fbffd217f37 service nova] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Received event network-changed-32417a5a-a445-4b76-b308-0d3b5180ac94 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:16:38 user nova-compute[72766]: DEBUG nova.compute.manager [req-d5efeed2-ce6a-4f23-9beb-57b81465d50d req-a76c2e44-403f-42ca-9911-1fbffd217f37 service nova] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Refreshing instance network info cache due to event network-changed-32417a5a-a445-4b76-b308-0d3b5180ac94. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:16:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d5efeed2-ce6a-4f23-9beb-57b81465d50d req-a76c2e44-403f-42ca-9911-1fbffd217f37 service nova] Acquiring lock "refresh_cache-c45186c1-193e-4d52-a09b-aa8d18195c8e" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:16:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d5efeed2-ce6a-4f23-9beb-57b81465d50d req-a76c2e44-403f-42ca-9911-1fbffd217f37 service nova] Acquired lock "refresh_cache-c45186c1-193e-4d52-a09b-aa8d18195c8e" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:16:38 user nova-compute[72766]: DEBUG nova.network.neutron [req-d5efeed2-ce6a-4f23-9beb-57b81465d50d req-a76c2e44-403f-42ca-9911-1fbffd217f37 service nova] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Refreshing network info cache for port 32417a5a-a445-4b76-b308-0d3b5180ac94 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:16:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f1aeab8a-8713-45d4-a6db-68bb7d208f3c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Acquiring lock "c45186c1-193e-4d52-a09b-aa8d18195c8e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:16:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f1aeab8a-8713-45d4-a6db-68bb7d208f3c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "c45186c1-193e-4d52-a09b-aa8d18195c8e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:16:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f1aeab8a-8713-45d4-a6db-68bb7d208f3c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Acquiring lock "c45186c1-193e-4d52-a09b-aa8d18195c8e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:16:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f1aeab8a-8713-45d4-a6db-68bb7d208f3c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "c45186c1-193e-4d52-a09b-aa8d18195c8e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:16:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f1aeab8a-8713-45d4-a6db-68bb7d208f3c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "c45186c1-193e-4d52-a09b-aa8d18195c8e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:16:38 user nova-compute[72766]: INFO nova.compute.manager [None req-f1aeab8a-8713-45d4-a6db-68bb7d208f3c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Terminating instance
Aug 14 23:16:38 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f1aeab8a-8713-45d4-a6db-68bb7d208f3c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:16:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:16:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:16:39 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:16:39 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:16:39 user nova-compute[72766]: DEBUG nova.network.neutron [req-d5efeed2-ce6a-4f23-9beb-57b81465d50d req-a76c2e44-403f-42ca-9911-1fbffd217f37 service nova] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Updated VIF entry in instance network info cache for port 32417a5a-a445-4b76-b308-0d3b5180ac94. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:16:39 user nova-compute[72766]: DEBUG nova.network.neutron [req-d5efeed2-ce6a-4f23-9beb-57b81465d50d req-a76c2e44-403f-42ca-9911-1fbffd217f37 service nova] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Updating instance_info_cache with network_info: [{"id": "32417a5a-a445-4b76-b308-0d3b5180ac94", "address": "fa:16:3e:ee:f9:d5", "network": {"id": "52ed808b-c840-47a7-aa8f-8055fd7bd1ef", "bridge": "br-int", "label": "tempest-TestStampPattern-1964150399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2329e260514d818d5af10aeeda498d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32417a5a-a4", "ovs_interfaceid": "32417a5a-a445-4b76-b308-0d3b5180ac94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:16:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d5efeed2-ce6a-4f23-9beb-57b81465d50d req-a76c2e44-403f-42ca-9911-1fbffd217f37 service nova] Releasing lock "refresh_cache-c45186c1-193e-4d52-a09b-aa8d18195c8e" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:16:39 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Instance destroyed successfully.
Aug 14 23:16:39 user nova-compute[72766]: DEBUG nova.objects.instance [None req-f1aeab8a-8713-45d4-a6db-68bb7d208f3c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lazy-loading 'resources' on Instance uuid c45186c1-193e-4d52-a09b-aa8d18195c8e {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:16:39 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-f1aeab8a-8713-45d4-a6db-68bb7d208f3c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:13:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1611717760',display_name='tempest-TestStampPattern-server-1611717760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1611717760',id=32,image_ref='5e8f2884-6cbc-494e-9311-8ce44f1ffd4b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpGwryUjtUrIoGUKk7UpA8gUykO9BhQbyJGpTNe51F8rSj8f9y24+iZRMzUrsprfERcHUFXZuW+wemEEJyvytSmT2p4zUjOXLeubfjibHmStVi+yhSgVVjf4UvXDmxC4g==',key_name='tempest-TestStampPattern-979334588',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:13:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc2329e260514d818d5af10aeeda498d',ramdisk_id='',reservation_id='r-6ixtvj9s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='9ec72ed8-0c33-4e70-ae88-d7571c84de2a',image_min_disk='1',image_min_ram='0',image_owner_id='bc2329e260514d818d5af10aeeda498d',image_owner_project_name='tempest-TestStampPattern-1250368372',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1250368372-project-member',image_user_id='fff2f6e64733493f905c23b2e15d4161',owner_project_name='tempest-TestStampPattern-1250368372',owner_user_name='tempest-TestStampPattern-1250368372-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:13:51Z,user_data=None,user_id='fff2f6e64733493f905c23b2e15d4161',uuid=c45186c1-193e-4d52-a09b-aa8d18195c8e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32417a5a-a445-4b76-b308-0d3b5180ac94", "address": "fa:16:3e:ee:f9:d5", "network": {"id": "52ed808b-c840-47a7-aa8f-8055fd7bd1ef", "bridge": "br-int", "label": "tempest-TestStampPattern-1964150399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2329e260514d818d5af10aeeda498d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32417a5a-a4", "ovs_interfaceid": "32417a5a-a445-4b76-b308-0d3b5180ac94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:16:39 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-f1aeab8a-8713-45d4-a6db-68bb7d208f3c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Converting VIF {"id": "32417a5a-a445-4b76-b308-0d3b5180ac94", "address": "fa:16:3e:ee:f9:d5", "network": {"id": "52ed808b-c840-47a7-aa8f-8055fd7bd1ef", "bridge": "br-int", "label": "tempest-TestStampPattern-1964150399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2329e260514d818d5af10aeeda498d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32417a5a-a4", "ovs_interfaceid": "32417a5a-a445-4b76-b308-0d3b5180ac94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:16:39 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-f1aeab8a-8713-45d4-a6db-68bb7d208f3c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:f9:d5,bridge_name='br-int',has_traffic_filtering=True,id=32417a5a-a445-4b76-b308-0d3b5180ac94,network=Network(52ed808b-c840-47a7-aa8f-8055fd7bd1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32417a5a-a4') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:16:39 user nova-compute[72766]: DEBUG os_vif [None req-f1aeab8a-8713-45d4-a6db-68bb7d208f3c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:f9:d5,bridge_name='br-int',has_traffic_filtering=True,id=32417a5a-a445-4b76-b308-0d3b5180ac94,network=Network(52ed808b-c840-47a7-aa8f-8055fd7bd1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32417a5a-a4') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:16:39 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:16:39 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32417a5a-a4, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:16:39 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:16:39 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:16:39 user nova-compute[72766]: INFO os_vif [None req-f1aeab8a-8713-45d4-a6db-68bb7d208f3c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:f9:d5,bridge_name='br-int',has_traffic_filtering=True,id=32417a5a-a445-4b76-b308-0d3b5180ac94,network=Network(52ed808b-c840-47a7-aa8f-8055fd7bd1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32417a5a-a4')
Aug 14 23:16:39 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-f1aeab8a-8713-45d4-a6db-68bb7d208f3c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Deleting instance files /opt/stack/data/nova/instances/c45186c1-193e-4d52-a09b-aa8d18195c8e_del
Aug 14 23:16:39 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-f1aeab8a-8713-45d4-a6db-68bb7d208f3c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Deletion of /opt/stack/data/nova/instances/c45186c1-193e-4d52-a09b-aa8d18195c8e_del complete
Aug 14 23:16:39 user nova-compute[72766]: INFO nova.compute.manager [None req-f1aeab8a-8713-45d4-a6db-68bb7d208f3c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 14 23:16:39 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-f1aeab8a-8713-45d4-a6db-68bb7d208f3c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:16:39 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:16:39 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:16:40 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:16:40 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Took 0.56 seconds to deallocate network for instance.
Aug 14 23:16:40 user nova-compute[72766]: DEBUG nova.compute.manager [req-cfe5d029-5b90-4a63-b0fd-e09d80d65768 req-b5da4480-dc96-4806-9e94-49a4d0de255b service nova] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Received event network-vif-deleted-32417a5a-a445-4b76-b308-0d3b5180ac94 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:16:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f1aeab8a-8713-45d4-a6db-68bb7d208f3c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:16:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f1aeab8a-8713-45d4-a6db-68bb7d208f3c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:16:40 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-f1aeab8a-8713-45d4-a6db-68bb7d208f3c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:16:40 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-f1aeab8a-8713-45d4-a6db-68bb7d208f3c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:16:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f1aeab8a-8713-45d4-a6db-68bb7d208f3c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.307s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:16:40 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:16:40 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72766) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 23:16:40 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-f1aeab8a-8713-45d4-a6db-68bb7d208f3c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Deleted allocations for instance c45186c1-193e-4d52-a09b-aa8d18195c8e
Aug 14 23:16:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f1aeab8a-8713-45d4-a6db-68bb7d208f3c tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "c45186c1-193e-4d52-a09b-aa8d18195c8e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.928s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:16:40 user nova-compute[72766]: DEBUG nova.compute.manager [req-0e9c31ff-de34-42b4-9812-8de782cd872b req-62e7e0bb-77d2-4244-8a63-b818b4c90416 service nova] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Received event network-vif-unplugged-32417a5a-a445-4b76-b308-0d3b5180ac94 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:16:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0e9c31ff-de34-42b4-9812-8de782cd872b req-62e7e0bb-77d2-4244-8a63-b818b4c90416 service nova] Acquiring lock "c45186c1-193e-4d52-a09b-aa8d18195c8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:16:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0e9c31ff-de34-42b4-9812-8de782cd872b req-62e7e0bb-77d2-4244-8a63-b818b4c90416 service nova] Lock "c45186c1-193e-4d52-a09b-aa8d18195c8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:16:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0e9c31ff-de34-42b4-9812-8de782cd872b req-62e7e0bb-77d2-4244-8a63-b818b4c90416 service nova] Lock "c45186c1-193e-4d52-a09b-aa8d18195c8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:16:40 user nova-compute[72766]: DEBUG nova.compute.manager [req-0e9c31ff-de34-42b4-9812-8de782cd872b req-62e7e0bb-77d2-4244-8a63-b818b4c90416 service nova] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] No waiting events found dispatching network-vif-unplugged-32417a5a-a445-4b76-b308-0d3b5180ac94 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:16:40 user nova-compute[72766]: WARNING nova.compute.manager [req-0e9c31ff-de34-42b4-9812-8de782cd872b req-62e7e0bb-77d2-4244-8a63-b818b4c90416 service nova] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Received unexpected event network-vif-unplugged-32417a5a-a445-4b76-b308-0d3b5180ac94 for instance with vm_state deleted and task_state None.
Aug 14 23:16:40 user nova-compute[72766]: DEBUG nova.compute.manager [req-0e9c31ff-de34-42b4-9812-8de782cd872b req-62e7e0bb-77d2-4244-8a63-b818b4c90416 service nova] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Received event network-vif-plugged-32417a5a-a445-4b76-b308-0d3b5180ac94 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:16:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0e9c31ff-de34-42b4-9812-8de782cd872b req-62e7e0bb-77d2-4244-8a63-b818b4c90416 service nova] Acquiring lock "c45186c1-193e-4d52-a09b-aa8d18195c8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:16:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0e9c31ff-de34-42b4-9812-8de782cd872b req-62e7e0bb-77d2-4244-8a63-b818b4c90416 service nova] Lock "c45186c1-193e-4d52-a09b-aa8d18195c8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:16:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0e9c31ff-de34-42b4-9812-8de782cd872b req-62e7e0bb-77d2-4244-8a63-b818b4c90416 service nova] Lock "c45186c1-193e-4d52-a09b-aa8d18195c8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:16:40 user nova-compute[72766]: DEBUG nova.compute.manager [req-0e9c31ff-de34-42b4-9812-8de782cd872b req-62e7e0bb-77d2-4244-8a63-b818b4c90416 service nova] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] No waiting events found dispatching network-vif-plugged-32417a5a-a445-4b76-b308-0d3b5180ac94 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:16:40 user nova-compute[72766]: WARNING nova.compute.manager [req-0e9c31ff-de34-42b4-9812-8de782cd872b req-62e7e0bb-77d2-4244-8a63-b818b4c90416 service nova] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Received unexpected event network-vif-plugged-32417a5a-a445-4b76-b308-0d3b5180ac94 for instance with vm_state deleted and task_state None.
Aug 14 23:16:41 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:16:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:16:44 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:16:44 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Cleaning up deleted instances {{(pid=72766) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 23:16:44 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] There are 0 instances to clean {{(pid=72766) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 23:16:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:16:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:16:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:16:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:16:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:16:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:16:54 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692054999.6227396, c45186c1-193e-4d52-a09b-aa8d18195c8e => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:16:54 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] VM Stopped (Lifecycle Event)
Aug 14 23:16:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-97c8e839-7d60-46d7-90cc-e07026383594 None None] [instance: c45186c1-193e-4d52-a09b-aa8d18195c8e] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:16:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:16:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b42ff72d-6566-49d6-94d6-ccb3c0674f93 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquiring lock "34998d61-8b57-453c-a16c-5bb7a2b2c96c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:16:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b42ff72d-6566-49d6-94d6-ccb3c0674f93 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "34998d61-8b57-453c-a16c-5bb7a2b2c96c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:16:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b42ff72d-6566-49d6-94d6-ccb3c0674f93 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquiring lock "34998d61-8b57-453c-a16c-5bb7a2b2c96c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:16:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b42ff72d-6566-49d6-94d6-ccb3c0674f93 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "34998d61-8b57-453c-a16c-5bb7a2b2c96c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:16:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b42ff72d-6566-49d6-94d6-ccb3c0674f93 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "34998d61-8b57-453c-a16c-5bb7a2b2c96c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:16:57 user nova-compute[72766]: INFO nova.compute.manager [None req-b42ff72d-6566-49d6-94d6-ccb3c0674f93 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Terminating instance
Aug 14 23:16:57 user nova-compute[72766]: DEBUG nova.compute.manager [None req-b42ff72d-6566-49d6-94d6-ccb3c0674f93 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:16:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:16:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:16:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:16:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:16:58 user nova-compute[72766]: DEBUG nova.compute.manager [req-a6628310-377e-44e8-b1e1-142d9579ee16 req-1d42d37d-3902-4184-82d4-080546285741 service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Received event network-vif-unplugged-d75b30b8-130a-44f8-b342-28a13e78fcd1 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:16:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a6628310-377e-44e8-b1e1-142d9579ee16 req-1d42d37d-3902-4184-82d4-080546285741 service nova] Acquiring lock "34998d61-8b57-453c-a16c-5bb7a2b2c96c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:16:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a6628310-377e-44e8-b1e1-142d9579ee16 req-1d42d37d-3902-4184-82d4-080546285741 service nova] Lock "34998d61-8b57-453c-a16c-5bb7a2b2c96c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:16:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a6628310-377e-44e8-b1e1-142d9579ee16 req-1d42d37d-3902-4184-82d4-080546285741 service nova] Lock "34998d61-8b57-453c-a16c-5bb7a2b2c96c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:16:58 user nova-compute[72766]: DEBUG nova.compute.manager [req-a6628310-377e-44e8-b1e1-142d9579ee16 req-1d42d37d-3902-4184-82d4-080546285741 service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] No waiting events found dispatching network-vif-unplugged-d75b30b8-130a-44f8-b342-28a13e78fcd1 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:16:58 user nova-compute[72766]: DEBUG nova.compute.manager [req-a6628310-377e-44e8-b1e1-142d9579ee16 req-1d42d37d-3902-4184-82d4-080546285741 service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Received event network-vif-unplugged-d75b30b8-130a-44f8-b342-28a13e78fcd1 for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:16:58 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Instance destroyed successfully.
Aug 14 23:16:58 user nova-compute[72766]: DEBUG nova.objects.instance [None req-b42ff72d-6566-49d6-94d6-ccb3c0674f93 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lazy-loading 'resources' on Instance uuid 34998d61-8b57-453c-a16c-5bb7a2b2c96c {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:16:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-b42ff72d-6566-49d6-94d6-ccb3c0674f93 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T23:11:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-573188518',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-573188518',id=30,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpCVNDOqJWsIopbIhA73fRWIMxhbGF3wyhqjeShQpFoDYaqRQlt+NjAJQM0+PHWFUaev0WNxHDrS1h03CUy+jZZz1Sbi35V266D2CLbwQbdXvPbnjiItTGPMQSCRiXk9A==',key_name='tempest-keypair-2040959384',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:15:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3f36bd126bda43c6971bccdef2b1da91',ramdisk_id='',reservation_id='r-wzdhb2yu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1828708750',owner_user_name='tempest-AttachVolumeShelveTestJSON-1828708750-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:15:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb167893135e4073928a60630ae7720c',uuid=34998d61-8b57-453c-a16c-5bb7a2b2c96c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d75b30b8-130a-44f8-b342-28a13e78fcd1", "address": "fa:16:3e:b3:d6:8a", "network": {"id": "ed86b27c-3e64-4c0a-8824-9bf68068058a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-506861998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f36bd126bda43c6971bccdef2b1da91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd75b30b8-13", "ovs_interfaceid": "d75b30b8-130a-44f8-b342-28a13e78fcd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:16:58 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-b42ff72d-6566-49d6-94d6-ccb3c0674f93 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Converting VIF {"id": "d75b30b8-130a-44f8-b342-28a13e78fcd1", "address": "fa:16:3e:b3:d6:8a", "network": {"id": "ed86b27c-3e64-4c0a-8824-9bf68068058a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-506861998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f36bd126bda43c6971bccdef2b1da91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd75b30b8-13", "ovs_interfaceid": "d75b30b8-130a-44f8-b342-28a13e78fcd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:16:58 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-b42ff72d-6566-49d6-94d6-ccb3c0674f93 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:d6:8a,bridge_name='br-int',has_traffic_filtering=True,id=d75b30b8-130a-44f8-b342-28a13e78fcd1,network=Network(ed86b27c-3e64-4c0a-8824-9bf68068058a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd75b30b8-13') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:16:58 user nova-compute[72766]: DEBUG os_vif [None req-b42ff72d-6566-49d6-94d6-ccb3c0674f93 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:d6:8a,bridge_name='br-int',has_traffic_filtering=True,id=d75b30b8-130a-44f8-b342-28a13e78fcd1,network=Network(ed86b27c-3e64-4c0a-8824-9bf68068058a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd75b30b8-13') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:16:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:16:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd75b30b8-13, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:16:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:16:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:16:58 user nova-compute[72766]: INFO os_vif [None req-b42ff72d-6566-49d6-94d6-ccb3c0674f93 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:d6:8a,bridge_name='br-int',has_traffic_filtering=True,id=d75b30b8-130a-44f8-b342-28a13e78fcd1,network=Network(ed86b27c-3e64-4c0a-8824-9bf68068058a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd75b30b8-13')
Aug 14 23:16:58 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-b42ff72d-6566-49d6-94d6-ccb3c0674f93 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Deleting instance files /opt/stack/data/nova/instances/34998d61-8b57-453c-a16c-5bb7a2b2c96c_del
Aug 14 23:16:58 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-b42ff72d-6566-49d6-94d6-ccb3c0674f93 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Deletion of /opt/stack/data/nova/instances/34998d61-8b57-453c-a16c-5bb7a2b2c96c_del complete
Aug 14 23:16:58 user nova-compute[72766]: INFO nova.compute.manager [None req-b42ff72d-6566-49d6-94d6-ccb3c0674f93 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 14 23:16:58 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-b42ff72d-6566-49d6-94d6-ccb3c0674f93 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:16:58 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:16:58 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:16:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:16:59 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:16:59 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Took 0.82 seconds to deallocate network for instance.
Aug 14 23:16:59 user nova-compute[72766]: DEBUG nova.compute.manager [req-52a7e1e1-26e4-44e0-b4a8-8107c238614e req-c1373c4d-f38b-45b6-95e4-6d3d18f3d383 service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Received event network-vif-deleted-d75b30b8-130a-44f8-b342-28a13e78fcd1 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:16:59 user nova-compute[72766]: INFO nova.compute.manager [req-52a7e1e1-26e4-44e0-b4a8-8107c238614e req-c1373c4d-f38b-45b6-95e4-6d3d18f3d383 service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Neutron deleted interface d75b30b8-130a-44f8-b342-28a13e78fcd1; detaching it from the instance and deleting it from the info cache
Aug 14 23:16:59 user nova-compute[72766]: DEBUG nova.network.neutron [req-52a7e1e1-26e4-44e0-b4a8-8107c238614e req-c1373c4d-f38b-45b6-95e4-6d3d18f3d383 service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:16:59 user nova-compute[72766]: DEBUG nova.compute.manager [req-52a7e1e1-26e4-44e0-b4a8-8107c238614e req-c1373c4d-f38b-45b6-95e4-6d3d18f3d383 service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Detach interface failed, port_id=d75b30b8-130a-44f8-b342-28a13e78fcd1, reason: Instance 34998d61-8b57-453c-a16c-5bb7a2b2c96c could not be found. {{(pid=72766) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 23:16:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b42ff72d-6566-49d6-94d6-ccb3c0674f93 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:16:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b42ff72d-6566-49d6-94d6-ccb3c0674f93 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:16:59 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-b42ff72d-6566-49d6-94d6-ccb3c0674f93 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:16:59 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-b42ff72d-6566-49d6-94d6-ccb3c0674f93 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:17:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b42ff72d-6566-49d6-94d6-ccb3c0674f93 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.263s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:17:00 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-b42ff72d-6566-49d6-94d6-ccb3c0674f93 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Deleted allocations for instance 34998d61-8b57-453c-a16c-5bb7a2b2c96c
Aug 14 23:17:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b42ff72d-6566-49d6-94d6-ccb3c0674f93 tempest-AttachVolumeShelveTestJSON-1828708750 tempest-AttachVolumeShelveTestJSON-1828708750-project-member] Lock "34998d61-8b57-453c-a16c-5bb7a2b2c96c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.271s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:17:00 user nova-compute[72766]: DEBUG nova.compute.manager [req-2c3f1575-7488-49ac-95ab-c3e515a652b7 req-0e14d57a-083d-4de3-aec8-bb252461aefd service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Received event network-vif-plugged-d75b30b8-130a-44f8-b342-28a13e78fcd1 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:17:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2c3f1575-7488-49ac-95ab-c3e515a652b7 req-0e14d57a-083d-4de3-aec8-bb252461aefd service nova] Acquiring lock "34998d61-8b57-453c-a16c-5bb7a2b2c96c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:17:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2c3f1575-7488-49ac-95ab-c3e515a652b7 req-0e14d57a-083d-4de3-aec8-bb252461aefd service nova] Lock "34998d61-8b57-453c-a16c-5bb7a2b2c96c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:17:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2c3f1575-7488-49ac-95ab-c3e515a652b7 req-0e14d57a-083d-4de3-aec8-bb252461aefd service nova] Lock "34998d61-8b57-453c-a16c-5bb7a2b2c96c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:17:00 user nova-compute[72766]: DEBUG nova.compute.manager [req-2c3f1575-7488-49ac-95ab-c3e515a652b7 req-0e14d57a-083d-4de3-aec8-bb252461aefd service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] No waiting events found dispatching network-vif-plugged-d75b30b8-130a-44f8-b342-28a13e78fcd1 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:17:00 user nova-compute[72766]: WARNING nova.compute.manager [req-2c3f1575-7488-49ac-95ab-c3e515a652b7 req-0e14d57a-083d-4de3-aec8-bb252461aefd service nova] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Received unexpected event network-vif-plugged-d75b30b8-130a-44f8-b342-28a13e78fcd1 for instance with vm_state deleted and task_state None.
Aug 14 23:17:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:17:13 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692055018.7475996, 34998d61-8b57-453c-a16c-5bb7a2b2c96c => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:17:13 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] VM Stopped (Lifecycle Event)
Aug 14 23:17:13 user nova-compute[72766]: DEBUG nova.compute.manager [None req-b54287f7-c879-4cdb-8a6d-a53d11695062 None None] [instance: 34998d61-8b57-453c-a16c-5bb7a2b2c96c] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:17:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:17:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:17:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:17:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:17:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:21 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:17:21 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:17:21 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:17:21 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:17:21 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:17:21 user nova-compute[72766]: INFO nova.compute.manager [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Terminating instance
Aug 14 23:17:21 user nova-compute[72766]: DEBUG nova.compute.manager [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:17:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG nova.compute.manager [req-e9dfa428-0af9-4277-8653-4ba8341a1049 req-7739f195-3c31-4e6a-958a-d3589fad1eb3 service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Received event network-vif-unplugged-f2f08b69-eb49-4a38-9357-36420ee797d6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e9dfa428-0af9-4277-8653-4ba8341a1049 req-7739f195-3c31-4e6a-958a-d3589fad1eb3 service nova] Acquiring lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e9dfa428-0af9-4277-8653-4ba8341a1049 req-7739f195-3c31-4e6a-958a-d3589fad1eb3 service nova] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e9dfa428-0af9-4277-8653-4ba8341a1049 req-7739f195-3c31-4e6a-958a-d3589fad1eb3 service nova] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG nova.compute.manager [req-e9dfa428-0af9-4277-8653-4ba8341a1049 req-7739f195-3c31-4e6a-958a-d3589fad1eb3 service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] No waiting events found dispatching network-vif-unplugged-f2f08b69-eb49-4a38-9357-36420ee797d6 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG nova.compute.manager [req-e9dfa428-0af9-4277-8653-4ba8341a1049 req-7739f195-3c31-4e6a-958a-d3589fad1eb3 service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Received event network-vif-unplugged-f2f08b69-eb49-4a38-9357-36420ee797d6 for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:22 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Instance destroyed successfully.
Aug 14 23:17:22 user nova-compute[72766]: DEBUG nova.objects.instance [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lazy-loading 'resources' on Instance uuid 901fe741-3b2f-472e-b91c-a90c9d4a9c39 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:11:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-952087033',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-952087033',id=31,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:13:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3725c4b1cd78403f9628c8af9f8e5cc5',ramdisk_id='',reservation_id='r-4s8wi2wt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-86235447',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:15:36Z,user_data=None,user_id='32e61321c50d4af28adeab72811a3f86',uuid=901fe741-3b2f-472e-b91c-a90c9d4a9c39,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2f08b69-eb49-4a38-9357-36420ee797d6", "address": "fa:16:3e:44:c6:dd", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f08b69-eb", "ovs_interfaceid": "f2f08b69-eb49-4a38-9357-36420ee797d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Converting VIF {"id": "f2f08b69-eb49-4a38-9357-36420ee797d6", "address": "fa:16:3e:44:c6:dd", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f08b69-eb", "ovs_interfaceid": "f2f08b69-eb49-4a38-9357-36420ee797d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:c6:dd,bridge_name='br-int',has_traffic_filtering=True,id=f2f08b69-eb49-4a38-9357-36420ee797d6,network=Network(f4efdeee-d89b-45e5-b0d9-b45573564e9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2f08b69-eb') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG os_vif [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:c6:dd,bridge_name='br-int',has_traffic_filtering=True,id=f2f08b69-eb49-4a38-9357-36420ee797d6,network=Network(f4efdeee-d89b-45e5-b0d9-b45573564e9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2f08b69-eb') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2f08b69-eb, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:17:22 user nova-compute[72766]: INFO os_vif [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:c6:dd,bridge_name='br-int',has_traffic_filtering=True,id=f2f08b69-eb49-4a38-9357-36420ee797d6,network=Network(f4efdeee-d89b-45e5-b0d9-b45573564e9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2f08b69-eb')
Aug 14 23:17:22 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fNiWyvpJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:17:22 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:17:22 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdfc0b2-5245-4f32-888b-54c1a0370206]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8303e7-8517-49ec-8951-d555715e2d05]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:17:22 user nova-compute[72766]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)
Aug 14 23:17:22 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:17:22 user nova-compute[72766]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 (non-flash)
Aug 14 23:17:22 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff154341c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4'): ({'sdb'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Removing single pathed devices sdb {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[46335506-3ac3-4bbf-ba08-0c67a6be5a29]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8346350-31f7-4c42-9f47-bd9e52afe9aa]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Flushing IO for device /dev/sdb {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[290fba3c-6845-45eb-be32-d72f917233ae]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[73705098-b583-44e1-9cff-7595731b2dae]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] SCSI volumes sdb have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO2b58070b-fddd26b176acef07', '/dev/disk/by-id/scsi-26664646432366231', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2b58070b') {{(pid=83651) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[f400ad87-ea25-464a-b354-297b15e00485]: (4, None) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[86684cd1-4f54-411f-af3e-0d91d2c05055]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[855c06c5-b4e3-446d-9b38-0c675d5badcf]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4, portal: 172.16.0.220,3260]
Aug 14 23:17:22 user nova-compute[72766]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4, portal: 172.16.0.220,3260] successful.
Aug 14 23:17:22 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c962ff1-98b5-48ca-bbce-dd40c372a3c4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[009bcd5d-3442-4972-b21b-4dd5b4933b28]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] <== disconnect_volume: return (306ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:17:22 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:17:22 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Deleting instance files /opt/stack/data/nova/instances/901fe741-3b2f-472e-b91c-a90c9d4a9c39_del
Aug 14 23:17:22 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Deletion of /opt/stack/data/nova/instances/901fe741-3b2f-472e-b91c-a90c9d4a9c39_del complete
Aug 14 23:17:23 user nova-compute[72766]: INFO nova.compute.manager [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Took 1.20 seconds to destroy the instance on the hypervisor.
Aug 14 23:17:23 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:17:23 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:17:23 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:17:23 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:17:23 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Took 0.57 seconds to deallocate network for instance.
Aug 14 23:17:24 user nova-compute[72766]: DEBUG nova.compute.manager [req-60c69a4a-36ca-4477-8afe-0f398e9b9ec3 req-65b0c2f1-d91a-491d-b98f-87fbc5c871cc service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Received event network-vif-plugged-f2f08b69-eb49-4a38-9357-36420ee797d6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:17:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-60c69a4a-36ca-4477-8afe-0f398e9b9ec3 req-65b0c2f1-d91a-491d-b98f-87fbc5c871cc service nova] Acquiring lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:17:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-60c69a4a-36ca-4477-8afe-0f398e9b9ec3 req-65b0c2f1-d91a-491d-b98f-87fbc5c871cc service nova] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:17:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-60c69a4a-36ca-4477-8afe-0f398e9b9ec3 req-65b0c2f1-d91a-491d-b98f-87fbc5c871cc service nova] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:17:24 user nova-compute[72766]: DEBUG nova.compute.manager [req-60c69a4a-36ca-4477-8afe-0f398e9b9ec3 req-65b0c2f1-d91a-491d-b98f-87fbc5c871cc service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] No waiting events found dispatching network-vif-plugged-f2f08b69-eb49-4a38-9357-36420ee797d6 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:17:24 user nova-compute[72766]: WARNING nova.compute.manager [req-60c69a4a-36ca-4477-8afe-0f398e9b9ec3 req-65b0c2f1-d91a-491d-b98f-87fbc5c871cc service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Received unexpected event network-vif-plugged-f2f08b69-eb49-4a38-9357-36420ee797d6 for instance with vm_state active and task_state deleting.
Aug 14 23:17:24 user nova-compute[72766]: DEBUG nova.compute.manager [req-60c69a4a-36ca-4477-8afe-0f398e9b9ec3 req-65b0c2f1-d91a-491d-b98f-87fbc5c871cc service nova] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Received event network-vif-deleted-f2f08b69-eb49-4a38-9357-36420ee797d6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:17:24 user nova-compute[72766]: INFO nova.compute.manager [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Took 0.75 seconds to detach 1 volumes for instance.
Aug 14 23:17:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:17:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:17:24 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:17:24 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:17:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.219s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:17:24 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Deleted allocations for instance 901fe741-3b2f-472e-b91c-a90c9d4a9c39
Aug 14 23:17:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d1ec2740-8a02-4af6-bf7a-6fc16af7b7cb tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "901fe741-3b2f-472e-b91c-a90c9d4a9c39" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.914s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:17:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:30 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:17:30 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:17:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-9ec72ed8-0c33-4e70-ae88-d7571c84de2a" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:17:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-9ec72ed8-0c33-4e70-ae88-d7571c84de2a" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:17:30 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:17:31 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Updating instance_info_cache with network_info: [{"id": "53e31c0d-29ff-4d0d-8f3a-6a08a69c927e", "address": "fa:16:3e:ba:ba:ec", "network": {"id": "52ed808b-c840-47a7-aa8f-8055fd7bd1ef", "bridge": "br-int", "label": "tempest-TestStampPattern-1964150399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2329e260514d818d5af10aeeda498d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e31c0d-29", "ovs_interfaceid": "53e31c0d-29ff-4d0d-8f3a-6a08a69c927e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:17:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-9ec72ed8-0c33-4e70-ae88-d7571c84de2a" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:17:31 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:17:31 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:17:31 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:17:32 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:32 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:17:32 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:17:32 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:17:32 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:17:32 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:17:32 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:17:32 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:17:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:17:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:17:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:17:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:17:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:17:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:17:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:17:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:17:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:17:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:17:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:17:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:17:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:17:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:17:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:17:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:17:34 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:17:34 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:17:34 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=8275MB free_disk=25.070423126220703GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:17:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:17:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:17:35 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 3ff300ff-34fd-4e94-9d2d-681fb133ba32 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:17:35 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance cbcf7851-e6f7-4f46-97cc-d773286ccddf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:17:35 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 83084ccc-8e55-43dc-9a37-ffcb35a10922 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:17:35 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 71970b47-b09b-4492-9d99-a2be8b3b2042 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:17:35 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 9ec72ed8-0c33-4e70-ae88-d7571c84de2a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:17:35 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:17:35 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:17:35 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:17:35 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:17:35 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:17:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.356s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:17:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:37 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:17:37 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:17:37 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:17:37 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:17:37 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692055042.6112416, 901fe741-3b2f-472e-b91c-a90c9d4a9c39 => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:17:37 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] VM Stopped (Lifecycle Event)
Aug 14 23:17:37 user nova-compute[72766]: DEBUG nova.compute.manager [None req-7ebf3db1-08ed-4f30-ad13-a612738de2f4 None None] [instance: 901fe741-3b2f-472e-b91c-a90c9d4a9c39] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:17:37 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:37 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:17:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "f658f249-cb92-4fc1-b1fb-cb6925cf7e1c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:17:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "f658f249-cb92-4fc1-b1fb-cb6925cf7e1c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:17:39 user nova-compute[72766]: DEBUG nova.compute.manager [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 23:17:39 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:17:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:17:39 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 23:17:39 user nova-compute[72766]: INFO nova.compute.claims [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Claim successful on node user
Aug 14 23:17:39 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:17:39 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:17:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.330s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:17:39 user nova-compute[72766]: DEBUG nova.compute.manager [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 23:17:39 user nova-compute[72766]: DEBUG nova.compute.manager [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 23:17:39 user nova-compute[72766]: DEBUG nova.network.neutron [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 23:17:39 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 23:17:39 user nova-compute[72766]: DEBUG nova.compute.manager [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 23:17:39 user nova-compute[72766]: DEBUG nova.policy [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '90e68d4dfd6048d99037fce632788b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785d8cff6cd41a4aff8becf528e3a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 23:17:39 user nova-compute[72766]: DEBUG nova.compute.manager [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 23:17:39 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 23:17:39 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Creating image(s)
Aug 14 23:17:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "/opt/stack/data/nova/instances/f658f249-cb92-4fc1-b1fb-cb6925cf7e1c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:17:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "/opt/stack/data/nova/instances/f658f249-cb92-4fc1-b1fb-cb6925cf7e1c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:17:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "/opt/stack/data/nova/instances/f658f249-cb92-4fc1-b1fb-cb6925cf7e1c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:17:39 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:17:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.187s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:17:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:17:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:17:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:17:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.193s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:17:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/f658f249-cb92-4fc1-b1fb-cb6925cf7e1c/disk 1073741824 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:17:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/f658f249-cb92-4fc1-b1fb-cb6925cf7e1c/disk 1073741824" returned: 0 in 0.127s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:17:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.330s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:17:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:17:40 user nova-compute[72766]: DEBUG nova.network.neutron [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Successfully created port: 1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80 {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 23:17:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.187s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:17:40 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f658f249-cb92-4fc1-b1fb-cb6925cf7e1c/disk. size=1073741824 {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 23:17:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f658f249-cb92-4fc1-b1fb-cb6925cf7e1c/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:17:40 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:17:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f658f249-cb92-4fc1-b1fb-cb6925cf7e1c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:17:40 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Cannot resize image /opt/stack/data/nova/instances/f658f249-cb92-4fc1-b1fb-cb6925cf7e1c/disk to a smaller size. {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 23:17:40 user nova-compute[72766]: DEBUG nova.objects.instance [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lazy-loading 'migration_context' on Instance uuid f658f249-cb92-4fc1-b1fb-cb6925cf7e1c {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:17:40 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 23:17:40 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Ensure instance console log exists: /opt/stack/data/nova/instances/f658f249-cb92-4fc1-b1fb-cb6925cf7e1c/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 23:17:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:17:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:17:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG nova.network.neutron [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Successfully updated port: 1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80 {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "refresh_cache-f658f249-cb92-4fc1-b1fb-cb6925cf7e1c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquired lock "refresh_cache-f658f249-cb92-4fc1-b1fb-cb6925cf7e1c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG nova.network.neutron [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG nova.compute.manager [req-e36284f7-8297-4763-91b3-21024e63411e req-b9a59cac-963f-435e-a5d2-9a3c3a1d04fd service nova] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Received event network-changed-1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG nova.compute.manager [req-e36284f7-8297-4763-91b3-21024e63411e req-b9a59cac-963f-435e-a5d2-9a3c3a1d04fd service nova] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Refreshing instance network info cache due to event network-changed-1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e36284f7-8297-4763-91b3-21024e63411e req-b9a59cac-963f-435e-a5d2-9a3c3a1d04fd service nova] Acquiring lock "refresh_cache-f658f249-cb92-4fc1-b1fb-cb6925cf7e1c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG nova.network.neutron [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG nova.network.neutron [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Updating instance_info_cache with network_info: [{"id": "1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80", "address": "fa:16:3e:e6:8a:ae", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd62d5e-81", "ovs_interfaceid": "1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Releasing lock "refresh_cache-f658f249-cb92-4fc1-b1fb-cb6925cf7e1c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG nova.compute.manager [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Instance network_info: |[{"id": "1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80", "address": "fa:16:3e:e6:8a:ae", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd62d5e-81", "ovs_interfaceid": "1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e36284f7-8297-4763-91b3-21024e63411e req-b9a59cac-963f-435e-a5d2-9a3c3a1d04fd service nova] Acquired lock "refresh_cache-f658f249-cb92-4fc1-b1fb-cb6925cf7e1c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG nova.network.neutron [req-e36284f7-8297-4763-91b3-21024e63411e req-b9a59cac-963f-435e-a5d2-9a3c3a1d04fd service nova] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Refreshing network info cache for port 1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Start _get_guest_xml network_info=[{"id": "1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80", "address": "fa:16:3e:e6:8a:ae", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd62d5e-81", "ovs_interfaceid": "1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd2900d30-2c4c-4d57-9135-d45564c0c596'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:17:41 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:17:41 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:17:41 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:17:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-124714953',display_name='tempest-AttachVolumeNegativeTest-server-124714953',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-124714953',id=34,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrRn6VM/NodMaXXlsqEjdmlXYxNoRhk02FHcFcLdqKqnHp5m2XSVm+/WhEBmEJ+jICRGE+e9+W/QBsRf/wWdpOkZe0RE6NOHzo9Sw5AvU5eZzq13+Tgc1PhqhXXmEDrVQ==',key_name='tempest-keypair-170593372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3785d8cff6cd41a4aff8becf528e3a4c',ramdisk_id='',reservation_id='r-wkfmniy8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1623363641',owner_user_name='tempest-AttachVolumeNegativeTest-1623363641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:17:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90e68d4dfd6048d99037fce632788b57',uuid=f658f249-cb92-4fc1-b1fb-cb6925cf7e1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80", "address": "fa:16:3e:e6:8a:ae", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd62d5e-81", "ovs_interfaceid": "1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Converting VIF {"id": "1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80", "address": "fa:16:3e:e6:8a:ae", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd62d5e-81", "ovs_interfaceid": "1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:8a:ae,bridge_name='br-int',has_traffic_filtering=True,id=1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80,network=Network(9491b8be-e6b2-4770-a591-370db9a96785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fd62d5e-81') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG nova.objects.instance [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lazy-loading 'pci_devices' on Instance uuid f658f249-cb92-4fc1-b1fb-cb6925cf7e1c {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:17:41 user nova-compute[72766]:   <uuid>f658f249-cb92-4fc1-b1fb-cb6925cf7e1c</uuid>
Aug 14 23:17:41 user nova-compute[72766]:   <name>instance-00000022</name>
Aug 14 23:17:41 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:17:41 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:17:41 user nova-compute[72766]:   <metadata>
Aug 14 23:17:41 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:17:41 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:17:41 user nova-compute[72766]:       <nova:name>tempest-AttachVolumeNegativeTest-server-124714953</nova:name>
Aug 14 23:17:41 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:17:41</nova:creationTime>
Aug 14 23:17:41 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:17:41 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:17:41 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:17:41 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:17:41 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:17:41 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:17:41 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:17:41 user nova-compute[72766]:       <nova:owner>
Aug 14 23:17:41 user nova-compute[72766]:         <nova:user uuid="90e68d4dfd6048d99037fce632788b57">tempest-AttachVolumeNegativeTest-1623363641-project-member</nova:user>
Aug 14 23:17:41 user nova-compute[72766]:         <nova:project uuid="3785d8cff6cd41a4aff8becf528e3a4c">tempest-AttachVolumeNegativeTest-1623363641</nova:project>
Aug 14 23:17:41 user nova-compute[72766]:       </nova:owner>
Aug 14 23:17:41 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 23:17:41 user nova-compute[72766]:       <nova:ports>
Aug 14 23:17:41 user nova-compute[72766]:         <nova:port uuid="1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80">
Aug 14 23:17:41 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 23:17:41 user nova-compute[72766]:         </nova:port>
Aug 14 23:17:41 user nova-compute[72766]:       </nova:ports>
Aug 14 23:17:41 user nova-compute[72766]:     </nova:instance>
Aug 14 23:17:41 user nova-compute[72766]:   </metadata>
Aug 14 23:17:41 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:17:41 user nova-compute[72766]:     <system>
Aug 14 23:17:41 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:17:41 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:17:41 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:17:41 user nova-compute[72766]:       <entry name="serial">f658f249-cb92-4fc1-b1fb-cb6925cf7e1c</entry>
Aug 14 23:17:41 user nova-compute[72766]:       <entry name="uuid">f658f249-cb92-4fc1-b1fb-cb6925cf7e1c</entry>
Aug 14 23:17:41 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:17:41 user nova-compute[72766]:     </system>
Aug 14 23:17:41 user nova-compute[72766]:   </sysinfo>
Aug 14 23:17:41 user nova-compute[72766]:   <os>
Aug 14 23:17:41 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:17:41 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:17:41 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:17:41 user nova-compute[72766]:   </os>
Aug 14 23:17:41 user nova-compute[72766]:   <features>
Aug 14 23:17:41 user nova-compute[72766]:     <acpi/>
Aug 14 23:17:41 user nova-compute[72766]:     <apic/>
Aug 14 23:17:41 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:17:41 user nova-compute[72766]:   </features>
Aug 14 23:17:41 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:17:41 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:17:41 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:17:41 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:17:41 user nova-compute[72766]:   </clock>
Aug 14 23:17:41 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:17:41 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:17:41 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:17:41 user nova-compute[72766]:   </cpu>
Aug 14 23:17:41 user nova-compute[72766]:   <devices>
Aug 14 23:17:41 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 23:17:41 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 23:17:41 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/f658f249-cb92-4fc1-b1fb-cb6925cf7e1c/disk"/>
Aug 14 23:17:41 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:17:41 user nova-compute[72766]:     </disk>
Aug 14 23:17:41 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:17:41 user nova-compute[72766]:       <mac address="fa:16:3e:e6:8a:ae"/>
Aug 14 23:17:41 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:17:41 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:17:41 user nova-compute[72766]:       <target dev="tap1fd62d5e-81"/>
Aug 14 23:17:41 user nova-compute[72766]:     </interface>
Aug 14 23:17:41 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:17:41 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/f658f249-cb92-4fc1-b1fb-cb6925cf7e1c/console.log" append="off"/>
Aug 14 23:17:41 user nova-compute[72766]:     </serial>
Aug 14 23:17:41 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:17:41 user nova-compute[72766]:     <video>
Aug 14 23:17:41 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:17:41 user nova-compute[72766]:     </video>
Aug 14 23:17:41 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:17:41 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:17:41 user nova-compute[72766]:     </rng>
Aug 14 23:17:41 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:17:41 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:17:41 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:17:41 user nova-compute[72766]:     </memballoon>
Aug 14 23:17:41 user nova-compute[72766]:   </devices>
Aug 14 23:17:41 user nova-compute[72766]: </domain>
Aug 14 23:17:41 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:17:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-124714953',display_name='tempest-AttachVolumeNegativeTest-server-124714953',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-124714953',id=34,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrRn6VM/NodMaXXlsqEjdmlXYxNoRhk02FHcFcLdqKqnHp5m2XSVm+/WhEBmEJ+jICRGE+e9+W/QBsRf/wWdpOkZe0RE6NOHzo9Sw5AvU5eZzq13+Tgc1PhqhXXmEDrVQ==',key_name='tempest-keypair-170593372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3785d8cff6cd41a4aff8becf528e3a4c',ramdisk_id='',reservation_id='r-wkfmniy8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1623363641',owner_user_name='tempest-AttachVolumeNegativeTest-1623363641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:17:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90e68d4dfd6048d99037fce632788b57',uuid=f658f249-cb92-4fc1-b1fb-cb6925cf7e1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80", "address": "fa:16:3e:e6:8a:ae", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd62d5e-81", "ovs_interfaceid": "1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Converting VIF {"id": "1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80", "address": "fa:16:3e:e6:8a:ae", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd62d5e-81", "ovs_interfaceid": "1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:8a:ae,bridge_name='br-int',has_traffic_filtering=True,id=1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80,network=Network(9491b8be-e6b2-4770-a591-370db9a96785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fd62d5e-81') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG os_vif [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:8a:ae,bridge_name='br-int',has_traffic_filtering=True,id=1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80,network=Network(9491b8be-e6b2-4770-a591-370db9a96785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fd62d5e-81') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1fd62d5e-81, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1fd62d5e-81, col_values=(('external_ids', {'iface-id': '1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:8a:ae', 'vm-uuid': 'f658f249-cb92-4fc1-b1fb-cb6925cf7e1c'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:17:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:41 user nova-compute[72766]: INFO os_vif [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:8a:ae,bridge_name='br-int',has_traffic_filtering=True,id=1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80,network=Network(9491b8be-e6b2-4770-a591-370db9a96785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fd62d5e-81')
Aug 14 23:17:42 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:17:42 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] No VIF found with MAC fa:16:3e:e6:8a:ae, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:17:42 user nova-compute[72766]: DEBUG nova.compute.manager [req-d53c8284-5a33-448c-b67c-44fbcf1ad861 req-dd645253-e092-48dd-8772-0b94d85882c3 service nova] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Received event network-changed-53e31c0d-29ff-4d0d-8f3a-6a08a69c927e {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:17:42 user nova-compute[72766]: DEBUG nova.compute.manager [req-d53c8284-5a33-448c-b67c-44fbcf1ad861 req-dd645253-e092-48dd-8772-0b94d85882c3 service nova] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Refreshing instance network info cache due to event network-changed-53e31c0d-29ff-4d0d-8f3a-6a08a69c927e. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:17:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d53c8284-5a33-448c-b67c-44fbcf1ad861 req-dd645253-e092-48dd-8772-0b94d85882c3 service nova] Acquiring lock "refresh_cache-9ec72ed8-0c33-4e70-ae88-d7571c84de2a" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:17:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d53c8284-5a33-448c-b67c-44fbcf1ad861 req-dd645253-e092-48dd-8772-0b94d85882c3 service nova] Acquired lock "refresh_cache-9ec72ed8-0c33-4e70-ae88-d7571c84de2a" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:17:42 user nova-compute[72766]: DEBUG nova.network.neutron [req-d53c8284-5a33-448c-b67c-44fbcf1ad861 req-dd645253-e092-48dd-8772-0b94d85882c3 service nova] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Refreshing network info cache for port 53e31c0d-29ff-4d0d-8f3a-6a08a69c927e {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:17:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-9c902fe1-defe-405c-bac4-5c9ca4f9fbcb tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Acquiring lock "9ec72ed8-0c33-4e70-ae88-d7571c84de2a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:17:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-9c902fe1-defe-405c-bac4-5c9ca4f9fbcb tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "9ec72ed8-0c33-4e70-ae88-d7571c84de2a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:17:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-9c902fe1-defe-405c-bac4-5c9ca4f9fbcb tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Acquiring lock "9ec72ed8-0c33-4e70-ae88-d7571c84de2a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:17:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-9c902fe1-defe-405c-bac4-5c9ca4f9fbcb tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "9ec72ed8-0c33-4e70-ae88-d7571c84de2a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:17:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-9c902fe1-defe-405c-bac4-5c9ca4f9fbcb tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "9ec72ed8-0c33-4e70-ae88-d7571c84de2a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:17:42 user nova-compute[72766]: INFO nova.compute.manager [None req-9c902fe1-defe-405c-bac4-5c9ca4f9fbcb tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Terminating instance
Aug 14 23:17:42 user nova-compute[72766]: DEBUG nova.compute.manager [None req-9c902fe1-defe-405c-bac4-5c9ca4f9fbcb tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:17:42 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:42 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:42 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:42 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:42 user nova-compute[72766]: DEBUG nova.network.neutron [req-d53c8284-5a33-448c-b67c-44fbcf1ad861 req-dd645253-e092-48dd-8772-0b94d85882c3 service nova] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Updated VIF entry in instance network info cache for port 53e31c0d-29ff-4d0d-8f3a-6a08a69c927e. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:17:42 user nova-compute[72766]: DEBUG nova.network.neutron [req-d53c8284-5a33-448c-b67c-44fbcf1ad861 req-dd645253-e092-48dd-8772-0b94d85882c3 service nova] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Updating instance_info_cache with network_info: [{"id": "53e31c0d-29ff-4d0d-8f3a-6a08a69c927e", "address": "fa:16:3e:ba:ba:ec", "network": {"id": "52ed808b-c840-47a7-aa8f-8055fd7bd1ef", "bridge": "br-int", "label": "tempest-TestStampPattern-1964150399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2329e260514d818d5af10aeeda498d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e31c0d-29", "ovs_interfaceid": "53e31c0d-29ff-4d0d-8f3a-6a08a69c927e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:17:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d53c8284-5a33-448c-b67c-44fbcf1ad861 req-dd645253-e092-48dd-8772-0b94d85882c3 service nova] Releasing lock "refresh_cache-9ec72ed8-0c33-4e70-ae88-d7571c84de2a" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:17:42 user nova-compute[72766]: DEBUG nova.network.neutron [req-e36284f7-8297-4763-91b3-21024e63411e req-b9a59cac-963f-435e-a5d2-9a3c3a1d04fd service nova] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Updated VIF entry in instance network info cache for port 1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:17:42 user nova-compute[72766]: DEBUG nova.network.neutron [req-e36284f7-8297-4763-91b3-21024e63411e req-b9a59cac-963f-435e-a5d2-9a3c3a1d04fd service nova] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Updating instance_info_cache with network_info: [{"id": "1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80", "address": "fa:16:3e:e6:8a:ae", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd62d5e-81", "ovs_interfaceid": "1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:17:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e36284f7-8297-4763-91b3-21024e63411e req-b9a59cac-963f-435e-a5d2-9a3c3a1d04fd service nova] Releasing lock "refresh_cache-f658f249-cb92-4fc1-b1fb-cb6925cf7e1c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:17:42 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:42 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:43 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Instance destroyed successfully.
Aug 14 23:17:43 user nova-compute[72766]: DEBUG nova.objects.instance [None req-9c902fe1-defe-405c-bac4-5c9ca4f9fbcb tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lazy-loading 'resources' on Instance uuid 9ec72ed8-0c33-4e70-ae88-d7571c84de2a {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:17:43 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-9c902fe1-defe-405c-bac4-5c9ca4f9fbcb tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:10:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1286106876',display_name='tempest-TestStampPattern-server-1286106876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1286106876',id=28,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpGwryUjtUrIoGUKk7UpA8gUykO9BhQbyJGpTNe51F8rSj8f9y24+iZRMzUrsprfERcHUFXZuW+wemEEJyvytSmT2p4zUjOXLeubfjibHmStVi+yhSgVVjf4UvXDmxC4g==',key_name='tempest-TestStampPattern-979334588',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:10:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc2329e260514d818d5af10aeeda498d',ramdisk_id='',reservation_id='r-33610i25',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1250368372',owner_user_name='tempest-TestStampPattern-1250368372-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:13:40Z,user_data=None,user_id='fff2f6e64733493f905c23b2e15d4161',uuid=9ec72ed8-0c33-4e70-ae88-d7571c84de2a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53e31c0d-29ff-4d0d-8f3a-6a08a69c927e", "address": "fa:16:3e:ba:ba:ec", "network": {"id": "52ed808b-c840-47a7-aa8f-8055fd7bd1ef", "bridge": "br-int", "label": "tempest-TestStampPattern-1964150399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2329e260514d818d5af10aeeda498d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e31c0d-29", "ovs_interfaceid": "53e31c0d-29ff-4d0d-8f3a-6a08a69c927e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:17:43 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-9c902fe1-defe-405c-bac4-5c9ca4f9fbcb tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Converting VIF {"id": "53e31c0d-29ff-4d0d-8f3a-6a08a69c927e", "address": "fa:16:3e:ba:ba:ec", "network": {"id": "52ed808b-c840-47a7-aa8f-8055fd7bd1ef", "bridge": "br-int", "label": "tempest-TestStampPattern-1964150399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2329e260514d818d5af10aeeda498d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e31c0d-29", "ovs_interfaceid": "53e31c0d-29ff-4d0d-8f3a-6a08a69c927e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:17:43 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-9c902fe1-defe-405c-bac4-5c9ca4f9fbcb tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:ba:ec,bridge_name='br-int',has_traffic_filtering=True,id=53e31c0d-29ff-4d0d-8f3a-6a08a69c927e,network=Network(52ed808b-c840-47a7-aa8f-8055fd7bd1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53e31c0d-29') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:17:43 user nova-compute[72766]: DEBUG os_vif [None req-9c902fe1-defe-405c-bac4-5c9ca4f9fbcb tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:ba:ec,bridge_name='br-int',has_traffic_filtering=True,id=53e31c0d-29ff-4d0d-8f3a-6a08a69c927e,network=Network(52ed808b-c840-47a7-aa8f-8055fd7bd1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53e31c0d-29') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:17:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53e31c0d-29, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:17:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:17:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:43 user nova-compute[72766]: INFO os_vif [None req-9c902fe1-defe-405c-bac4-5c9ca4f9fbcb tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:ba:ec,bridge_name='br-int',has_traffic_filtering=True,id=53e31c0d-29ff-4d0d-8f3a-6a08a69c927e,network=Network(52ed808b-c840-47a7-aa8f-8055fd7bd1ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53e31c0d-29')
Aug 14 23:17:43 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-9c902fe1-defe-405c-bac4-5c9ca4f9fbcb tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Deleting instance files /opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a_del
Aug 14 23:17:43 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-9c902fe1-defe-405c-bac4-5c9ca4f9fbcb tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Deletion of /opt/stack/data/nova/instances/9ec72ed8-0c33-4e70-ae88-d7571c84de2a_del complete
Aug 14 23:17:43 user nova-compute[72766]: INFO nova.compute.manager [None req-9c902fe1-defe-405c-bac4-5c9ca4f9fbcb tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Took 1.31 seconds to destroy the instance on the hypervisor.
Aug 14 23:17:43 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-9c902fe1-defe-405c-bac4-5c9ca4f9fbcb tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:17:43 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:17:43 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:17:43 user nova-compute[72766]: DEBUG nova.compute.manager [req-91a9f22a-7aa7-484c-9bf8-4eff39393200 req-9743871d-b011-45cc-a1ac-783809731e98 service nova] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Received event network-vif-unplugged-53e31c0d-29ff-4d0d-8f3a-6a08a69c927e {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:17:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-91a9f22a-7aa7-484c-9bf8-4eff39393200 req-9743871d-b011-45cc-a1ac-783809731e98 service nova] Acquiring lock "9ec72ed8-0c33-4e70-ae88-d7571c84de2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:17:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-91a9f22a-7aa7-484c-9bf8-4eff39393200 req-9743871d-b011-45cc-a1ac-783809731e98 service nova] Lock "9ec72ed8-0c33-4e70-ae88-d7571c84de2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:17:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-91a9f22a-7aa7-484c-9bf8-4eff39393200 req-9743871d-b011-45cc-a1ac-783809731e98 service nova] Lock "9ec72ed8-0c33-4e70-ae88-d7571c84de2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:17:43 user nova-compute[72766]: DEBUG nova.compute.manager [req-91a9f22a-7aa7-484c-9bf8-4eff39393200 req-9743871d-b011-45cc-a1ac-783809731e98 service nova] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] No waiting events found dispatching network-vif-unplugged-53e31c0d-29ff-4d0d-8f3a-6a08a69c927e {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:17:43 user nova-compute[72766]: DEBUG nova.compute.manager [req-91a9f22a-7aa7-484c-9bf8-4eff39393200 req-9743871d-b011-45cc-a1ac-783809731e98 service nova] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Received event network-vif-unplugged-53e31c0d-29ff-4d0d-8f3a-6a08a69c927e for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:17:43 user nova-compute[72766]: DEBUG nova.compute.manager [req-91a9f22a-7aa7-484c-9bf8-4eff39393200 req-9743871d-b011-45cc-a1ac-783809731e98 service nova] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Received event network-vif-plugged-53e31c0d-29ff-4d0d-8f3a-6a08a69c927e {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:17:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-91a9f22a-7aa7-484c-9bf8-4eff39393200 req-9743871d-b011-45cc-a1ac-783809731e98 service nova] Acquiring lock "9ec72ed8-0c33-4e70-ae88-d7571c84de2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:17:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-91a9f22a-7aa7-484c-9bf8-4eff39393200 req-9743871d-b011-45cc-a1ac-783809731e98 service nova] Lock "9ec72ed8-0c33-4e70-ae88-d7571c84de2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:17:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-91a9f22a-7aa7-484c-9bf8-4eff39393200 req-9743871d-b011-45cc-a1ac-783809731e98 service nova] Lock "9ec72ed8-0c33-4e70-ae88-d7571c84de2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:17:43 user nova-compute[72766]: DEBUG nova.compute.manager [req-91a9f22a-7aa7-484c-9bf8-4eff39393200 req-9743871d-b011-45cc-a1ac-783809731e98 service nova] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] No waiting events found dispatching network-vif-plugged-53e31c0d-29ff-4d0d-8f3a-6a08a69c927e {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:17:43 user nova-compute[72766]: WARNING nova.compute.manager [req-91a9f22a-7aa7-484c-9bf8-4eff39393200 req-9743871d-b011-45cc-a1ac-783809731e98 service nova] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Received unexpected event network-vif-plugged-53e31c0d-29ff-4d0d-8f3a-6a08a69c927e for instance with vm_state active and task_state deleting.
Aug 14 23:17:43 user nova-compute[72766]: DEBUG nova.compute.manager [req-91a9f22a-7aa7-484c-9bf8-4eff39393200 req-9743871d-b011-45cc-a1ac-783809731e98 service nova] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Received event network-vif-plugged-53e31c0d-29ff-4d0d-8f3a-6a08a69c927e {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:17:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-91a9f22a-7aa7-484c-9bf8-4eff39393200 req-9743871d-b011-45cc-a1ac-783809731e98 service nova] Acquiring lock "9ec72ed8-0c33-4e70-ae88-d7571c84de2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:17:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-91a9f22a-7aa7-484c-9bf8-4eff39393200 req-9743871d-b011-45cc-a1ac-783809731e98 service nova] Lock "9ec72ed8-0c33-4e70-ae88-d7571c84de2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:17:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-91a9f22a-7aa7-484c-9bf8-4eff39393200 req-9743871d-b011-45cc-a1ac-783809731e98 service nova] Lock "9ec72ed8-0c33-4e70-ae88-d7571c84de2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:17:43 user nova-compute[72766]: DEBUG nova.compute.manager [req-91a9f22a-7aa7-484c-9bf8-4eff39393200 req-9743871d-b011-45cc-a1ac-783809731e98 service nova] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] No waiting events found dispatching network-vif-plugged-53e31c0d-29ff-4d0d-8f3a-6a08a69c927e {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:17:43 user nova-compute[72766]: WARNING nova.compute.manager [req-91a9f22a-7aa7-484c-9bf8-4eff39393200 req-9743871d-b011-45cc-a1ac-783809731e98 service nova] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Received unexpected event network-vif-plugged-53e31c0d-29ff-4d0d-8f3a-6a08a69c927e for instance with vm_state active and task_state deleting.
Aug 14 23:17:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:44 user nova-compute[72766]: DEBUG nova.compute.manager [req-c171a2e1-92d1-4b6a-97dc-d86b33d87b35 req-171ab316-7f29-49a8-8731-5c259a9fe125 service nova] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Received event network-vif-plugged-1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:17:44 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-c171a2e1-92d1-4b6a-97dc-d86b33d87b35 req-171ab316-7f29-49a8-8731-5c259a9fe125 service nova] Acquiring lock "f658f249-cb92-4fc1-b1fb-cb6925cf7e1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:17:44 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-c171a2e1-92d1-4b6a-97dc-d86b33d87b35 req-171ab316-7f29-49a8-8731-5c259a9fe125 service nova] Lock "f658f249-cb92-4fc1-b1fb-cb6925cf7e1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:17:44 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-c171a2e1-92d1-4b6a-97dc-d86b33d87b35 req-171ab316-7f29-49a8-8731-5c259a9fe125 service nova] Lock "f658f249-cb92-4fc1-b1fb-cb6925cf7e1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:17:44 user nova-compute[72766]: DEBUG nova.compute.manager [req-c171a2e1-92d1-4b6a-97dc-d86b33d87b35 req-171ab316-7f29-49a8-8731-5c259a9fe125 service nova] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] No waiting events found dispatching network-vif-plugged-1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:17:44 user nova-compute[72766]: WARNING nova.compute.manager [req-c171a2e1-92d1-4b6a-97dc-d86b33d87b35 req-171ab316-7f29-49a8-8731-5c259a9fe125 service nova] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Received unexpected event network-vif-plugged-1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80 for instance with vm_state building and task_state spawning.
Aug 14 23:17:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:44 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:17:44 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Took 1.41 seconds to deallocate network for instance.
Aug 14 23:17:44 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-9c902fe1-defe-405c-bac4-5c9ca4f9fbcb tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:17:44 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-9c902fe1-defe-405c-bac4-5c9ca4f9fbcb tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:17:45 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-9c902fe1-defe-405c-bac4-5c9ca4f9fbcb tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:17:45 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-9c902fe1-defe-405c-bac4-5c9ca4f9fbcb tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:17:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-9c902fe1-defe-405c-bac4-5c9ca4f9fbcb tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.268s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:17:45 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-9c902fe1-defe-405c-bac4-5c9ca4f9fbcb tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Deleted allocations for instance 9ec72ed8-0c33-4e70-ae88-d7571c84de2a
Aug 14 23:17:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-9c902fe1-defe-405c-bac4-5c9ca4f9fbcb tempest-TestStampPattern-1250368372 tempest-TestStampPattern-1250368372-project-member] Lock "9ec72ed8-0c33-4e70-ae88-d7571c84de2a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.223s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:17:45 user nova-compute[72766]: DEBUG nova.compute.manager [req-be37a31d-6aac-4a07-8a7e-a156df6ca908 req-ad8700dc-2259-4b71-9097-21000b64a044 service nova] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Received event network-vif-plugged-53e31c0d-29ff-4d0d-8f3a-6a08a69c927e {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:17:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-be37a31d-6aac-4a07-8a7e-a156df6ca908 req-ad8700dc-2259-4b71-9097-21000b64a044 service nova] Acquiring lock "9ec72ed8-0c33-4e70-ae88-d7571c84de2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:17:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-be37a31d-6aac-4a07-8a7e-a156df6ca908 req-ad8700dc-2259-4b71-9097-21000b64a044 service nova] Lock "9ec72ed8-0c33-4e70-ae88-d7571c84de2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:17:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-be37a31d-6aac-4a07-8a7e-a156df6ca908 req-ad8700dc-2259-4b71-9097-21000b64a044 service nova] Lock "9ec72ed8-0c33-4e70-ae88-d7571c84de2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:17:45 user nova-compute[72766]: DEBUG nova.compute.manager [req-be37a31d-6aac-4a07-8a7e-a156df6ca908 req-ad8700dc-2259-4b71-9097-21000b64a044 service nova] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] No waiting events found dispatching network-vif-plugged-53e31c0d-29ff-4d0d-8f3a-6a08a69c927e {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:17:45 user nova-compute[72766]: WARNING nova.compute.manager [req-be37a31d-6aac-4a07-8a7e-a156df6ca908 req-ad8700dc-2259-4b71-9097-21000b64a044 service nova] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Received unexpected event network-vif-plugged-53e31c0d-29ff-4d0d-8f3a-6a08a69c927e for instance with vm_state deleted and task_state None.
Aug 14 23:17:45 user nova-compute[72766]: DEBUG nova.compute.manager [req-be37a31d-6aac-4a07-8a7e-a156df6ca908 req-ad8700dc-2259-4b71-9097-21000b64a044 service nova] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Received event network-vif-unplugged-53e31c0d-29ff-4d0d-8f3a-6a08a69c927e {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:17:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-be37a31d-6aac-4a07-8a7e-a156df6ca908 req-ad8700dc-2259-4b71-9097-21000b64a044 service nova] Acquiring lock "9ec72ed8-0c33-4e70-ae88-d7571c84de2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:17:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-be37a31d-6aac-4a07-8a7e-a156df6ca908 req-ad8700dc-2259-4b71-9097-21000b64a044 service nova] Lock "9ec72ed8-0c33-4e70-ae88-d7571c84de2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:17:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-be37a31d-6aac-4a07-8a7e-a156df6ca908 req-ad8700dc-2259-4b71-9097-21000b64a044 service nova] Lock "9ec72ed8-0c33-4e70-ae88-d7571c84de2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:17:45 user nova-compute[72766]: DEBUG nova.compute.manager [req-be37a31d-6aac-4a07-8a7e-a156df6ca908 req-ad8700dc-2259-4b71-9097-21000b64a044 service nova] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] No waiting events found dispatching network-vif-unplugged-53e31c0d-29ff-4d0d-8f3a-6a08a69c927e {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:17:45 user nova-compute[72766]: WARNING nova.compute.manager [req-be37a31d-6aac-4a07-8a7e-a156df6ca908 req-ad8700dc-2259-4b71-9097-21000b64a044 service nova] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Received unexpected event network-vif-unplugged-53e31c0d-29ff-4d0d-8f3a-6a08a69c927e for instance with vm_state deleted and task_state None.
Aug 14 23:17:45 user nova-compute[72766]: DEBUG nova.compute.manager [req-be37a31d-6aac-4a07-8a7e-a156df6ca908 req-ad8700dc-2259-4b71-9097-21000b64a044 service nova] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Received event network-vif-plugged-53e31c0d-29ff-4d0d-8f3a-6a08a69c927e {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:17:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-be37a31d-6aac-4a07-8a7e-a156df6ca908 req-ad8700dc-2259-4b71-9097-21000b64a044 service nova] Acquiring lock "9ec72ed8-0c33-4e70-ae88-d7571c84de2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:17:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-be37a31d-6aac-4a07-8a7e-a156df6ca908 req-ad8700dc-2259-4b71-9097-21000b64a044 service nova] Lock "9ec72ed8-0c33-4e70-ae88-d7571c84de2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:17:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-be37a31d-6aac-4a07-8a7e-a156df6ca908 req-ad8700dc-2259-4b71-9097-21000b64a044 service nova] Lock "9ec72ed8-0c33-4e70-ae88-d7571c84de2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:17:45 user nova-compute[72766]: DEBUG nova.compute.manager [req-be37a31d-6aac-4a07-8a7e-a156df6ca908 req-ad8700dc-2259-4b71-9097-21000b64a044 service nova] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] No waiting events found dispatching network-vif-plugged-53e31c0d-29ff-4d0d-8f3a-6a08a69c927e {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:17:45 user nova-compute[72766]: WARNING nova.compute.manager [req-be37a31d-6aac-4a07-8a7e-a156df6ca908 req-ad8700dc-2259-4b71-9097-21000b64a044 service nova] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Received unexpected event network-vif-plugged-53e31c0d-29ff-4d0d-8f3a-6a08a69c927e for instance with vm_state deleted and task_state None.
Aug 14 23:17:45 user nova-compute[72766]: DEBUG nova.compute.manager [req-be37a31d-6aac-4a07-8a7e-a156df6ca908 req-ad8700dc-2259-4b71-9097-21000b64a044 service nova] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Received event network-vif-deleted-53e31c0d-29ff-4d0d-8f3a-6a08a69c927e {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:17:45 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692055065.8523686, f658f249-cb92-4fc1-b1fb-cb6925cf7e1c => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:17:45 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] VM Resumed (Lifecycle Event)
Aug 14 23:17:45 user nova-compute[72766]: DEBUG nova.compute.manager [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:17:45 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 23:17:45 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Instance spawned successfully.
Aug 14 23:17:45 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 23:17:45 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:17:45 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:17:45 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:17:45 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:17:45 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:17:45 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:17:45 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:17:45 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:17:45 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:17:45 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692055065.8535044, f658f249-cb92-4fc1-b1fb-cb6925cf7e1c => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:17:45 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] VM Started (Lifecycle Event)
Aug 14 23:17:45 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:17:45 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:17:45 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:17:45 user nova-compute[72766]: INFO nova.compute.manager [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Took 6.02 seconds to spawn the instance on the hypervisor.
Aug 14 23:17:45 user nova-compute[72766]: DEBUG nova.compute.manager [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:17:46 user nova-compute[72766]: INFO nova.compute.manager [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Took 6.72 seconds to build instance.
Aug 14 23:17:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a91eb558-8f6e-42cb-a577-de55ae18019c tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "f658f249-cb92-4fc1-b1fb-cb6925cf7e1c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.816s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:17:46 user nova-compute[72766]: DEBUG nova.compute.manager [req-be8d3580-4ec3-4cd4-8f99-4685cfb8c024 req-3700c4ed-537c-4cb7-b559-2df39884db0b service nova] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Received event network-vif-plugged-1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:17:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-be8d3580-4ec3-4cd4-8f99-4685cfb8c024 req-3700c4ed-537c-4cb7-b559-2df39884db0b service nova] Acquiring lock "f658f249-cb92-4fc1-b1fb-cb6925cf7e1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:17:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-be8d3580-4ec3-4cd4-8f99-4685cfb8c024 req-3700c4ed-537c-4cb7-b559-2df39884db0b service nova] Lock "f658f249-cb92-4fc1-b1fb-cb6925cf7e1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:17:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-be8d3580-4ec3-4cd4-8f99-4685cfb8c024 req-3700c4ed-537c-4cb7-b559-2df39884db0b service nova] Lock "f658f249-cb92-4fc1-b1fb-cb6925cf7e1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:17:46 user nova-compute[72766]: DEBUG nova.compute.manager [req-be8d3580-4ec3-4cd4-8f99-4685cfb8c024 req-3700c4ed-537c-4cb7-b559-2df39884db0b service nova] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] No waiting events found dispatching network-vif-plugged-1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:17:46 user nova-compute[72766]: WARNING nova.compute.manager [req-be8d3580-4ec3-4cd4-8f99-4685cfb8c024 req-3700c4ed-537c-4cb7-b559-2df39884db0b service nova] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Received unexpected event network-vif-plugged-1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80 for instance with vm_state active and task_state None.
Aug 14 23:17:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:58 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692055063.3644557, 9ec72ed8-0c33-4e70-ae88-d7571c84de2a => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:17:58 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] VM Stopped (Lifecycle Event)
Aug 14 23:17:58 user nova-compute[72766]: DEBUG nova.compute.manager [None req-40bb59c5-5fc9-4522-bcf3-e47939e1f382 None None] [instance: 9ec72ed8-0c33-4e70-ae88-d7571c84de2a] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:17:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:17:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:18:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:18:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:18:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:18:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:18:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:18:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-40886754-88ff-4d5d-8637-5cab546213db tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "71970b47-b09b-4492-9d99-a2be8b3b2042" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:18:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-40886754-88ff-4d5d-8637-5cab546213db tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "71970b47-b09b-4492-9d99-a2be8b3b2042" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:18:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-40886754-88ff-4d5d-8637-5cab546213db tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "71970b47-b09b-4492-9d99-a2be8b3b2042-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:18:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-40886754-88ff-4d5d-8637-5cab546213db tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "71970b47-b09b-4492-9d99-a2be8b3b2042-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:18:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-40886754-88ff-4d5d-8637-5cab546213db tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "71970b47-b09b-4492-9d99-a2be8b3b2042-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:18:12 user nova-compute[72766]: INFO nova.compute.manager [None req-40886754-88ff-4d5d-8637-5cab546213db tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Terminating instance
Aug 14 23:18:12 user nova-compute[72766]: DEBUG nova.compute.manager [None req-40886754-88ff-4d5d-8637-5cab546213db tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:18:12 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:18:12 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:18:12 user nova-compute[72766]: DEBUG nova.compute.manager [req-d4314c63-c2a8-45b8-b51a-cd7b7a8b614f req-498c8f06-cad1-46aa-a76f-b3665afc6df4 service nova] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Received event network-vif-unplugged-aa623ac3-2e29-46fc-aa95-d6e6e2404758 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:18:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d4314c63-c2a8-45b8-b51a-cd7b7a8b614f req-498c8f06-cad1-46aa-a76f-b3665afc6df4 service nova] Acquiring lock "71970b47-b09b-4492-9d99-a2be8b3b2042-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:18:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d4314c63-c2a8-45b8-b51a-cd7b7a8b614f req-498c8f06-cad1-46aa-a76f-b3665afc6df4 service nova] Lock "71970b47-b09b-4492-9d99-a2be8b3b2042-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:18:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d4314c63-c2a8-45b8-b51a-cd7b7a8b614f req-498c8f06-cad1-46aa-a76f-b3665afc6df4 service nova] Lock "71970b47-b09b-4492-9d99-a2be8b3b2042-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:18:12 user nova-compute[72766]: DEBUG nova.compute.manager [req-d4314c63-c2a8-45b8-b51a-cd7b7a8b614f req-498c8f06-cad1-46aa-a76f-b3665afc6df4 service nova] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] No waiting events found dispatching network-vif-unplugged-aa623ac3-2e29-46fc-aa95-d6e6e2404758 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:18:12 user nova-compute[72766]: DEBUG nova.compute.manager [req-d4314c63-c2a8-45b8-b51a-cd7b7a8b614f req-498c8f06-cad1-46aa-a76f-b3665afc6df4 service nova] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Received event network-vif-unplugged-aa623ac3-2e29-46fc-aa95-d6e6e2404758 for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:18:12 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:18:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:18:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:18:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:18:13 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Instance destroyed successfully.
Aug 14 23:18:13 user nova-compute[72766]: DEBUG nova.objects.instance [None req-40886754-88ff-4d5d-8637-5cab546213db tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lazy-loading 'resources' on Instance uuid 71970b47-b09b-4492-9d99-a2be8b3b2042 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:18:13 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-40886754-88ff-4d5d-8637-5cab546213db tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:08:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1355436982',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1355436982',id=27,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:08:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3725c4b1cd78403f9628c8af9f8e5cc5',ramdisk_id='',reservation_id='r-6wxiswgq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-86235447',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:10:47Z,user_data=None,user_id='32e61321c50d4af28adeab72811a3f86',uuid=71970b47-b09b-4492-9d99-a2be8b3b2042,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa623ac3-2e29-46fc-aa95-d6e6e2404758", "address": "fa:16:3e:3b:e1:a4", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa623ac3-2e", "ovs_interfaceid": "aa623ac3-2e29-46fc-aa95-d6e6e2404758", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:18:13 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-40886754-88ff-4d5d-8637-5cab546213db tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Converting VIF {"id": "aa623ac3-2e29-46fc-aa95-d6e6e2404758", "address": "fa:16:3e:3b:e1:a4", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa623ac3-2e", "ovs_interfaceid": "aa623ac3-2e29-46fc-aa95-d6e6e2404758", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:18:13 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-40886754-88ff-4d5d-8637-5cab546213db tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:e1:a4,bridge_name='br-int',has_traffic_filtering=True,id=aa623ac3-2e29-46fc-aa95-d6e6e2404758,network=Network(f4efdeee-d89b-45e5-b0d9-b45573564e9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa623ac3-2e') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:18:13 user nova-compute[72766]: DEBUG os_vif [None req-40886754-88ff-4d5d-8637-5cab546213db tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:e1:a4,bridge_name='br-int',has_traffic_filtering=True,id=aa623ac3-2e29-46fc-aa95-d6e6e2404758,network=Network(f4efdeee-d89b-45e5-b0d9-b45573564e9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa623ac3-2e') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:18:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:18:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa623ac3-2e, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:18:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:18:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:18:13 user nova-compute[72766]: INFO os_vif [None req-40886754-88ff-4d5d-8637-5cab546213db tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:e1:a4,bridge_name='br-int',has_traffic_filtering=True,id=aa623ac3-2e29-46fc-aa95-d6e6e2404758,network=Network(f4efdeee-d89b-45e5-b0d9-b45573564e9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa623ac3-2e')
Aug 14 23:18:13 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-40886754-88ff-4d5d-8637-5cab546213db tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Deleting instance files /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042_del
Aug 14 23:18:13 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-40886754-88ff-4d5d-8637-5cab546213db tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Deletion of /opt/stack/data/nova/instances/71970b47-b09b-4492-9d99-a2be8b3b2042_del complete
Aug 14 23:18:13 user nova-compute[72766]: INFO nova.compute.manager [None req-40886754-88ff-4d5d-8637-5cab546213db tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Took 0.65 seconds to destroy the instance on the hypervisor.
Aug 14 23:18:13 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-40886754-88ff-4d5d-8637-5cab546213db tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:18:13 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:18:13 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:18:13 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:18:13 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Took 0.44 seconds to deallocate network for instance.
Aug 14 23:18:13 user nova-compute[72766]: DEBUG nova.compute.manager [req-4f5497bb-c04a-4e3f-ad95-c85c4b3d4813 req-e454244d-4217-40a7-89f3-a7101f944dc1 service nova] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Received event network-vif-deleted-aa623ac3-2e29-46fc-aa95-d6e6e2404758 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:18:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-40886754-88ff-4d5d-8637-5cab546213db tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:18:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-40886754-88ff-4d5d-8637-5cab546213db tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:18:13 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-40886754-88ff-4d5d-8637-5cab546213db tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:18:13 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-40886754-88ff-4d5d-8637-5cab546213db tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:18:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-40886754-88ff-4d5d-8637-5cab546213db tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.205s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:18:14 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-40886754-88ff-4d5d-8637-5cab546213db tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Deleted allocations for instance 71970b47-b09b-4492-9d99-a2be8b3b2042
Aug 14 23:18:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-40886754-88ff-4d5d-8637-5cab546213db tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "71970b47-b09b-4492-9d99-a2be8b3b2042" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.545s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:18:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:18:15 user nova-compute[72766]: DEBUG nova.compute.manager [req-02fd3dcd-9835-4c39-a989-350eb0808eea req-b09c737f-e5d1-42e4-8115-21da8859c317 service nova] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Received event network-vif-plugged-aa623ac3-2e29-46fc-aa95-d6e6e2404758 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:18:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-02fd3dcd-9835-4c39-a989-350eb0808eea req-b09c737f-e5d1-42e4-8115-21da8859c317 service nova] Acquiring lock "71970b47-b09b-4492-9d99-a2be8b3b2042-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:18:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-02fd3dcd-9835-4c39-a989-350eb0808eea req-b09c737f-e5d1-42e4-8115-21da8859c317 service nova] Lock "71970b47-b09b-4492-9d99-a2be8b3b2042-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:18:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-02fd3dcd-9835-4c39-a989-350eb0808eea req-b09c737f-e5d1-42e4-8115-21da8859c317 service nova] Lock "71970b47-b09b-4492-9d99-a2be8b3b2042-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:18:15 user nova-compute[72766]: DEBUG nova.compute.manager [req-02fd3dcd-9835-4c39-a989-350eb0808eea req-b09c737f-e5d1-42e4-8115-21da8859c317 service nova] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] No waiting events found dispatching network-vif-plugged-aa623ac3-2e29-46fc-aa95-d6e6e2404758 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:18:15 user nova-compute[72766]: WARNING nova.compute.manager [req-02fd3dcd-9835-4c39-a989-350eb0808eea req-b09c737f-e5d1-42e4-8115-21da8859c317 service nova] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Received unexpected event network-vif-plugged-aa623ac3-2e29-46fc-aa95-d6e6e2404758 for instance with vm_state deleted and task_state None.
Aug 14 23:18:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:18:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:18:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:18:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:18:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:18:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:18:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:18:28 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692055093.2030683, 71970b47-b09b-4492-9d99-a2be8b3b2042 => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:18:28 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] VM Stopped (Lifecycle Event)
Aug 14 23:18:28 user nova-compute[72766]: DEBUG nova.compute.manager [None req-6a48ebba-811d-4768-b7d2-4edcb4997238 None None] [instance: 71970b47-b09b-4492-9d99-a2be8b3b2042] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:18:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:18:30 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:18:30 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:18:30 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Didn't find any instances for network info cache update. {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 23:18:32 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:18:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:18:33 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:18:33 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:18:33 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:18:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:18:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:18:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:18:33 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:18:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:18:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:18:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:18:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:18:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:18:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f658f249-cb92-4fc1-b1fb-cb6925cf7e1c/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:18:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f658f249-cb92-4fc1-b1fb-cb6925cf7e1c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:18:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f658f249-cb92-4fc1-b1fb-cb6925cf7e1c/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:18:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f658f249-cb92-4fc1-b1fb-cb6925cf7e1c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:18:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:18:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:18:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:18:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:18:35 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:18:35 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:18:35 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=8382MB free_disk=25.289447784423828GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:18:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:18:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:18:35 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 3ff300ff-34fd-4e94-9d2d-681fb133ba32 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:18:35 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance cbcf7851-e6f7-4f46-97cc-d773286ccddf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:18:35 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 83084ccc-8e55-43dc-9a37-ffcb35a10922 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:18:35 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance f658f249-cb92-4fc1-b1fb-cb6925cf7e1c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:18:35 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:18:35 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:18:35 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:18:35 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:18:35 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:18:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.306s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:18:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:18:39 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:18:39 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:18:39 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:18:39 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:18:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:18:42 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:18:42 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:18:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:18:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:18:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:18:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:18:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:18:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:18:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:18:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:18:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:18:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:00 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "83084ccc-8e55-43dc-9a37-ffcb35a10922" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:19:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "83084ccc-8e55-43dc-9a37-ffcb35a10922" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:19:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "83084ccc-8e55-43dc-9a37-ffcb35a10922-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:19:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "83084ccc-8e55-43dc-9a37-ffcb35a10922-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:19:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "83084ccc-8e55-43dc-9a37-ffcb35a10922-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:19:03 user nova-compute[72766]: INFO nova.compute.manager [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Terminating instance
Aug 14 23:19:03 user nova-compute[72766]: DEBUG nova.compute.manager [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:19:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:03 user nova-compute[72766]: DEBUG nova.compute.manager [req-53667613-5a3e-417b-bf32-f9fac38a369f req-84c3afe5-c453-41cc-bd71-d3bb81f88964 service nova] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Received event network-vif-unplugged-cbbf0086-17e4-41a5-8893-cf8657faf6e5 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:19:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-53667613-5a3e-417b-bf32-f9fac38a369f req-84c3afe5-c453-41cc-bd71-d3bb81f88964 service nova] Acquiring lock "83084ccc-8e55-43dc-9a37-ffcb35a10922-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:19:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-53667613-5a3e-417b-bf32-f9fac38a369f req-84c3afe5-c453-41cc-bd71-d3bb81f88964 service nova] Lock "83084ccc-8e55-43dc-9a37-ffcb35a10922-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:19:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-53667613-5a3e-417b-bf32-f9fac38a369f req-84c3afe5-c453-41cc-bd71-d3bb81f88964 service nova] Lock "83084ccc-8e55-43dc-9a37-ffcb35a10922-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:19:03 user nova-compute[72766]: DEBUG nova.compute.manager [req-53667613-5a3e-417b-bf32-f9fac38a369f req-84c3afe5-c453-41cc-bd71-d3bb81f88964 service nova] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] No waiting events found dispatching network-vif-unplugged-cbbf0086-17e4-41a5-8893-cf8657faf6e5 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:19:03 user nova-compute[72766]: DEBUG nova.compute.manager [req-53667613-5a3e-417b-bf32-f9fac38a369f req-84c3afe5-c453-41cc-bd71-d3bb81f88964 service nova] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Received event network-vif-unplugged-cbbf0086-17e4-41a5-8893-cf8657faf6e5 for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:19:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:03 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Instance destroyed successfully.
Aug 14 23:19:03 user nova-compute[72766]: DEBUG nova.objects.instance [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lazy-loading 'resources' on Instance uuid 83084ccc-8e55-43dc-9a37-ffcb35a10922 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:19:03 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:03:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1775402070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1775402070',id=22,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:05:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3725c4b1cd78403f9628c8af9f8e5cc5',ramdisk_id='',reservation_id='r-0ruzrjdf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-86235447',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:07:03Z,user_data=None,user_id='32e61321c50d4af28adeab72811a3f86',uuid=83084ccc-8e55-43dc-9a37-ffcb35a10922,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cbbf0086-17e4-41a5-8893-cf8657faf6e5", "address": "fa:16:3e:22:4b:22", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbbf0086-17", "ovs_interfaceid": "cbbf0086-17e4-41a5-8893-cf8657faf6e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:19:03 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Converting VIF {"id": "cbbf0086-17e4-41a5-8893-cf8657faf6e5", "address": "fa:16:3e:22:4b:22", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbbf0086-17", "ovs_interfaceid": "cbbf0086-17e4-41a5-8893-cf8657faf6e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:19:03 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:4b:22,bridge_name='br-int',has_traffic_filtering=True,id=cbbf0086-17e4-41a5-8893-cf8657faf6e5,network=Network(f4efdeee-d89b-45e5-b0d9-b45573564e9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbbf0086-17') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:19:03 user nova-compute[72766]: DEBUG os_vif [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:4b:22,bridge_name='br-int',has_traffic_filtering=True,id=cbbf0086-17e4-41a5-8893-cf8657faf6e5,network=Network(f4efdeee-d89b-45e5-b0d9-b45573564e9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbbf0086-17') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcbbf0086-17, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:04 user nova-compute[72766]: INFO os_vif [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:4b:22,bridge_name='br-int',has_traffic_filtering=True,id=cbbf0086-17e4-41a5-8893-cf8657faf6e5,network=Network(f4efdeee-d89b-45e5-b0d9-b45573564e9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbbf0086-17')
Aug 14 23:19:04 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JEHjDmsq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:19:04 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:19:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c1d734-3ef1-46bc-8e29-3445712372fb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac864e1-8a76-4b0e-aeb2-2f65cefc9d0f]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:19:04 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 (non-flash)
Aug 14 23:19:04 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff1741723b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966'): ({'sdf'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Removing single pathed devices sdf {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ace9c0-ec26-49cd-b940-3d6c16c9cc9b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e882f00f-98ea-452a-a7e2-442a598e6c3c]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Flushing IO for device /dev/sdf {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10205bf-2eb8-4cd5-927d-993a987c1517]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.069s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a19d24c-8397-42b3-a10f-2a537f8eda6e]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] SCSI volumes sdf have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ada75a-2bdf-4781-afc3-5f4646e0be18]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab9d18c-36b3-4046-9cdf-1e6fd6d9b3dd]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966, portal: 172.16.0.220,3260]
Aug 14 23:19:04 user nova-compute[72766]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966, portal: 172.16.0.220,3260] successful.
Aug 14 23:19:04 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c69b0c70-6633-43aa-bc9e-d46f033b8966 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54e6be9-0c49-408e-8e4f-dfc21a5cda6d]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] <== disconnect_volume: return (315ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:19:04 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Deleting instance files /opt/stack/data/nova/instances/83084ccc-8e55-43dc-9a37-ffcb35a10922_del
Aug 14 23:19:04 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Deletion of /opt/stack/data/nova/instances/83084ccc-8e55-43dc-9a37-ffcb35a10922_del complete
Aug 14 23:19:04 user nova-compute[72766]: INFO nova.compute.manager [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 14 23:19:04 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:19:04 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:19:05 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Took 0.57 seconds to deallocate network for instance.
Aug 14 23:19:05 user nova-compute[72766]: DEBUG nova.compute.manager [req-5424e42d-2a6b-41e4-a61d-c9205d1a1892 req-2f008e47-9cf5-441c-aee4-500885bfb001 service nova] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Received event network-vif-deleted-cbbf0086-17e4-41a5-8893-cf8657faf6e5 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:19:05 user nova-compute[72766]: INFO nova.compute.manager [req-5424e42d-2a6b-41e4-a61d-c9205d1a1892 req-2f008e47-9cf5-441c-aee4-500885bfb001 service nova] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Neutron deleted interface cbbf0086-17e4-41a5-8893-cf8657faf6e5; detaching it from the instance and deleting it from the info cache
Aug 14 23:19:05 user nova-compute[72766]: DEBUG nova.network.neutron [req-5424e42d-2a6b-41e4-a61d-c9205d1a1892 req-2f008e47-9cf5-441c-aee4-500885bfb001 service nova] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:19:05 user nova-compute[72766]: DEBUG nova.compute.manager [req-5424e42d-2a6b-41e4-a61d-c9205d1a1892 req-2f008e47-9cf5-441c-aee4-500885bfb001 service nova] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Detach interface failed, port_id=cbbf0086-17e4-41a5-8893-cf8657faf6e5, reason: Instance 83084ccc-8e55-43dc-9a37-ffcb35a10922 could not be found. {{(pid=72766) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 23:19:05 user nova-compute[72766]: DEBUG nova.compute.manager [req-63cc43f0-7840-4cf4-8b93-155adc872e2e req-ce1e3731-48bc-44da-9308-1af7e0657256 service nova] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Received event network-vif-plugged-cbbf0086-17e4-41a5-8893-cf8657faf6e5 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:19:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-63cc43f0-7840-4cf4-8b93-155adc872e2e req-ce1e3731-48bc-44da-9308-1af7e0657256 service nova] Acquiring lock "83084ccc-8e55-43dc-9a37-ffcb35a10922-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:19:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-63cc43f0-7840-4cf4-8b93-155adc872e2e req-ce1e3731-48bc-44da-9308-1af7e0657256 service nova] Lock "83084ccc-8e55-43dc-9a37-ffcb35a10922-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:19:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-63cc43f0-7840-4cf4-8b93-155adc872e2e req-ce1e3731-48bc-44da-9308-1af7e0657256 service nova] Lock "83084ccc-8e55-43dc-9a37-ffcb35a10922-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:19:05 user nova-compute[72766]: DEBUG nova.compute.manager [req-63cc43f0-7840-4cf4-8b93-155adc872e2e req-ce1e3731-48bc-44da-9308-1af7e0657256 service nova] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] No waiting events found dispatching network-vif-plugged-cbbf0086-17e4-41a5-8893-cf8657faf6e5 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:19:05 user nova-compute[72766]: WARNING nova.compute.manager [req-63cc43f0-7840-4cf4-8b93-155adc872e2e req-ce1e3731-48bc-44da-9308-1af7e0657256 service nova] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Received unexpected event network-vif-plugged-cbbf0086-17e4-41a5-8893-cf8657faf6e5 for instance with vm_state active and task_state deleting.
Aug 14 23:19:05 user nova-compute[72766]: INFO nova.compute.manager [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Took 0.92 seconds to detach 1 volumes for instance.
Aug 14 23:19:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:19:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:19:06 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:19:06 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:19:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.231s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:19:06 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Deleted allocations for instance 83084ccc-8e55-43dc-9a37-ffcb35a10922
Aug 14 23:19:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b7507e28-413e-44f7-89a4-e3f9c5bbf70d tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "83084ccc-8e55-43dc-9a37-ffcb35a10922" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.123s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:19:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "b913283d-2446-432b-9c59-9d0e91bb5309" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:19:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "b913283d-2446-432b-9c59-9d0e91bb5309" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:19:18 user nova-compute[72766]: DEBUG nova.compute.manager [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 23:19:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:19:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:19:18 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 23:19:18 user nova-compute[72766]: INFO nova.compute.claims [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Claim successful on node user
Aug 14 23:19:18 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:19:18 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:19:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.265s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:19:18 user nova-compute[72766]: DEBUG nova.compute.manager [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 23:19:18 user nova-compute[72766]: DEBUG nova.compute.manager [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 23:19:18 user nova-compute[72766]: DEBUG nova.network.neutron [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 23:19:18 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 23:19:18 user nova-compute[72766]: DEBUG nova.compute.manager [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 23:19:18 user nova-compute[72766]: INFO nova.virt.block_device [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Booting with volume snapshot 4cf430d5-b645-43aa-9eb6-e8960e92f27f at /dev/vda
Aug 14 23:19:18 user nova-compute[72766]: DEBUG nova.policy [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '999390ac8e6240199c9a7484e234f3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c9f53727cc497c94516ff7fa1bbf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 23:19:18 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692055143.9744012, 83084ccc-8e55-43dc-9a37-ffcb35a10922 => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:19:18 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] VM Stopped (Lifecycle Event)
Aug 14 23:19:18 user nova-compute[72766]: DEBUG nova.compute.manager [None req-fe501204-d87e-4438-a0a8-1a4e573baaa5 None None] [instance: 83084ccc-8e55-43dc-9a37-ffcb35a10922] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:19:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:19 user nova-compute[72766]: DEBUG nova.network.neutron [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Successfully created port: b1133fb7-42f6-42a4-b7ee-a18dd5a45d59 {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 23:19:20 user nova-compute[72766]: DEBUG nova.network.neutron [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Successfully updated port: b1133fb7-42f6-42a4-b7ee-a18dd5a45d59 {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 23:19:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "refresh_cache-b913283d-2446-432b-9c59-9d0e91bb5309" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:19:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquired lock "refresh_cache-b913283d-2446-432b-9c59-9d0e91bb5309" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:19:20 user nova-compute[72766]: DEBUG nova.network.neutron [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:19:20 user nova-compute[72766]: DEBUG nova.compute.manager [req-4ad9cef3-5e40-437d-819f-044fbb0af9e3 req-5e379fdb-6b18-4d77-8802-09a59c245069 service nova] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Received event network-changed-b1133fb7-42f6-42a4-b7ee-a18dd5a45d59 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:19:20 user nova-compute[72766]: DEBUG nova.compute.manager [req-4ad9cef3-5e40-437d-819f-044fbb0af9e3 req-5e379fdb-6b18-4d77-8802-09a59c245069 service nova] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Refreshing instance network info cache due to event network-changed-b1133fb7-42f6-42a4-b7ee-a18dd5a45d59. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:19:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-4ad9cef3-5e40-437d-819f-044fbb0af9e3 req-5e379fdb-6b18-4d77-8802-09a59c245069 service nova] Acquiring lock "refresh_cache-b913283d-2446-432b-9c59-9d0e91bb5309" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:19:20 user nova-compute[72766]: DEBUG nova.network.neutron [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 23:19:20 user nova-compute[72766]: DEBUG nova.network.neutron [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Updating instance_info_cache with network_info: [{"id": "b1133fb7-42f6-42a4-b7ee-a18dd5a45d59", "address": "fa:16:3e:56:59:20", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1133fb7-42", "ovs_interfaceid": "b1133fb7-42f6-42a4-b7ee-a18dd5a45d59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:19:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Releasing lock "refresh_cache-b913283d-2446-432b-9c59-9d0e91bb5309" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:19:20 user nova-compute[72766]: DEBUG nova.compute.manager [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Instance network_info: |[{"id": "b1133fb7-42f6-42a4-b7ee-a18dd5a45d59", "address": "fa:16:3e:56:59:20", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1133fb7-42", "ovs_interfaceid": "b1133fb7-42f6-42a4-b7ee-a18dd5a45d59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 23:19:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-4ad9cef3-5e40-437d-819f-044fbb0af9e3 req-5e379fdb-6b18-4d77-8802-09a59c245069 service nova] Acquired lock "refresh_cache-b913283d-2446-432b-9c59-9d0e91bb5309" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:19:20 user nova-compute[72766]: DEBUG nova.network.neutron [req-4ad9cef3-5e40-437d-819f-044fbb0af9e3 req-5e379fdb-6b18-4d77-8802-09a59c245069 service nova] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Refreshing network info cache for port b1133fb7-42f6-42a4-b7ee-a18dd5a45d59 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:19:21 user nova-compute[72766]: DEBUG nova.network.neutron [req-4ad9cef3-5e40-437d-819f-044fbb0af9e3 req-5e379fdb-6b18-4d77-8802-09a59c245069 service nova] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Updated VIF entry in instance network info cache for port b1133fb7-42f6-42a4-b7ee-a18dd5a45d59. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:19:21 user nova-compute[72766]: DEBUG nova.network.neutron [req-4ad9cef3-5e40-437d-819f-044fbb0af9e3 req-5e379fdb-6b18-4d77-8802-09a59c245069 service nova] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Updating instance_info_cache with network_info: [{"id": "b1133fb7-42f6-42a4-b7ee-a18dd5a45d59", "address": "fa:16:3e:56:59:20", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1133fb7-42", "ovs_interfaceid": "b1133fb7-42f6-42a4-b7ee-a18dd5a45d59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:19:21 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-4ad9cef3-5e40-437d-819f-044fbb0af9e3 req-5e379fdb-6b18-4d77-8802-09a59c245069 service nova] Releasing lock "refresh_cache-b913283d-2446-432b-9c59-9d0e91bb5309" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:19:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:24 user nova-compute[72766]: DEBUG os_brick.utils [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:19:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[09901d7e-9d01-48d8-8187-8cef22e4b99d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:19:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[1baaaa62-4a5c-4046-a115-dcb888077427]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:19:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ed01c9-d98c-48fa-971d-db8748775ad5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:19:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[956609f0-873b-4a80-bf53-1f246801420d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:19:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:19:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 23:19:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:19:24 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 23:19:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8969a4d-32a0-4ca5-bbb4-8d6f956a32e7]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:19:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 23:19:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 23:19:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 23:19:24 user nova-compute[72766]: DEBUG os_brick.utils [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:19:24 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Updating existing volume attachment record: 55f9a413-610f-403b-bec1-275aac1ce433 {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 23:19:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:30 user nova-compute[72766]: DEBUG nova.compute.manager [req-1c11d6a6-c660-459f-be1c-74178c756b2c req-133bbe2b-302e-453d-8d22-e32b45270158 service nova] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Received event network-changed-1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:19:30 user nova-compute[72766]: DEBUG nova.compute.manager [req-1c11d6a6-c660-459f-be1c-74178c756b2c req-133bbe2b-302e-453d-8d22-e32b45270158 service nova] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Refreshing instance network info cache due to event network-changed-1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:19:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-1c11d6a6-c660-459f-be1c-74178c756b2c req-133bbe2b-302e-453d-8d22-e32b45270158 service nova] Acquiring lock "refresh_cache-f658f249-cb92-4fc1-b1fb-cb6925cf7e1c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:19:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-1c11d6a6-c660-459f-be1c-74178c756b2c req-133bbe2b-302e-453d-8d22-e32b45270158 service nova] Acquired lock "refresh_cache-f658f249-cb92-4fc1-b1fb-cb6925cf7e1c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:19:30 user nova-compute[72766]: DEBUG nova.network.neutron [req-1c11d6a6-c660-459f-be1c-74178c756b2c req-133bbe2b-302e-453d-8d22-e32b45270158 service nova] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Refreshing network info cache for port 1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:19:30 user nova-compute[72766]: DEBUG nova.network.neutron [req-1c11d6a6-c660-459f-be1c-74178c756b2c req-133bbe2b-302e-453d-8d22-e32b45270158 service nova] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Updated VIF entry in instance network info cache for port 1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:19:30 user nova-compute[72766]: DEBUG nova.network.neutron [req-1c11d6a6-c660-459f-be1c-74178c756b2c req-133bbe2b-302e-453d-8d22-e32b45270158 service nova] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Updating instance_info_cache with network_info: [{"id": "1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80", "address": "fa:16:3e:e6:8a:ae", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd62d5e-81", "ovs_interfaceid": "1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:19:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-1c11d6a6-c660-459f-be1c-74178c756b2c req-133bbe2b-302e-453d-8d22-e32b45270158 service nova] Releasing lock "refresh_cache-f658f249-cb92-4fc1-b1fb-cb6925cf7e1c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:19:32 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:19:32 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:19:32 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Rebuilding the list of instances to heal {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 23:19:32 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Skipping network cache update for instance because it is Building. {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 14 23:19:32 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-3ff300ff-34fd-4e94-9d2d-681fb133ba32" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:19:32 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-3ff300ff-34fd-4e94-9d2d-681fb133ba32" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:19:32 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:19:32 user nova-compute[72766]: DEBUG nova.objects.instance [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lazy-loading 'info_cache' on Instance uuid 3ff300ff-34fd-4e94-9d2d-681fb133ba32 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Updating instance_info_cache with network_info: [{"id": "c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d", "address": "fa:16:3e:67:f9:a0", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46ab9cb-e6", "ovs_interfaceid": "c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG nova.compute.manager [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 23:19:33 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Creating image(s)
Aug 14 23:19:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Did not create local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Ensure instance console log exists: /opt/stack/data/nova/instances/b913283d-2446-432b-9c59-9d0e91bb5309/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Start _get_guest_xml network_info=[{"id": "b1133fb7-42f6-42a4-b7ee-a18dd5a45d59", "address": "fa:16:3e:56:59:20", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1133fb7-42", "ovs_interfaceid": "b1133fb7-42f6-42a4-b7ee-a18dd5a45d59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': '55f9a413-610f-403b-bec1-275aac1ce433', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OsfgQSjZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b913283d-2446-432b-9c59-9d0e91bb5309', 'attached_at': '', 'detached_at': '', 'volume_id': 'c19b3ca8-8061-4212-b07b-d995398bb2f7', 'serial': 'c19b3ca8-8061-4212-b07b-d995398bb2f7'}, 'volume_type': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-3ff300ff-34fd-4e94-9d2d-681fb133ba32" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:19:33 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:19:33 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:19:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OsfgQSjZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:19:33 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:19:33 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:19:33 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:19:33 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:19:33 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 23:19:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7 -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9ed542-9473-4f5d-960f-96639fa2ac07]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 23:19:33 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92c3e0b-eaa5-432d-b82e-3c69ee42b0f7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7] added
Aug 14 23:19:33 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4127b30f-81f5-4f47-97d4-eebfaebe413a]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a9d03d-e6d4-48d8-af2a-a3aebbad5673]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OsfgQSjZ {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OsfgQSjZ" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfd66e2-7b88-4c73-b115-1a858c6c0692]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OsfgQSjZ'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d6e8b4-e5d6-451f-b207-60cbe72b3c3e]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d21980-447b-4ff0-a43b-b39feddc6b9e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 23:19:33 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 23:19:33 user nova-compute[72766]:  {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:19:33 user nova-compute[72766]: WARNING os_brick.initiator.connectors.iscsi [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 23:19:33 user nova-compute[72766]: 
Aug 14 23:19:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7 -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d88cda-d0ce-4eda-8235-a826f90afec4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7, portal: 172.16.0.220,3260]
Aug 14 23:19:33 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7, portal: 172.16.0.220,3260] successful.
Aug 14 23:19:33 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[67304ed2-7a23-425a-8b8a-93873450868c]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1d17c1-f773-4fe5-9b3c-6d4b63c0da81]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7 (non-flash)
Aug 14 23:19:33 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7 (non-flash)
Aug 14 23:19:33 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[04009649-a5a7-4da1-9f1d-73a7bca52ad8]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OsfgQSjZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:19:33 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "f658f249-cb92-4fc1-b1fb-cb6925cf7e1c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "f658f249-cb92-4fc1-b1fb-cb6925cf7e1c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG nova.objects.instance [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lazy-loading 'flavor' on Instance uuid f658f249-cb92-4fc1-b1fb-cb6925cf7e1c {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "f658f249-cb92-4fc1-b1fb-cb6925cf7e1c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "f658f249-cb92-4fc1-b1fb-cb6925cf7e1c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "f658f249-cb92-4fc1-b1fb-cb6925cf7e1c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:19:34 user nova-compute[72766]: INFO nova.compute.manager [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Attaching volume 31a29ca5-1ceb-49c0-a18b-535a0686c81f to /dev/vdb
Aug 14 23:19:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG os_brick.utils [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4150e1aa-e1c5-4483-a65b-3953a08e6b2f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[0710b3c8-109f-4379-b6b4-9975556dcc2f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8c935c-39d0-4721-b79d-d3d2314bfe5e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d6b5f4-b983-4591-92af-8b71bde09983]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:19:34 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 23:19:34 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[823f50a2-aab1-4ae5-bb1f-17a727d8b3d2]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG os_brick.utils [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Updating existing volume attachment record: 18312dcf-3b00-45fe-9e00-c4c82ec24a71 {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23536666163373234', 'path': '/dev/sdb'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536666163373234', 'path': '/dev/sdb'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:19:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1893257722',display_name='tempest-TestVolumeBootPattern-server-1893257722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1893257722',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3c9f53727cc497c94516ff7fa1bbf4f',ramdisk_id='',reservation_id='r-z5wvdxvc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-213280496',owner_user_name='tempest-TestVolumeBootPattern-213280496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:19:19Z,user_data=None,user_id='999390ac8e6240199c9a7484e234f3a7',uuid=b913283d-2446-432b-9c59-9d0e91bb5309,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1133fb7-42f6-42a4-b7ee-a18dd5a45d59", "address": "fa:16:3e:56:59:20", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1133fb7-42", "ovs_interfaceid": "b1133fb7-42f6-42a4-b7ee-a18dd5a45d59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Converting VIF {"id": "b1133fb7-42f6-42a4-b7ee-a18dd5a45d59", "address": "fa:16:3e:56:59:20", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1133fb7-42", "ovs_interfaceid": "b1133fb7-42f6-42a4-b7ee-a18dd5a45d59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:59:20,bridge_name='br-int',has_traffic_filtering=True,id=b1133fb7-42f6-42a4-b7ee-a18dd5a45d59,network=Network(f418a384-bbac-4892-8e0f-c7af2e9464ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1133fb7-42') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG nova.objects.instance [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lazy-loading 'pci_devices' on Instance uuid b913283d-2446-432b-9c59-9d0e91bb5309 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:19:34 user nova-compute[72766]:   <uuid>b913283d-2446-432b-9c59-9d0e91bb5309</uuid>
Aug 14 23:19:34 user nova-compute[72766]:   <name>instance-00000023</name>
Aug 14 23:19:34 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:19:34 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:19:34 user nova-compute[72766]:   <metadata>
Aug 14 23:19:34 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:19:34 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:19:34 user nova-compute[72766]:       <nova:name>tempest-TestVolumeBootPattern-server-1893257722</nova:name>
Aug 14 23:19:34 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:19:33</nova:creationTime>
Aug 14 23:19:34 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:19:34 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:19:34 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:19:34 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:19:34 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:19:34 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:19:34 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:19:34 user nova-compute[72766]:       <nova:owner>
Aug 14 23:19:34 user nova-compute[72766]:         <nova:user uuid="999390ac8e6240199c9a7484e234f3a7">tempest-TestVolumeBootPattern-213280496-project-member</nova:user>
Aug 14 23:19:34 user nova-compute[72766]:         <nova:project uuid="a3c9f53727cc497c94516ff7fa1bbf4f">tempest-TestVolumeBootPattern-213280496</nova:project>
Aug 14 23:19:34 user nova-compute[72766]:       </nova:owner>
Aug 14 23:19:34 user nova-compute[72766]:       <nova:ports>
Aug 14 23:19:34 user nova-compute[72766]:         <nova:port uuid="b1133fb7-42f6-42a4-b7ee-a18dd5a45d59">
Aug 14 23:19:34 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 23:19:34 user nova-compute[72766]:         </nova:port>
Aug 14 23:19:34 user nova-compute[72766]:       </nova:ports>
Aug 14 23:19:34 user nova-compute[72766]:     </nova:instance>
Aug 14 23:19:34 user nova-compute[72766]:   </metadata>
Aug 14 23:19:34 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:19:34 user nova-compute[72766]:     <system>
Aug 14 23:19:34 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:19:34 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:19:34 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:19:34 user nova-compute[72766]:       <entry name="serial">b913283d-2446-432b-9c59-9d0e91bb5309</entry>
Aug 14 23:19:34 user nova-compute[72766]:       <entry name="uuid">b913283d-2446-432b-9c59-9d0e91bb5309</entry>
Aug 14 23:19:34 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:19:34 user nova-compute[72766]:     </system>
Aug 14 23:19:34 user nova-compute[72766]:   </sysinfo>
Aug 14 23:19:34 user nova-compute[72766]:   <os>
Aug 14 23:19:34 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:19:34 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:19:34 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:19:34 user nova-compute[72766]:   </os>
Aug 14 23:19:34 user nova-compute[72766]:   <features>
Aug 14 23:19:34 user nova-compute[72766]:     <acpi/>
Aug 14 23:19:34 user nova-compute[72766]:     <apic/>
Aug 14 23:19:34 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:19:34 user nova-compute[72766]:   </features>
Aug 14 23:19:34 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:19:34 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:19:34 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:19:34 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:19:34 user nova-compute[72766]:   </clock>
Aug 14 23:19:34 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:19:34 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:19:34 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:19:34 user nova-compute[72766]:   </cpu>
Aug 14 23:19:34 user nova-compute[72766]:   <devices>
Aug 14 23:19:34 user nova-compute[72766]:     <disk type="block" device="disk">
Aug 14 23:19:34 user nova-compute[72766]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:19:34 user nova-compute[72766]:       <source dev="/dev/sdb"/>
Aug 14 23:19:34 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:19:34 user nova-compute[72766]:       <serial>c19b3ca8-8061-4212-b07b-d995398bb2f7</serial>
Aug 14 23:19:34 user nova-compute[72766]:     </disk>
Aug 14 23:19:34 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:19:34 user nova-compute[72766]:       <mac address="fa:16:3e:56:59:20"/>
Aug 14 23:19:34 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:19:34 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:19:34 user nova-compute[72766]:       <target dev="tapb1133fb7-42"/>
Aug 14 23:19:34 user nova-compute[72766]:     </interface>
Aug 14 23:19:34 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:19:34 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/b913283d-2446-432b-9c59-9d0e91bb5309/console.log" append="off"/>
Aug 14 23:19:34 user nova-compute[72766]:     </serial>
Aug 14 23:19:34 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:19:34 user nova-compute[72766]:     <video>
Aug 14 23:19:34 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:19:34 user nova-compute[72766]:     </video>
Aug 14 23:19:34 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:19:34 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:19:34 user nova-compute[72766]:     </rng>
Aug 14 23:19:34 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:19:34 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:19:34 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:19:34 user nova-compute[72766]:     </memballoon>
Aug 14 23:19:34 user nova-compute[72766]:   </devices>
Aug 14 23:19:34 user nova-compute[72766]: </domain>
Aug 14 23:19:34 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:19:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1893257722',display_name='tempest-TestVolumeBootPattern-server-1893257722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1893257722',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3c9f53727cc497c94516ff7fa1bbf4f',ramdisk_id='',reservation_id='r-z5wvdxvc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-213280496',owner_user_name='tempest-TestVolumeBootPattern-213280496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:19:19Z,user_data=None,user_id='999390ac8e6240199c9a7484e234f3a7',uuid=b913283d-2446-432b-9c59-9d0e91bb5309,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1133fb7-42f6-42a4-b7ee-a18dd5a45d59", "address": "fa:16:3e:56:59:20", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1133fb7-42", "ovs_interfaceid": "b1133fb7-42f6-42a4-b7ee-a18dd5a45d59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Converting VIF {"id": "b1133fb7-42f6-42a4-b7ee-a18dd5a45d59", "address": "fa:16:3e:56:59:20", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1133fb7-42", "ovs_interfaceid": "b1133fb7-42f6-42a4-b7ee-a18dd5a45d59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:59:20,bridge_name='br-int',has_traffic_filtering=True,id=b1133fb7-42f6-42a4-b7ee-a18dd5a45d59,network=Network(f418a384-bbac-4892-8e0f-c7af2e9464ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1133fb7-42') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG os_vif [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:59:20,bridge_name='br-int',has_traffic_filtering=True,id=b1133fb7-42f6-42a4-b7ee-a18dd5a45d59,network=Network(f418a384-bbac-4892-8e0f-c7af2e9464ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1133fb7-42') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1133fb7-42, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb1133fb7-42, col_values=(('external_ids', {'iface-id': 'b1133fb7-42f6-42a4-b7ee-a18dd5a45d59', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:59:20', 'vm-uuid': 'b913283d-2446-432b-9c59-9d0e91bb5309'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:34 user nova-compute[72766]: INFO os_vif [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:59:20,bridge_name='br-int',has_traffic_filtering=True,id=b1133fb7-42f6-42a4-b7ee-a18dd5a45d59,network=Network(f418a384-bbac-4892-8e0f-c7af2e9464ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1133fb7-42')
Aug 14 23:19:34 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] No VIF found with MAC fa:16:3e:56:59:20, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:19:34 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f658f249-cb92-4fc1-b1fb-cb6925cf7e1c/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f658f249-cb92-4fc1-b1fb-cb6925cf7e1c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f658f249-cb92-4fc1-b1fb-cb6925cf7e1c/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f658f249-cb92-4fc1-b1fb-cb6925cf7e1c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:36 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:36 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:36 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:36 user nova-compute[72766]: DEBUG nova.compute.manager [req-2ae74d17-8b9e-4854-8842-aa186889d331 req-ed9aca7b-3024-4ed4-ac85-205723c32600 service nova] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Received event network-vif-plugged-b1133fb7-42f6-42a4-b7ee-a18dd5a45d59 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:19:36 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2ae74d17-8b9e-4854-8842-aa186889d331 req-ed9aca7b-3024-4ed4-ac85-205723c32600 service nova] Acquiring lock "b913283d-2446-432b-9c59-9d0e91bb5309-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:19:36 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2ae74d17-8b9e-4854-8842-aa186889d331 req-ed9aca7b-3024-4ed4-ac85-205723c32600 service nova] Lock "b913283d-2446-432b-9c59-9d0e91bb5309-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:19:36 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2ae74d17-8b9e-4854-8842-aa186889d331 req-ed9aca7b-3024-4ed4-ac85-205723c32600 service nova] Lock "b913283d-2446-432b-9c59-9d0e91bb5309-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:19:36 user nova-compute[72766]: DEBUG nova.compute.manager [req-2ae74d17-8b9e-4854-8842-aa186889d331 req-ed9aca7b-3024-4ed4-ac85-205723c32600 service nova] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] No waiting events found dispatching network-vif-plugged-b1133fb7-42f6-42a4-b7ee-a18dd5a45d59 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:19:36 user nova-compute[72766]: WARNING nova.compute.manager [req-2ae74d17-8b9e-4854-8842-aa186889d331 req-ed9aca7b-3024-4ed4-ac85-205723c32600 service nova] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Received unexpected event network-vif-plugged-b1133fb7-42f6-42a4-b7ee-a18dd5a45d59 for instance with vm_state building and task_state spawning.
Aug 14 23:19:36 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:19:38 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692055178.1535804, b913283d-2446-432b-9c59-9d0e91bb5309 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:19:38 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] VM Resumed (Lifecycle Event)
Aug 14 23:19:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:38 user nova-compute[72766]: DEBUG nova.compute.manager [req-baf6a95f-22e6-4002-ab23-f9f5fa96515c req-bf7c6a7e-ca7a-4d37-8bbb-0c9956eb4013 service nova] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Received event network-vif-plugged-b1133fb7-42f6-42a4-b7ee-a18dd5a45d59 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:19:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-baf6a95f-22e6-4002-ab23-f9f5fa96515c req-bf7c6a7e-ca7a-4d37-8bbb-0c9956eb4013 service nova] Acquiring lock "b913283d-2446-432b-9c59-9d0e91bb5309-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:19:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-baf6a95f-22e6-4002-ab23-f9f5fa96515c req-bf7c6a7e-ca7a-4d37-8bbb-0c9956eb4013 service nova] Lock "b913283d-2446-432b-9c59-9d0e91bb5309-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:19:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-baf6a95f-22e6-4002-ab23-f9f5fa96515c req-bf7c6a7e-ca7a-4d37-8bbb-0c9956eb4013 service nova] Lock "b913283d-2446-432b-9c59-9d0e91bb5309-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:19:38 user nova-compute[72766]: DEBUG nova.compute.manager [req-baf6a95f-22e6-4002-ab23-f9f5fa96515c req-bf7c6a7e-ca7a-4d37-8bbb-0c9956eb4013 service nova] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] No waiting events found dispatching network-vif-plugged-b1133fb7-42f6-42a4-b7ee-a18dd5a45d59 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:19:38 user nova-compute[72766]: WARNING nova.compute.manager [req-baf6a95f-22e6-4002-ab23-f9f5fa96515c req-bf7c6a7e-ca7a-4d37-8bbb-0c9956eb4013 service nova] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Received unexpected event network-vif-plugged-b1133fb7-42f6-42a4-b7ee-a18dd5a45d59 for instance with vm_state building and task_state spawning.
Aug 14 23:19:38 user nova-compute[72766]: DEBUG nova.compute.manager [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:19:38 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 23:19:38 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:19:38 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Instance spawned successfully.
Aug 14 23:19:38 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 23:19:38 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:19:38 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:19:38 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=8417MB free_disk=25.277446746826172GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:19:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:19:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:19:38 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:19:38 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:19:38 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:19:38 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:19:38 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:19:38 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:19:38 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:19:38 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:19:38 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692055178.1546354, b913283d-2446-432b-9c59-9d0e91bb5309 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:19:38 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] VM Started (Lifecycle Event)
Aug 14 23:19:38 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:19:38 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:19:38 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:19:38 user nova-compute[72766]: INFO nova.compute.manager [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Took 5.37 seconds to spawn the instance on the hypervisor.
Aug 14 23:19:38 user nova-compute[72766]: DEBUG nova.compute.manager [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:19:38 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 3ff300ff-34fd-4e94-9d2d-681fb133ba32 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:19:38 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance cbcf7851-e6f7-4f46-97cc-d773286ccddf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:19:38 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance f658f249-cb92-4fc1-b1fb-cb6925cf7e1c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:19:38 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance b913283d-2446-432b-9c59-9d0e91bb5309 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:19:38 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:19:38 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:19:38 user nova-compute[72766]: INFO nova.compute.manager [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Took 20.56 seconds to build instance.
Aug 14 23:19:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-0a3e1e38-6806-483c-adcb-531a64b12f7a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "b913283d-2446-432b-9c59-9d0e91bb5309" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.661s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:19:38 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:19:38 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:19:38 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:19:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.351s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:19:39 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:39 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:39 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:19:39 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:19:39 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:19:39 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:19:40 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:19:40 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:19:42 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XqoPIKAs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:19:43 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:19:43 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:19:43 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:19:43 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:19:43 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 23:19:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[7334763a-2700-41e2-83e9-fa98f408249e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 23:19:43 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b56bd9-f1a3-457e-88a7-b77ffc88ffdd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f] added
Aug 14 23:19:43 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e5dc27-6944-46a6-9c5a-95cabd895d4b]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[76509d73-e693-42e1-b62e-8c401c058c2e]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XqoPIKAs {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XqoPIKAs" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[555c7b95-7374-456a-af76-cdcf9dce906d]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XqoPIKAs'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[364c5e94-d890-402d-b3e6-eed5fc266e75]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4419935-4d76-474f-ad51-f680f279ae69]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7 (non-flash)
Aug 14 23:19:43 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7 (non-flash)
Aug 14 23:19:43 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d65f78-abef-40a4-85c0-5e936e9358ca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f, portal: 172.16.0.220,3260]
Aug 14 23:19:43 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f, portal: 172.16.0.220,3260] successful.
Aug 14 23:19:43 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a38c44d-f068-4428-96f1-bf5e4e00aa47]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a2cdb8-7459-4d7e-8744-fa15a23f92f7]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7 (non-flash)
Aug 14 23:19:43 user nova-compute[72766]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f (non-flash)
Aug 14 23:19:43 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7 (non-flash)
Aug 14 23:19:43 user nova-compute[72766]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f (non-flash)
Aug 14 23:19:43 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb50d69-340f-485c-8c7d-47c032950f16]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:19:43 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: None {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:19:44 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:19:44 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XqoPIKAs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 23:19:44 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:19:44 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26332343363653332', 'path': '/dev/sdc'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:19:44 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332343363653332', 'path': '/dev/sdc'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 23:19:44 user nova-compute[72766]: DEBUG nova.objects.instance [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lazy-loading 'flavor' on Instance uuid f658f249-cb92-4fc1-b1fb-cb6925cf7e1c {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:19:44 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 23:19:44 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:19:44 user nova-compute[72766]:   <source dev="/dev/sdc"/>
Aug 14 23:19:44 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:19:44 user nova-compute[72766]:   <serial>31a29ca5-1ceb-49c0-a18b-535a0686c81f</serial>
Aug 14 23:19:44 user nova-compute[72766]: </disk>
Aug 14 23:19:44 user nova-compute[72766]:  {{(pid=72766) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 23:19:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:19:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:19:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:19:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:19:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:45 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:19:45 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:19:45 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] No VIF found with MAC fa:16:3e:e6:8a:ae, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:19:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c8902aa6-a076-4918-bd79-587c0d86b717 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "f658f249-cb92-4fc1-b1fb-cb6925cf7e1c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.955s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:19:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "f7dacacc-1e32-43c2-8e07-01b71103c007" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:19:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "f7dacacc-1e32-43c2-8e07-01b71103c007" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:19:49 user nova-compute[72766]: DEBUG nova.compute.manager [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 23:19:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:19:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:19:49 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 23:19:49 user nova-compute[72766]: INFO nova.compute.claims [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Claim successful on node user
Aug 14 23:19:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:49 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:19:49 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:19:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.308s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:19:49 user nova-compute[72766]: DEBUG nova.compute.manager [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 23:19:49 user nova-compute[72766]: DEBUG nova.compute.manager [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 23:19:49 user nova-compute[72766]: DEBUG nova.network.neutron [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 23:19:49 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 23:19:49 user nova-compute[72766]: DEBUG nova.compute.manager [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 23:19:49 user nova-compute[72766]: DEBUG nova.policy [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '90e68d4dfd6048d99037fce632788b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785d8cff6cd41a4aff8becf528e3a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 23:19:49 user nova-compute[72766]: DEBUG nova.compute.manager [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 23:19:49 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 23:19:49 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Creating image(s)
Aug 14 23:19:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "/opt/stack/data/nova/instances/f7dacacc-1e32-43c2-8e07-01b71103c007/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:19:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "/opt/stack/data/nova/instances/f7dacacc-1e32-43c2-8e07-01b71103c007/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:19:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "/opt/stack/data/nova/instances/f7dacacc-1e32-43c2-8e07-01b71103c007/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:19:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.185s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:19:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:19:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.180s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/f7dacacc-1e32-43c2-8e07-01b71103c007/disk 1073741824 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/f7dacacc-1e32-43c2-8e07-01b71103c007/disk 1073741824" returned: 0 in 0.065s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:19:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.204s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:50 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f7dacacc-1e32-43c2-8e07-01b71103c007/disk. size=1073741824 {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 23:19:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7dacacc-1e32-43c2-8e07-01b71103c007/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:19:50 user nova-compute[72766]: DEBUG nova.network.neutron [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Successfully created port: cc954c15-d2f1-421e-bd59-65e145e12ef6 {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 23:19:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7dacacc-1e32-43c2-8e07-01b71103c007/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:19:50 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Cannot resize image /opt/stack/data/nova/instances/f7dacacc-1e32-43c2-8e07-01b71103c007/disk to a smaller size. {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 23:19:50 user nova-compute[72766]: DEBUG nova.objects.instance [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lazy-loading 'migration_context' on Instance uuid f7dacacc-1e32-43c2-8e07-01b71103c007 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:19:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 23:19:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Ensure instance console log exists: /opt/stack/data/nova/instances/f7dacacc-1e32-43c2-8e07-01b71103c007/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 23:19:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:19:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:19:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG nova.network.neutron [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Successfully updated port: cc954c15-d2f1-421e-bd59-65e145e12ef6 {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "refresh_cache-f7dacacc-1e32-43c2-8e07-01b71103c007" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquired lock "refresh_cache-f7dacacc-1e32-43c2-8e07-01b71103c007" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG nova.network.neutron [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG nova.compute.manager [req-7e319178-a29d-49d4-95cb-494c3817d96d req-a8c09288-cf51-410f-b28d-8c4720bcaf70 service nova] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Received event network-changed-cc954c15-d2f1-421e-bd59-65e145e12ef6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG nova.compute.manager [req-7e319178-a29d-49d4-95cb-494c3817d96d req-a8c09288-cf51-410f-b28d-8c4720bcaf70 service nova] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Refreshing instance network info cache due to event network-changed-cc954c15-d2f1-421e-bd59-65e145e12ef6. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7e319178-a29d-49d4-95cb-494c3817d96d req-a8c09288-cf51-410f-b28d-8c4720bcaf70 service nova] Acquiring lock "refresh_cache-f7dacacc-1e32-43c2-8e07-01b71103c007" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG nova.network.neutron [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG nova.network.neutron [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Updating instance_info_cache with network_info: [{"id": "cc954c15-d2f1-421e-bd59-65e145e12ef6", "address": "fa:16:3e:3e:ab:f4", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc954c15-d2", "ovs_interfaceid": "cc954c15-d2f1-421e-bd59-65e145e12ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Releasing lock "refresh_cache-f7dacacc-1e32-43c2-8e07-01b71103c007" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG nova.compute.manager [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Instance network_info: |[{"id": "cc954c15-d2f1-421e-bd59-65e145e12ef6", "address": "fa:16:3e:3e:ab:f4", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc954c15-d2", "ovs_interfaceid": "cc954c15-d2f1-421e-bd59-65e145e12ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7e319178-a29d-49d4-95cb-494c3817d96d req-a8c09288-cf51-410f-b28d-8c4720bcaf70 service nova] Acquired lock "refresh_cache-f7dacacc-1e32-43c2-8e07-01b71103c007" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG nova.network.neutron [req-7e319178-a29d-49d4-95cb-494c3817d96d req-a8c09288-cf51-410f-b28d-8c4720bcaf70 service nova] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Refreshing network info cache for port cc954c15-d2f1-421e-bd59-65e145e12ef6 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Start _get_guest_xml network_info=[{"id": "cc954c15-d2f1-421e-bd59-65e145e12ef6", "address": "fa:16:3e:3e:ab:f4", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc954c15-d2", "ovs_interfaceid": "cc954c15-d2f1-421e-bd59-65e145e12ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd2900d30-2c4c-4d57-9135-d45564c0c596'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:19:51 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:19:51 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:19:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:19:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1599577153',display_name='tempest-AttachVolumeNegativeTest-server-1599577153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1599577153',id=36,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPlgEPqURESY6kfwd7o8wChwpo7eiBsH75Lo1DrboxJec0L/YunW6o+rOChnE/c8wEXXkEoWxY7rU+eXW+RE73ylvCCMCzzzo/DSevfnsLKfXy207J39Yj9974QMvmn6A==',key_name='tempest-keypair-795283177',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3785d8cff6cd41a4aff8becf528e3a4c',ramdisk_id='',reservation_id='r-6jwyx5py',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1623363641',owner_user_name='tempest-AttachVolumeNegativeTest-1623363641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:19:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90e68d4dfd6048d99037fce632788b57',uuid=f7dacacc-1e32-43c2-8e07-01b71103c007,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc954c15-d2f1-421e-bd59-65e145e12ef6", "address": "fa:16:3e:3e:ab:f4", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc954c15-d2", "ovs_interfaceid": "cc954c15-d2f1-421e-bd59-65e145e12ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Converting VIF {"id": "cc954c15-d2f1-421e-bd59-65e145e12ef6", "address": "fa:16:3e:3e:ab:f4", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc954c15-d2", "ovs_interfaceid": "cc954c15-d2f1-421e-bd59-65e145e12ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:ab:f4,bridge_name='br-int',has_traffic_filtering=True,id=cc954c15-d2f1-421e-bd59-65e145e12ef6,network=Network(9491b8be-e6b2-4770-a591-370db9a96785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc954c15-d2') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG nova.objects.instance [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lazy-loading 'pci_devices' on Instance uuid f7dacacc-1e32-43c2-8e07-01b71103c007 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:19:51 user nova-compute[72766]:   <uuid>f7dacacc-1e32-43c2-8e07-01b71103c007</uuid>
Aug 14 23:19:51 user nova-compute[72766]:   <name>instance-00000024</name>
Aug 14 23:19:51 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:19:51 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:19:51 user nova-compute[72766]:   <metadata>
Aug 14 23:19:51 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:19:51 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:19:51 user nova-compute[72766]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1599577153</nova:name>
Aug 14 23:19:51 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:19:51</nova:creationTime>
Aug 14 23:19:51 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:19:51 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:19:51 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:19:51 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:19:51 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:19:51 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:19:51 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:19:51 user nova-compute[72766]:       <nova:owner>
Aug 14 23:19:51 user nova-compute[72766]:         <nova:user uuid="90e68d4dfd6048d99037fce632788b57">tempest-AttachVolumeNegativeTest-1623363641-project-member</nova:user>
Aug 14 23:19:51 user nova-compute[72766]:         <nova:project uuid="3785d8cff6cd41a4aff8becf528e3a4c">tempest-AttachVolumeNegativeTest-1623363641</nova:project>
Aug 14 23:19:51 user nova-compute[72766]:       </nova:owner>
Aug 14 23:19:51 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 23:19:51 user nova-compute[72766]:       <nova:ports>
Aug 14 23:19:51 user nova-compute[72766]:         <nova:port uuid="cc954c15-d2f1-421e-bd59-65e145e12ef6">
Aug 14 23:19:51 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 14 23:19:51 user nova-compute[72766]:         </nova:port>
Aug 14 23:19:51 user nova-compute[72766]:       </nova:ports>
Aug 14 23:19:51 user nova-compute[72766]:     </nova:instance>
Aug 14 23:19:51 user nova-compute[72766]:   </metadata>
Aug 14 23:19:51 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:19:51 user nova-compute[72766]:     <system>
Aug 14 23:19:51 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:19:51 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:19:51 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:19:51 user nova-compute[72766]:       <entry name="serial">f7dacacc-1e32-43c2-8e07-01b71103c007</entry>
Aug 14 23:19:51 user nova-compute[72766]:       <entry name="uuid">f7dacacc-1e32-43c2-8e07-01b71103c007</entry>
Aug 14 23:19:51 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:19:51 user nova-compute[72766]:     </system>
Aug 14 23:19:51 user nova-compute[72766]:   </sysinfo>
Aug 14 23:19:51 user nova-compute[72766]:   <os>
Aug 14 23:19:51 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:19:51 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:19:51 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:19:51 user nova-compute[72766]:   </os>
Aug 14 23:19:51 user nova-compute[72766]:   <features>
Aug 14 23:19:51 user nova-compute[72766]:     <acpi/>
Aug 14 23:19:51 user nova-compute[72766]:     <apic/>
Aug 14 23:19:51 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:19:51 user nova-compute[72766]:   </features>
Aug 14 23:19:51 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:19:51 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:19:51 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:19:51 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:19:51 user nova-compute[72766]:   </clock>
Aug 14 23:19:51 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:19:51 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:19:51 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:19:51 user nova-compute[72766]:   </cpu>
Aug 14 23:19:51 user nova-compute[72766]:   <devices>
Aug 14 23:19:51 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 23:19:51 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 23:19:51 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/f7dacacc-1e32-43c2-8e07-01b71103c007/disk"/>
Aug 14 23:19:51 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:19:51 user nova-compute[72766]:     </disk>
Aug 14 23:19:51 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:19:51 user nova-compute[72766]:       <mac address="fa:16:3e:3e:ab:f4"/>
Aug 14 23:19:51 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:19:51 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:19:51 user nova-compute[72766]:       <target dev="tapcc954c15-d2"/>
Aug 14 23:19:51 user nova-compute[72766]:     </interface>
Aug 14 23:19:51 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:19:51 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/f7dacacc-1e32-43c2-8e07-01b71103c007/console.log" append="off"/>
Aug 14 23:19:51 user nova-compute[72766]:     </serial>
Aug 14 23:19:51 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:19:51 user nova-compute[72766]:     <video>
Aug 14 23:19:51 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:19:51 user nova-compute[72766]:     </video>
Aug 14 23:19:51 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:19:51 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:19:51 user nova-compute[72766]:     </rng>
Aug 14 23:19:51 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:19:51 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:19:51 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:19:51 user nova-compute[72766]:     </memballoon>
Aug 14 23:19:51 user nova-compute[72766]:   </devices>
Aug 14 23:19:51 user nova-compute[72766]: </domain>
Aug 14 23:19:51 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:19:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1599577153',display_name='tempest-AttachVolumeNegativeTest-server-1599577153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1599577153',id=36,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPlgEPqURESY6kfwd7o8wChwpo7eiBsH75Lo1DrboxJec0L/YunW6o+rOChnE/c8wEXXkEoWxY7rU+eXW+RE73ylvCCMCzzzo/DSevfnsLKfXy207J39Yj9974QMvmn6A==',key_name='tempest-keypair-795283177',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3785d8cff6cd41a4aff8becf528e3a4c',ramdisk_id='',reservation_id='r-6jwyx5py',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1623363641',owner_user_name='tempest-AttachVolumeNegativeTest-1623363641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:19:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90e68d4dfd6048d99037fce632788b57',uuid=f7dacacc-1e32-43c2-8e07-01b71103c007,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc954c15-d2f1-421e-bd59-65e145e12ef6", "address": "fa:16:3e:3e:ab:f4", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc954c15-d2", "ovs_interfaceid": "cc954c15-d2f1-421e-bd59-65e145e12ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Converting VIF {"id": "cc954c15-d2f1-421e-bd59-65e145e12ef6", "address": "fa:16:3e:3e:ab:f4", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc954c15-d2", "ovs_interfaceid": "cc954c15-d2f1-421e-bd59-65e145e12ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:ab:f4,bridge_name='br-int',has_traffic_filtering=True,id=cc954c15-d2f1-421e-bd59-65e145e12ef6,network=Network(9491b8be-e6b2-4770-a591-370db9a96785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc954c15-d2') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG os_vif [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:ab:f4,bridge_name='br-int',has_traffic_filtering=True,id=cc954c15-d2f1-421e-bd59-65e145e12ef6,network=Network(9491b8be-e6b2-4770-a591-370db9a96785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc954c15-d2') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc954c15-d2, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcc954c15-d2, col_values=(('external_ids', {'iface-id': 'cc954c15-d2f1-421e-bd59-65e145e12ef6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:ab:f4', 'vm-uuid': 'f7dacacc-1e32-43c2-8e07-01b71103c007'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:51 user nova-compute[72766]: INFO os_vif [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:ab:f4,bridge_name='br-int',has_traffic_filtering=True,id=cc954c15-d2f1-421e-bd59-65e145e12ef6,network=Network(9491b8be-e6b2-4770-a591-370db9a96785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc954c15-d2')
Aug 14 23:19:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] No VIF found with MAC fa:16:3e:3e:ab:f4, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG nova.network.neutron [req-7e319178-a29d-49d4-95cb-494c3817d96d req-a8c09288-cf51-410f-b28d-8c4720bcaf70 service nova] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Updated VIF entry in instance network info cache for port cc954c15-d2f1-421e-bd59-65e145e12ef6. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG nova.network.neutron [req-7e319178-a29d-49d4-95cb-494c3817d96d req-a8c09288-cf51-410f-b28d-8c4720bcaf70 service nova] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Updating instance_info_cache with network_info: [{"id": "cc954c15-d2f1-421e-bd59-65e145e12ef6", "address": "fa:16:3e:3e:ab:f4", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc954c15-d2", "ovs_interfaceid": "cc954c15-d2f1-421e-bd59-65e145e12ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:19:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7e319178-a29d-49d4-95cb-494c3817d96d req-a8c09288-cf51-410f-b28d-8c4720bcaf70 service nova] Releasing lock "refresh_cache-f7dacacc-1e32-43c2-8e07-01b71103c007" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:19:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:53 user nova-compute[72766]: DEBUG nova.compute.manager [req-2d9a126c-3419-415e-ba3f-c76b9a1cf5c6 req-263eaa79-8fd2-4bdf-8172-97cc83390a7a service nova] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Received event network-vif-plugged-cc954c15-d2f1-421e-bd59-65e145e12ef6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:19:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2d9a126c-3419-415e-ba3f-c76b9a1cf5c6 req-263eaa79-8fd2-4bdf-8172-97cc83390a7a service nova] Acquiring lock "f7dacacc-1e32-43c2-8e07-01b71103c007-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:19:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2d9a126c-3419-415e-ba3f-c76b9a1cf5c6 req-263eaa79-8fd2-4bdf-8172-97cc83390a7a service nova] Lock "f7dacacc-1e32-43c2-8e07-01b71103c007-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:19:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2d9a126c-3419-415e-ba3f-c76b9a1cf5c6 req-263eaa79-8fd2-4bdf-8172-97cc83390a7a service nova] Lock "f7dacacc-1e32-43c2-8e07-01b71103c007-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:19:53 user nova-compute[72766]: DEBUG nova.compute.manager [req-2d9a126c-3419-415e-ba3f-c76b9a1cf5c6 req-263eaa79-8fd2-4bdf-8172-97cc83390a7a service nova] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] No waiting events found dispatching network-vif-plugged-cc954c15-d2f1-421e-bd59-65e145e12ef6 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:19:53 user nova-compute[72766]: WARNING nova.compute.manager [req-2d9a126c-3419-415e-ba3f-c76b9a1cf5c6 req-263eaa79-8fd2-4bdf-8172-97cc83390a7a service nova] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Received unexpected event network-vif-plugged-cc954c15-d2f1-421e-bd59-65e145e12ef6 for instance with vm_state building and task_state spawning.
Aug 14 23:19:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6c15bd3e-4b2a-48cf-b8ba-0d8f8df60570 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "3ff300ff-34fd-4e94-9d2d-681fb133ba32" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:19:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6c15bd3e-4b2a-48cf-b8ba-0d8f8df60570 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "3ff300ff-34fd-4e94-9d2d-681fb133ba32" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:19:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6c15bd3e-4b2a-48cf-b8ba-0d8f8df60570 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "3ff300ff-34fd-4e94-9d2d-681fb133ba32-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:19:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6c15bd3e-4b2a-48cf-b8ba-0d8f8df60570 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "3ff300ff-34fd-4e94-9d2d-681fb133ba32-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:19:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6c15bd3e-4b2a-48cf-b8ba-0d8f8df60570 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "3ff300ff-34fd-4e94-9d2d-681fb133ba32-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:19:54 user nova-compute[72766]: INFO nova.compute.manager [None req-6c15bd3e-4b2a-48cf-b8ba-0d8f8df60570 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Terminating instance
Aug 14 23:19:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-6c15bd3e-4b2a-48cf-b8ba-0d8f8df60570 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:19:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:54 user nova-compute[72766]: DEBUG nova.compute.manager [req-a41c037e-936c-47e5-a8a9-40f232bc0ad5 req-6102573a-d79a-41e3-9d5b-37c6732830d2 service nova] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Received event network-vif-unplugged-c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:19:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a41c037e-936c-47e5-a8a9-40f232bc0ad5 req-6102573a-d79a-41e3-9d5b-37c6732830d2 service nova] Acquiring lock "3ff300ff-34fd-4e94-9d2d-681fb133ba32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:19:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a41c037e-936c-47e5-a8a9-40f232bc0ad5 req-6102573a-d79a-41e3-9d5b-37c6732830d2 service nova] Lock "3ff300ff-34fd-4e94-9d2d-681fb133ba32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:19:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a41c037e-936c-47e5-a8a9-40f232bc0ad5 req-6102573a-d79a-41e3-9d5b-37c6732830d2 service nova] Lock "3ff300ff-34fd-4e94-9d2d-681fb133ba32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:19:54 user nova-compute[72766]: DEBUG nova.compute.manager [req-a41c037e-936c-47e5-a8a9-40f232bc0ad5 req-6102573a-d79a-41e3-9d5b-37c6732830d2 service nova] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] No waiting events found dispatching network-vif-unplugged-c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:19:54 user nova-compute[72766]: DEBUG nova.compute.manager [req-a41c037e-936c-47e5-a8a9-40f232bc0ad5 req-6102573a-d79a-41e3-9d5b-37c6732830d2 service nova] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Received event network-vif-unplugged-c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:19:54 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Instance destroyed successfully.
Aug 14 23:19:54 user nova-compute[72766]: DEBUG nova.objects.instance [None req-6c15bd3e-4b2a-48cf-b8ba-0d8f8df60570 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lazy-loading 'resources' on Instance uuid 3ff300ff-34fd-4e94-9d2d-681fb133ba32 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:19:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-6c15bd3e-4b2a-48cf-b8ba-0d8f8df60570 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:00:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1502527097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1502527097',id=17,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:00:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3725c4b1cd78403f9628c8af9f8e5cc5',ramdisk_id='',reservation_id='r-mxh22qu1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-86235447',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:02:13Z,user_data=None,user_id='32e61321c50d4af28adeab72811a3f86',uuid=3ff300ff-34fd-4e94-9d2d-681fb133ba32,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d", "address": "fa:16:3e:67:f9:a0", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46ab9cb-e6", "ovs_interfaceid": "c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:19:54 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-6c15bd3e-4b2a-48cf-b8ba-0d8f8df60570 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Converting VIF {"id": "c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d", "address": "fa:16:3e:67:f9:a0", "network": {"id": "f4efdeee-d89b-45e5-b0d9-b45573564e9f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-541055049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3725c4b1cd78403f9628c8af9f8e5cc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46ab9cb-e6", "ovs_interfaceid": "c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:19:54 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-6c15bd3e-4b2a-48cf-b8ba-0d8f8df60570 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:f9:a0,bridge_name='br-int',has_traffic_filtering=True,id=c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d,network=Network(f4efdeee-d89b-45e5-b0d9-b45573564e9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc46ab9cb-e6') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:19:54 user nova-compute[72766]: DEBUG os_vif [None req-6c15bd3e-4b2a-48cf-b8ba-0d8f8df60570 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:f9:a0,bridge_name='br-int',has_traffic_filtering=True,id=c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d,network=Network(f4efdeee-d89b-45e5-b0d9-b45573564e9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc46ab9cb-e6') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:19:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc46ab9cb-e6, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:19:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:19:54 user nova-compute[72766]: INFO os_vif [None req-6c15bd3e-4b2a-48cf-b8ba-0d8f8df60570 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:f9:a0,bridge_name='br-int',has_traffic_filtering=True,id=c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d,network=Network(f4efdeee-d89b-45e5-b0d9-b45573564e9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc46ab9cb-e6')
Aug 14 23:19:54 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-6c15bd3e-4b2a-48cf-b8ba-0d8f8df60570 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Deleting instance files /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32_del
Aug 14 23:19:54 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-6c15bd3e-4b2a-48cf-b8ba-0d8f8df60570 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Deletion of /opt/stack/data/nova/instances/3ff300ff-34fd-4e94-9d2d-681fb133ba32_del complete
Aug 14 23:19:54 user nova-compute[72766]: INFO nova.compute.manager [None req-6c15bd3e-4b2a-48cf-b8ba-0d8f8df60570 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 14 23:19:54 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-6c15bd3e-4b2a-48cf-b8ba-0d8f8df60570 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:19:54 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:19:54 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:19:55 user nova-compute[72766]: DEBUG nova.compute.manager [req-e81e3e22-934e-47b6-a2aa-11e40ba1fb90 req-67a5a6a2-dc15-4a1a-8e71-c3c7c5a96315 service nova] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Received event network-vif-plugged-cc954c15-d2f1-421e-bd59-65e145e12ef6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:19:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e81e3e22-934e-47b6-a2aa-11e40ba1fb90 req-67a5a6a2-dc15-4a1a-8e71-c3c7c5a96315 service nova] Acquiring lock "f7dacacc-1e32-43c2-8e07-01b71103c007-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:19:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e81e3e22-934e-47b6-a2aa-11e40ba1fb90 req-67a5a6a2-dc15-4a1a-8e71-c3c7c5a96315 service nova] Lock "f7dacacc-1e32-43c2-8e07-01b71103c007-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:19:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e81e3e22-934e-47b6-a2aa-11e40ba1fb90 req-67a5a6a2-dc15-4a1a-8e71-c3c7c5a96315 service nova] Lock "f7dacacc-1e32-43c2-8e07-01b71103c007-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:19:55 user nova-compute[72766]: DEBUG nova.compute.manager [req-e81e3e22-934e-47b6-a2aa-11e40ba1fb90 req-67a5a6a2-dc15-4a1a-8e71-c3c7c5a96315 service nova] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] No waiting events found dispatching network-vif-plugged-cc954c15-d2f1-421e-bd59-65e145e12ef6 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:19:55 user nova-compute[72766]: WARNING nova.compute.manager [req-e81e3e22-934e-47b6-a2aa-11e40ba1fb90 req-67a5a6a2-dc15-4a1a-8e71-c3c7c5a96315 service nova] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Received unexpected event network-vif-plugged-cc954c15-d2f1-421e-bd59-65e145e12ef6 for instance with vm_state building and task_state spawning.
Aug 14 23:19:55 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692055195.1258621, f7dacacc-1e32-43c2-8e07-01b71103c007 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:19:55 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] VM Resumed (Lifecycle Event)
Aug 14 23:19:55 user nova-compute[72766]: DEBUG nova.compute.manager [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:19:55 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 23:19:55 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Instance spawned successfully.
Aug 14 23:19:55 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 23:19:55 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:19:55 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:19:55 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:19:55 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:19:55 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:19:55 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:19:55 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:19:55 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:19:55 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:19:55 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692055195.1291106, f7dacacc-1e32-43c2-8e07-01b71103c007 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:19:55 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] VM Started (Lifecycle Event)
Aug 14 23:19:55 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:19:55 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:19:55 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:19:55 user nova-compute[72766]: INFO nova.compute.manager [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Took 5.57 seconds to spawn the instance on the hypervisor.
Aug 14 23:19:55 user nova-compute[72766]: DEBUG nova.compute.manager [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:19:55 user nova-compute[72766]: INFO nova.compute.manager [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Took 6.23 seconds to build instance.
Aug 14 23:19:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-fc2918b5-d46c-405c-8016-1e3b4350f55b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "f7dacacc-1e32-43c2-8e07-01b71103c007" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.344s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:19:55 user nova-compute[72766]: DEBUG nova.compute.manager [req-6f89ad95-4b2d-425d-a429-1145b2f51fc2 req-e6146dec-b321-4fc9-835b-87fdcc8b0add service nova] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Received event network-vif-deleted-c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:19:55 user nova-compute[72766]: INFO nova.compute.manager [req-6f89ad95-4b2d-425d-a429-1145b2f51fc2 req-e6146dec-b321-4fc9-835b-87fdcc8b0add service nova] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Neutron deleted interface c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d; detaching it from the instance and deleting it from the info cache
Aug 14 23:19:55 user nova-compute[72766]: DEBUG nova.network.neutron [req-6f89ad95-4b2d-425d-a429-1145b2f51fc2 req-e6146dec-b321-4fc9-835b-87fdcc8b0add service nova] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:19:55 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:19:56 user nova-compute[72766]: DEBUG nova.compute.manager [req-6f89ad95-4b2d-425d-a429-1145b2f51fc2 req-e6146dec-b321-4fc9-835b-87fdcc8b0add service nova] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Detach interface failed, port_id=c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d, reason: Instance 3ff300ff-34fd-4e94-9d2d-681fb133ba32 could not be found. {{(pid=72766) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 23:19:56 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Took 1.02 seconds to deallocate network for instance.
Aug 14 23:19:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6c15bd3e-4b2a-48cf-b8ba-0d8f8df60570 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:19:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6c15bd3e-4b2a-48cf-b8ba-0d8f8df60570 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:19:56 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-6c15bd3e-4b2a-48cf-b8ba-0d8f8df60570 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:19:56 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-6c15bd3e-4b2a-48cf-b8ba-0d8f8df60570 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:19:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6c15bd3e-4b2a-48cf-b8ba-0d8f8df60570 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.240s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:19:56 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-6c15bd3e-4b2a-48cf-b8ba-0d8f8df60570 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Deleted allocations for instance 3ff300ff-34fd-4e94-9d2d-681fb133ba32
Aug 14 23:19:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6c15bd3e-4b2a-48cf-b8ba-0d8f8df60570 tempest-ServerBootFromVolumeStableRescueTest-86235447 tempest-ServerBootFromVolumeStableRescueTest-86235447-project-member] Lock "3ff300ff-34fd-4e94-9d2d-681fb133ba32" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.304s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:19:56 user nova-compute[72766]: DEBUG nova.compute.manager [req-449edf39-f919-4f6f-9927-079395b7fca5 req-4872338c-8e89-464a-be32-2ac48a863221 service nova] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Received event network-vif-plugged-c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:19:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-449edf39-f919-4f6f-9927-079395b7fca5 req-4872338c-8e89-464a-be32-2ac48a863221 service nova] Acquiring lock "3ff300ff-34fd-4e94-9d2d-681fb133ba32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:19:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-449edf39-f919-4f6f-9927-079395b7fca5 req-4872338c-8e89-464a-be32-2ac48a863221 service nova] Lock "3ff300ff-34fd-4e94-9d2d-681fb133ba32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:19:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-449edf39-f919-4f6f-9927-079395b7fca5 req-4872338c-8e89-464a-be32-2ac48a863221 service nova] Lock "3ff300ff-34fd-4e94-9d2d-681fb133ba32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:19:56 user nova-compute[72766]: DEBUG nova.compute.manager [req-449edf39-f919-4f6f-9927-079395b7fca5 req-4872338c-8e89-464a-be32-2ac48a863221 service nova] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] No waiting events found dispatching network-vif-plugged-c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:19:56 user nova-compute[72766]: WARNING nova.compute.manager [req-449edf39-f919-4f6f-9927-079395b7fca5 req-4872338c-8e89-464a-be32-2ac48a863221 service nova] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Received unexpected event network-vif-plugged-c46ab9cb-e6fd-44a8-a2ff-ca92ad37b15d for instance with vm_state deleted and task_state None.
Aug 14 23:19:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:19:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:20:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:20:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:20:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:20:09 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692055194.8855522, 3ff300ff-34fd-4e94-9d2d-681fb133ba32 => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:20:09 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] VM Stopped (Lifecycle Event)
Aug 14 23:20:09 user nova-compute[72766]: DEBUG nova.compute.manager [None req-15314263-06ca-4aac-b157-ec1953b3a61a None None] [instance: 3ff300ff-34fd-4e94-9d2d-681fb133ba32] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:20:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:20:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:20:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:20:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:20:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:20:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:20:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:20:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:20:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:20:32 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:20:32 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:20:32 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-cbcf7851-e6f7-4f46-97cc-d773286ccddf" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:20:32 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-cbcf7851-e6f7-4f46-97cc-d773286ccddf" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:20:32 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:20:33 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Updating instance_info_cache with network_info: [{"id": "8f65f8f0-60fe-4fdb-af66-424a85b12caf", "address": "fa:16:3e:70:30:66", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f65f8f0-60", "ovs_interfaceid": "8f65f8f0-60fe-4fdb-af66-424a85b12caf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:20:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-cbcf7851-e6f7-4f46-97cc-d773286ccddf" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:20:33 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:20:33 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:20:34 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:20:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:20:35 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:20:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:20:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:20:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:20:35 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:20:35 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7dacacc-1e32-43c2-8e07-01b71103c007/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:20:36 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7dacacc-1e32-43c2-8e07-01b71103c007/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:20:36 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7dacacc-1e32-43c2-8e07-01b71103c007/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:20:36 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7dacacc-1e32-43c2-8e07-01b71103c007/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:20:36 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f658f249-cb92-4fc1-b1fb-cb6925cf7e1c/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:20:36 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f658f249-cb92-4fc1-b1fb-cb6925cf7e1c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:20:36 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f658f249-cb92-4fc1-b1fb-cb6925cf7e1c/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:20:36 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f658f249-cb92-4fc1-b1fb-cb6925cf7e1c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:20:36 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:20:36 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:20:36 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:20:36 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:20:36 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:20:36 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:20:37 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:20:37 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:20:37 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=8268MB free_disk=25.37042236328125GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:20:37 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:20:37 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:20:37 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance cbcf7851-e6f7-4f46-97cc-d773286ccddf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:20:37 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance f658f249-cb92-4fc1-b1fb-cb6925cf7e1c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:20:37 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance b913283d-2446-432b-9c59-9d0e91bb5309 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:20:37 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance f7dacacc-1e32-43c2-8e07-01b71103c007 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:20:37 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:20:37 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:20:37 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:20:37 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:20:37 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:20:37 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.290s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:20:39 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:20:39 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:20:39 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:20:39 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:20:42 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:20:42 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:20:44 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:20:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:20:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:20:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:20:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:20:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:20:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:20:47 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:20:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:20:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:20:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:20:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:20:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:20:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:20:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:20:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:21:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:21:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "b913283d-2446-432b-9c59-9d0e91bb5309" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:21:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "b913283d-2446-432b-9c59-9d0e91bb5309" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:21:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "b913283d-2446-432b-9c59-9d0e91bb5309-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:21:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "b913283d-2446-432b-9c59-9d0e91bb5309-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:21:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "b913283d-2446-432b-9c59-9d0e91bb5309-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:21:08 user nova-compute[72766]: INFO nova.compute.manager [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Terminating instance
Aug 14 23:21:08 user nova-compute[72766]: DEBUG nova.compute.manager [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:21:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:21:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:21:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG nova.compute.manager [req-4da7149e-4ecd-4689-aa81-c1df7c278313 req-23f835dc-b64e-4f48-aa03-b76a8ae491fa service nova] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Received event network-vif-unplugged-b1133fb7-42f6-42a4-b7ee-a18dd5a45d59 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-4da7149e-4ecd-4689-aa81-c1df7c278313 req-23f835dc-b64e-4f48-aa03-b76a8ae491fa service nova] Acquiring lock "b913283d-2446-432b-9c59-9d0e91bb5309-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-4da7149e-4ecd-4689-aa81-c1df7c278313 req-23f835dc-b64e-4f48-aa03-b76a8ae491fa service nova] Lock "b913283d-2446-432b-9c59-9d0e91bb5309-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-4da7149e-4ecd-4689-aa81-c1df7c278313 req-23f835dc-b64e-4f48-aa03-b76a8ae491fa service nova] Lock "b913283d-2446-432b-9c59-9d0e91bb5309-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG nova.compute.manager [req-4da7149e-4ecd-4689-aa81-c1df7c278313 req-23f835dc-b64e-4f48-aa03-b76a8ae491fa service nova] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] No waiting events found dispatching network-vif-unplugged-b1133fb7-42f6-42a4-b7ee-a18dd5a45d59 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG nova.compute.manager [req-4da7149e-4ecd-4689-aa81-c1df7c278313 req-23f835dc-b64e-4f48-aa03-b76a8ae491fa service nova] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Received event network-vif-unplugged-b1133fb7-42f6-42a4-b7ee-a18dd5a45d59 for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:21:09 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Instance destroyed successfully.
Aug 14 23:21:09 user nova-compute[72766]: DEBUG nova.objects.instance [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lazy-loading 'resources' on Instance uuid b913283d-2446-432b-9c59-9d0e91bb5309 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:19:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1893257722',display_name='tempest-TestVolumeBootPattern-server-1893257722',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1893257722',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:19:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3c9f53727cc497c94516ff7fa1bbf4f',ramdisk_id='',reservation_id='r-z5wvdxvc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-213280496',owner_user_name='tempest-TestVolumeBootPattern-213280496-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:19:39Z,user_data=None,user_id='999390ac8e6240199c9a7484e234f3a7',uuid=b913283d-2446-432b-9c59-9d0e91bb5309,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1133fb7-42f6-42a4-b7ee-a18dd5a45d59", "address": "fa:16:3e:56:59:20", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1133fb7-42", "ovs_interfaceid": "b1133fb7-42f6-42a4-b7ee-a18dd5a45d59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Converting VIF {"id": "b1133fb7-42f6-42a4-b7ee-a18dd5a45d59", "address": "fa:16:3e:56:59:20", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1133fb7-42", "ovs_interfaceid": "b1133fb7-42f6-42a4-b7ee-a18dd5a45d59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:59:20,bridge_name='br-int',has_traffic_filtering=True,id=b1133fb7-42f6-42a4-b7ee-a18dd5a45d59,network=Network(f418a384-bbac-4892-8e0f-c7af2e9464ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1133fb7-42') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG os_vif [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:59:20,bridge_name='br-int',has_traffic_filtering=True,id=b1133fb7-42f6-42a4-b7ee-a18dd5a45d59,network=Network(f418a384-bbac-4892-8e0f-c7af2e9464ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1133fb7-42') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1133fb7-42, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:21:09 user nova-compute[72766]: INFO os_vif [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:59:20,bridge_name='br-int',has_traffic_filtering=True,id=b1133fb7-42f6-42a4-b7ee-a18dd5a45d59,network=Network(f418a384-bbac-4892-8e0f-c7af2e9464ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1133fb7-42')
Aug 14 23:21:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OsfgQSjZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:21:09 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:21:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[05705aae-cf76-4398-88a1-91f2cde23054]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[458028fd-4dee-4461-853f-c080ab02894b]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7 (non-flash)
Aug 14 23:21:09 user nova-compute[72766]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f (non-flash)
Aug 14 23:21:09 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7 (non-flash)
Aug 14 23:21:09 user nova-compute[72766]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f (non-flash)
Aug 14 23:21:09 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff1741cd5a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7'): ({'sdb'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Removing single pathed devices sdb {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f2afd5-d490-4988-a1b3-f956e6f2df62]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a011a6-baf9-4adb-bba3-7662184f326b]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Flushing IO for device /dev/sdb {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[89bbaca9-a600-4a40-bed3-5cd010da5339]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa55d754-61ef-4653-b39b-9cd7eb9699ea]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] SCSI volumes sdb have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f919d47-dbf8-416a-a87a-a381d26929a5]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7 -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4080dec9-c7ae-46fa-a89e-ea48c832e913]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7, portal: 172.16.0.220,3260]
Aug 14 23:21:09 user nova-compute[72766]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7, portal: 172.16.0.220,3260] successful.
Aug 14 23:21:09 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7 -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c19b3ca8-8061-4212-b07b-d995398bb2f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e692b2-3e61-4310-b9dc-d5dfa5493631]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] <== disconnect_volume: return (296ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:21:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:21:09 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Deleting instance files /opt/stack/data/nova/instances/b913283d-2446-432b-9c59-9d0e91bb5309_del
Aug 14 23:21:09 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Deletion of /opt/stack/data/nova/instances/b913283d-2446-432b-9c59-9d0e91bb5309_del complete
Aug 14 23:21:10 user nova-compute[72766]: INFO nova.compute.manager [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 14 23:21:10 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:21:10 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:21:10 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:21:10 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:21:10 user nova-compute[72766]: DEBUG nova.compute.manager [req-8cd8db85-b0cf-4f87-8b17-5bce147fc971 req-f6b1516b-8d7a-4ab6-8636-cc24ff0bf168 service nova] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Received event network-vif-deleted-b1133fb7-42f6-42a4-b7ee-a18dd5a45d59 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:21:10 user nova-compute[72766]: INFO nova.compute.manager [req-8cd8db85-b0cf-4f87-8b17-5bce147fc971 req-f6b1516b-8d7a-4ab6-8636-cc24ff0bf168 service nova] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Neutron deleted interface b1133fb7-42f6-42a4-b7ee-a18dd5a45d59; detaching it from the instance and deleting it from the info cache
Aug 14 23:21:10 user nova-compute[72766]: DEBUG nova.network.neutron [req-8cd8db85-b0cf-4f87-8b17-5bce147fc971 req-f6b1516b-8d7a-4ab6-8636-cc24ff0bf168 service nova] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:21:10 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Took 0.52 seconds to deallocate network for instance.
Aug 14 23:21:10 user nova-compute[72766]: DEBUG nova.compute.manager [req-8cd8db85-b0cf-4f87-8b17-5bce147fc971 req-f6b1516b-8d7a-4ab6-8636-cc24ff0bf168 service nova] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Detach interface failed, port_id=b1133fb7-42f6-42a4-b7ee-a18dd5a45d59, reason: Instance b913283d-2446-432b-9c59-9d0e91bb5309 could not be found. {{(pid=72766) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 23:21:11 user nova-compute[72766]: DEBUG nova.compute.manager [req-4ce27cd9-2b95-442c-accb-757a974f0864 req-c07e3d02-3348-4712-8d0a-05b2e8441928 service nova] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Received event network-vif-plugged-b1133fb7-42f6-42a4-b7ee-a18dd5a45d59 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:21:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-4ce27cd9-2b95-442c-accb-757a974f0864 req-c07e3d02-3348-4712-8d0a-05b2e8441928 service nova] Acquiring lock "b913283d-2446-432b-9c59-9d0e91bb5309-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:21:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-4ce27cd9-2b95-442c-accb-757a974f0864 req-c07e3d02-3348-4712-8d0a-05b2e8441928 service nova] Lock "b913283d-2446-432b-9c59-9d0e91bb5309-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:21:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-4ce27cd9-2b95-442c-accb-757a974f0864 req-c07e3d02-3348-4712-8d0a-05b2e8441928 service nova] Lock "b913283d-2446-432b-9c59-9d0e91bb5309-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:21:11 user nova-compute[72766]: DEBUG nova.compute.manager [req-4ce27cd9-2b95-442c-accb-757a974f0864 req-c07e3d02-3348-4712-8d0a-05b2e8441928 service nova] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] No waiting events found dispatching network-vif-plugged-b1133fb7-42f6-42a4-b7ee-a18dd5a45d59 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:21:11 user nova-compute[72766]: WARNING nova.compute.manager [req-4ce27cd9-2b95-442c-accb-757a974f0864 req-c07e3d02-3348-4712-8d0a-05b2e8441928 service nova] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Received unexpected event network-vif-plugged-b1133fb7-42f6-42a4-b7ee-a18dd5a45d59 for instance with vm_state active and task_state deleting.
Aug 14 23:21:11 user nova-compute[72766]: INFO nova.compute.manager [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Took 0.75 seconds to detach 1 volumes for instance.
Aug 14 23:21:11 user nova-compute[72766]: DEBUG nova.compute.manager [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Deleting volume: c19b3ca8-8061-4212-b07b-d995398bb2f7 {{(pid=72766) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 23:21:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:21:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:21:11 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:21:11 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:21:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.178s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:21:11 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Deleted allocations for instance b913283d-2446-432b-9c59-9d0e91bb5309
Aug 14 23:21:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-77b447cb-4b9e-45e5-9981-28e1df627688 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "b913283d-2446-432b-9c59-9d0e91bb5309" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.865s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:21:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:21:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:21:22 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:21:24 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692055269.6481712, b913283d-2446-432b-9c59-9d0e91bb5309 => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:21:24 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] VM Stopped (Lifecycle Event)
Aug 14 23:21:24 user nova-compute[72766]: DEBUG nova.compute.manager [None req-1a64370a-ae86-4af7-8086-522d6226f754 None None] [instance: b913283d-2446-432b-9c59-9d0e91bb5309] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:21:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:21:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:21:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:21:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:21:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:21:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:21:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:21:33 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:21:34 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:21:34 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:21:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:21:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:21:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:21:34 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:21:35 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Updating instance_info_cache with network_info: [{"id": "0df45a26-6026-4baa-bdaa-a761d2d3c2a6", "address": "fa:16:3e:89:96:a5", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0df45a26-60", "ovs_interfaceid": "0df45a26-6026-4baa-bdaa-a761d2d3c2a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:21:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:21:35 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:21:35 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:21:35 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:21:35 user nova-compute[72766]: WARNING nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] While synchronizing instance power states, found 4 instances in the database and 3 instances on the hypervisor.
Aug 14 23:21:35 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Triggering sync for uuid cbcf7851-e6f7-4f46-97cc-d773286ccddf {{(pid=72766) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 23:21:35 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Triggering sync for uuid 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef {{(pid=72766) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 23:21:35 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Triggering sync for uuid f658f249-cb92-4fc1-b1fb-cb6925cf7e1c {{(pid=72766) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 23:21:35 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Triggering sync for uuid f7dacacc-1e32-43c2-8e07-01b71103c007 {{(pid=72766) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 23:21:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "cbcf7851-e6f7-4f46-97cc-d773286ccddf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:21:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "cbcf7851-e6f7-4f46-97cc-d773286ccddf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:21:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:21:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:21:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "f658f249-cb92-4fc1-b1fb-cb6925cf7e1c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:21:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "f658f249-cb92-4fc1-b1fb-cb6925cf7e1c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:21:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "f7dacacc-1e32-43c2-8e07-01b71103c007" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:21:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "f7dacacc-1e32-43c2-8e07-01b71103c007" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:21:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:21:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "cbcf7851-e6f7-4f46-97cc-d773286ccddf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:21:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "f658f249-cb92-4fc1-b1fb-cb6925cf7e1c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:21:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "f7dacacc-1e32-43c2-8e07-01b71103c007" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:21:36 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:21:36 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:21:36 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:21:36 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:21:36 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:21:36 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7dacacc-1e32-43c2-8e07-01b71103c007/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:21:37 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7dacacc-1e32-43c2-8e07-01b71103c007/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:21:37 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7dacacc-1e32-43c2-8e07-01b71103c007/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:21:37 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7dacacc-1e32-43c2-8e07-01b71103c007/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:21:37 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f658f249-cb92-4fc1-b1fb-cb6925cf7e1c/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:21:37 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f658f249-cb92-4fc1-b1fb-cb6925cf7e1c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:21:37 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f658f249-cb92-4fc1-b1fb-cb6925cf7e1c/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:21:37 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f658f249-cb92-4fc1-b1fb-cb6925cf7e1c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:21:37 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:21:37 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:21:37 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:21:37 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:21:37 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:21:38 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:21:38 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:21:38 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=8483MB free_disk=25.360485076904297GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:21:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:21:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:21:38 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance cbcf7851-e6f7-4f46-97cc-d773286ccddf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:21:38 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance f658f249-cb92-4fc1-b1fb-cb6925cf7e1c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:21:38 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance f7dacacc-1e32-43c2-8e07-01b71103c007 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:21:38 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:21:38 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:21:38 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Refreshing inventories for resource provider 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 23:21:38 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Updating ProviderTree inventory for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 23:21:38 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Updating inventory in ProviderTree for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 23:21:38 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Refreshing aggregate associations for resource provider 45c8ff08-bf31-4ab6-8452-2e293102f899, aggregates: None {{(pid=72766) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 23:21:38 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Refreshing trait associations for resource provider 45c8ff08-bf31-4ab6-8452-2e293102f899, traits: COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=72766) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 23:21:38 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:21:38 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:21:38 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:21:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.532s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:21:39 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:21:40 user nova-compute[72766]: DEBUG nova.compute.manager [req-ca8cf13e-0a8a-4781-9b13-e55aec61f3d9 req-bb2e4444-caf9-48b7-a120-bfbf8ddd4c2c service nova] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Received event network-changed-cc954c15-d2f1-421e-bd59-65e145e12ef6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:21:40 user nova-compute[72766]: DEBUG nova.compute.manager [req-ca8cf13e-0a8a-4781-9b13-e55aec61f3d9 req-bb2e4444-caf9-48b7-a120-bfbf8ddd4c2c service nova] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Refreshing instance network info cache due to event network-changed-cc954c15-d2f1-421e-bd59-65e145e12ef6. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:21:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ca8cf13e-0a8a-4781-9b13-e55aec61f3d9 req-bb2e4444-caf9-48b7-a120-bfbf8ddd4c2c service nova] Acquiring lock "refresh_cache-f7dacacc-1e32-43c2-8e07-01b71103c007" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:21:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ca8cf13e-0a8a-4781-9b13-e55aec61f3d9 req-bb2e4444-caf9-48b7-a120-bfbf8ddd4c2c service nova] Acquired lock "refresh_cache-f7dacacc-1e32-43c2-8e07-01b71103c007" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:21:40 user nova-compute[72766]: DEBUG nova.network.neutron [req-ca8cf13e-0a8a-4781-9b13-e55aec61f3d9 req-bb2e4444-caf9-48b7-a120-bfbf8ddd4c2c service nova] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Refreshing network info cache for port cc954c15-d2f1-421e-bd59-65e145e12ef6 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:21:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6529fa16-60ef-449a-ad1e-fae727c00a22 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "f7dacacc-1e32-43c2-8e07-01b71103c007" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:21:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6529fa16-60ef-449a-ad1e-fae727c00a22 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "f7dacacc-1e32-43c2-8e07-01b71103c007" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:21:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6529fa16-60ef-449a-ad1e-fae727c00a22 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "f7dacacc-1e32-43c2-8e07-01b71103c007-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:21:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6529fa16-60ef-449a-ad1e-fae727c00a22 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "f7dacacc-1e32-43c2-8e07-01b71103c007-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:21:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6529fa16-60ef-449a-ad1e-fae727c00a22 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "f7dacacc-1e32-43c2-8e07-01b71103c007-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:21:40 user nova-compute[72766]: INFO nova.compute.manager [None req-6529fa16-60ef-449a-ad1e-fae727c00a22 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Terminating instance
Aug 14 23:21:40 user nova-compute[72766]: DEBUG nova.compute.manager [None req-6529fa16-60ef-449a-ad1e-fae727c00a22 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:21:40 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:21:40 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:21:40 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:21:40 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:21:41 user nova-compute[72766]: DEBUG nova.network.neutron [req-ca8cf13e-0a8a-4781-9b13-e55aec61f3d9 req-bb2e4444-caf9-48b7-a120-bfbf8ddd4c2c service nova] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Updated VIF entry in instance network info cache for port cc954c15-d2f1-421e-bd59-65e145e12ef6. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:21:41 user nova-compute[72766]: DEBUG nova.network.neutron [req-ca8cf13e-0a8a-4781-9b13-e55aec61f3d9 req-bb2e4444-caf9-48b7-a120-bfbf8ddd4c2c service nova] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Updating instance_info_cache with network_info: [{"id": "cc954c15-d2f1-421e-bd59-65e145e12ef6", "address": "fa:16:3e:3e:ab:f4", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc954c15-d2", "ovs_interfaceid": "cc954c15-d2f1-421e-bd59-65e145e12ef6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:21:41 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ca8cf13e-0a8a-4781-9b13-e55aec61f3d9 req-bb2e4444-caf9-48b7-a120-bfbf8ddd4c2c service nova] Releasing lock "refresh_cache-f7dacacc-1e32-43c2-8e07-01b71103c007" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:21:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:21:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:21:41 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Instance destroyed successfully.
Aug 14 23:21:41 user nova-compute[72766]: DEBUG nova.objects.instance [None req-6529fa16-60ef-449a-ad1e-fae727c00a22 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lazy-loading 'resources' on Instance uuid f7dacacc-1e32-43c2-8e07-01b71103c007 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:21:41 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-6529fa16-60ef-449a-ad1e-fae727c00a22 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:19:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1599577153',display_name='tempest-AttachVolumeNegativeTest-server-1599577153',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1599577153',id=36,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPlgEPqURESY6kfwd7o8wChwpo7eiBsH75Lo1DrboxJec0L/YunW6o+rOChnE/c8wEXXkEoWxY7rU+eXW+RE73ylvCCMCzzzo/DSevfnsLKfXy207J39Yj9974QMvmn6A==',key_name='tempest-keypair-795283177',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:19:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3785d8cff6cd41a4aff8becf528e3a4c',ramdisk_id='',reservation_id='r-6jwyx5py',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1623363641',owner_user_name='tempest-AttachVolumeNegativeTest-1623363641-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:19:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90e68d4dfd6048d99037fce632788b57',uuid=f7dacacc-1e32-43c2-8e07-01b71103c007,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc954c15-d2f1-421e-bd59-65e145e12ef6", "address": "fa:16:3e:3e:ab:f4", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc954c15-d2", "ovs_interfaceid": "cc954c15-d2f1-421e-bd59-65e145e12ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:21:41 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-6529fa16-60ef-449a-ad1e-fae727c00a22 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Converting VIF {"id": "cc954c15-d2f1-421e-bd59-65e145e12ef6", "address": "fa:16:3e:3e:ab:f4", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc954c15-d2", "ovs_interfaceid": "cc954c15-d2f1-421e-bd59-65e145e12ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:21:41 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-6529fa16-60ef-449a-ad1e-fae727c00a22 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:ab:f4,bridge_name='br-int',has_traffic_filtering=True,id=cc954c15-d2f1-421e-bd59-65e145e12ef6,network=Network(9491b8be-e6b2-4770-a591-370db9a96785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc954c15-d2') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:21:41 user nova-compute[72766]: DEBUG os_vif [None req-6529fa16-60ef-449a-ad1e-fae727c00a22 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:ab:f4,bridge_name='br-int',has_traffic_filtering=True,id=cc954c15-d2f1-421e-bd59-65e145e12ef6,network=Network(9491b8be-e6b2-4770-a591-370db9a96785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc954c15-d2') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:21:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:21:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc954c15-d2, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:21:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:21:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:21:41 user nova-compute[72766]: INFO os_vif [None req-6529fa16-60ef-449a-ad1e-fae727c00a22 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:ab:f4,bridge_name='br-int',has_traffic_filtering=True,id=cc954c15-d2f1-421e-bd59-65e145e12ef6,network=Network(9491b8be-e6b2-4770-a591-370db9a96785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc954c15-d2')
Aug 14 23:21:41 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-6529fa16-60ef-449a-ad1e-fae727c00a22 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Deleting instance files /opt/stack/data/nova/instances/f7dacacc-1e32-43c2-8e07-01b71103c007_del
Aug 14 23:21:41 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-6529fa16-60ef-449a-ad1e-fae727c00a22 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Deletion of /opt/stack/data/nova/instances/f7dacacc-1e32-43c2-8e07-01b71103c007_del complete
Aug 14 23:21:41 user nova-compute[72766]: INFO nova.compute.manager [None req-6529fa16-60ef-449a-ad1e-fae727c00a22 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 14 23:21:41 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-6529fa16-60ef-449a-ad1e-fae727c00a22 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:21:41 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:21:41 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:21:41 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:21:41 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:21:42 user nova-compute[72766]: DEBUG nova.compute.manager [req-e9b8baf5-cca5-4eed-b950-77be4fdb3fc9 req-9bee87e6-344d-499c-8e9a-1a850b5a5d21 service nova] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Received event network-vif-unplugged-cc954c15-d2f1-421e-bd59-65e145e12ef6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:21:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e9b8baf5-cca5-4eed-b950-77be4fdb3fc9 req-9bee87e6-344d-499c-8e9a-1a850b5a5d21 service nova] Acquiring lock "f7dacacc-1e32-43c2-8e07-01b71103c007-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:21:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e9b8baf5-cca5-4eed-b950-77be4fdb3fc9 req-9bee87e6-344d-499c-8e9a-1a850b5a5d21 service nova] Lock "f7dacacc-1e32-43c2-8e07-01b71103c007-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:21:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e9b8baf5-cca5-4eed-b950-77be4fdb3fc9 req-9bee87e6-344d-499c-8e9a-1a850b5a5d21 service nova] Lock "f7dacacc-1e32-43c2-8e07-01b71103c007-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:21:42 user nova-compute[72766]: DEBUG nova.compute.manager [req-e9b8baf5-cca5-4eed-b950-77be4fdb3fc9 req-9bee87e6-344d-499c-8e9a-1a850b5a5d21 service nova] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] No waiting events found dispatching network-vif-unplugged-cc954c15-d2f1-421e-bd59-65e145e12ef6 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:21:42 user nova-compute[72766]: DEBUG nova.compute.manager [req-e9b8baf5-cca5-4eed-b950-77be4fdb3fc9 req-9bee87e6-344d-499c-8e9a-1a850b5a5d21 service nova] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Received event network-vif-unplugged-cc954c15-d2f1-421e-bd59-65e145e12ef6 for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:21:42 user nova-compute[72766]: DEBUG nova.compute.manager [req-e9b8baf5-cca5-4eed-b950-77be4fdb3fc9 req-9bee87e6-344d-499c-8e9a-1a850b5a5d21 service nova] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Received event network-vif-plugged-cc954c15-d2f1-421e-bd59-65e145e12ef6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:21:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e9b8baf5-cca5-4eed-b950-77be4fdb3fc9 req-9bee87e6-344d-499c-8e9a-1a850b5a5d21 service nova] Acquiring lock "f7dacacc-1e32-43c2-8e07-01b71103c007-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:21:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e9b8baf5-cca5-4eed-b950-77be4fdb3fc9 req-9bee87e6-344d-499c-8e9a-1a850b5a5d21 service nova] Lock "f7dacacc-1e32-43c2-8e07-01b71103c007-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:21:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e9b8baf5-cca5-4eed-b950-77be4fdb3fc9 req-9bee87e6-344d-499c-8e9a-1a850b5a5d21 service nova] Lock "f7dacacc-1e32-43c2-8e07-01b71103c007-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:21:42 user nova-compute[72766]: DEBUG nova.compute.manager [req-e9b8baf5-cca5-4eed-b950-77be4fdb3fc9 req-9bee87e6-344d-499c-8e9a-1a850b5a5d21 service nova] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] No waiting events found dispatching network-vif-plugged-cc954c15-d2f1-421e-bd59-65e145e12ef6 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:21:42 user nova-compute[72766]: WARNING nova.compute.manager [req-e9b8baf5-cca5-4eed-b950-77be4fdb3fc9 req-9bee87e6-344d-499c-8e9a-1a850b5a5d21 service nova] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Received unexpected event network-vif-plugged-cc954c15-d2f1-421e-bd59-65e145e12ef6 for instance with vm_state active and task_state deleting.
Aug 14 23:21:42 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:21:42 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:21:42 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Took 1.20 seconds to deallocate network for instance.
Aug 14 23:21:42 user nova-compute[72766]: DEBUG nova.compute.manager [req-a8caada5-567d-4b21-a265-47a905e9da08 req-0c5ff952-912f-4873-a7c0-1103a1dae8e8 service nova] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Received event network-vif-deleted-cc954c15-d2f1-421e-bd59-65e145e12ef6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:21:42 user nova-compute[72766]: INFO nova.compute.manager [req-a8caada5-567d-4b21-a265-47a905e9da08 req-0c5ff952-912f-4873-a7c0-1103a1dae8e8 service nova] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Neutron deleted interface cc954c15-d2f1-421e-bd59-65e145e12ef6; detaching it from the instance and deleting it from the info cache
Aug 14 23:21:42 user nova-compute[72766]: DEBUG nova.network.neutron [req-a8caada5-567d-4b21-a265-47a905e9da08 req-0c5ff952-912f-4873-a7c0-1103a1dae8e8 service nova] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:21:42 user nova-compute[72766]: DEBUG nova.compute.manager [req-a8caada5-567d-4b21-a265-47a905e9da08 req-0c5ff952-912f-4873-a7c0-1103a1dae8e8 service nova] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Detach interface failed, port_id=cc954c15-d2f1-421e-bd59-65e145e12ef6, reason: Instance f7dacacc-1e32-43c2-8e07-01b71103c007 could not be found. {{(pid=72766) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 23:21:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6529fa16-60ef-449a-ad1e-fae727c00a22 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:21:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6529fa16-60ef-449a-ad1e-fae727c00a22 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:21:43 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-6529fa16-60ef-449a-ad1e-fae727c00a22 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:21:43 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-6529fa16-60ef-449a-ad1e-fae727c00a22 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:21:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6529fa16-60ef-449a-ad1e-fae727c00a22 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.157s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:21:43 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-6529fa16-60ef-449a-ad1e-fae727c00a22 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Deleted allocations for instance f7dacacc-1e32-43c2-8e07-01b71103c007
Aug 14 23:21:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6529fa16-60ef-449a-ad1e-fae727c00a22 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "f7dacacc-1e32-43c2-8e07-01b71103c007" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.528s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:21:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:21:44 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:21:44 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:21:44 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:21:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:21:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:21:52 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:21:52 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72766) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 23:21:54 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:21:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Cleaning up deleted instances {{(pid=72766) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 23:21:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] There are 0 instances to clean {{(pid=72766) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 23:21:55 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:21:56 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692055301.5566044, f7dacacc-1e32-43c2-8e07-01b71103c007 => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:21:56 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] VM Stopped (Lifecycle Event)
Aug 14 23:21:56 user nova-compute[72766]: DEBUG nova.compute.manager [None req-42386a80-749b-4232-9686-334cad38ebdf None None] [instance: f7dacacc-1e32-43c2-8e07-01b71103c007] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:21:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:21:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:21:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:21:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:21:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:21:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:22:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:22:06 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:22:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:22:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:22:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:22:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:22:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:22:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:22:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:22:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:22:21 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "22fcbe70-f8b6-4a57-ac95-296bac414544" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:22:21 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "22fcbe70-f8b6-4a57-ac95-296bac414544" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:22:21 user nova-compute[72766]: DEBUG nova.compute.manager [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 23:22:21 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:22:21 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:22:21 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 23:22:21 user nova-compute[72766]: INFO nova.compute.claims [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Claim successful on node user
Aug 14 23:22:22 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:22:22 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:22:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.229s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:22:22 user nova-compute[72766]: DEBUG nova.compute.manager [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 23:22:22 user nova-compute[72766]: DEBUG nova.compute.manager [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 23:22:22 user nova-compute[72766]: DEBUG nova.network.neutron [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 23:22:22 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 23:22:22 user nova-compute[72766]: DEBUG nova.compute.manager [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 23:22:22 user nova-compute[72766]: DEBUG nova.policy [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '999390ac8e6240199c9a7484e234f3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c9f53727cc497c94516ff7fa1bbf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 23:22:22 user nova-compute[72766]: INFO nova.virt.block_device [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Booting with volume 0d5442fe-5df3-46b0-9419-1403d2ddffe9 at /dev/vda
Aug 14 23:22:22 user nova-compute[72766]: DEBUG os_brick.utils [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:22:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:22:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:22:22 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[59046829-2b68-435b-8ce5-aa10a4aea598]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:22:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:22:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:22:22 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[034144d4-0c58-41c0-b52a-b9167f12833f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:22:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:22:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:22:22 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[58070218-0aad-49fc-b249-2c0e73d1e9b1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:22:22 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfeeb038-7781-4e07-95c6-d8612921c8ba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:22:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:22:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:22:22 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 23:22:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:22:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:22:22 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 23:22:22 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a9d9a7-9801-47f0-b073-7b9e778b8052]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:22:22 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 23:22:22 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 23:22:22 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 23:22:22 user nova-compute[72766]: DEBUG os_brick.utils [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:22:22 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Updating existing volume attachment record: 39a384cb-8de2-479a-a367-9846403c02eb {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 23:22:22 user nova-compute[72766]: DEBUG nova.network.neutron [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Successfully created port: f6796bc3-3d20-4f6b-83ef-0d97754ecf19 {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 23:22:23 user nova-compute[72766]: DEBUG nova.network.neutron [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Successfully updated port: f6796bc3-3d20-4f6b-83ef-0d97754ecf19 {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 23:22:23 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "refresh_cache-22fcbe70-f8b6-4a57-ac95-296bac414544" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:22:23 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquired lock "refresh_cache-22fcbe70-f8b6-4a57-ac95-296bac414544" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:22:23 user nova-compute[72766]: DEBUG nova.network.neutron [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:22:23 user nova-compute[72766]: DEBUG nova.network.neutron [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 23:22:23 user nova-compute[72766]: DEBUG nova.compute.manager [req-e0cb939b-3409-4179-893c-0ffd6c32898e req-30e98157-dedf-40ec-a47d-b6901db6bcfa service nova] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Received event network-changed-f6796bc3-3d20-4f6b-83ef-0d97754ecf19 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:22:23 user nova-compute[72766]: DEBUG nova.compute.manager [req-e0cb939b-3409-4179-893c-0ffd6c32898e req-30e98157-dedf-40ec-a47d-b6901db6bcfa service nova] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Refreshing instance network info cache due to event network-changed-f6796bc3-3d20-4f6b-83ef-0d97754ecf19. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:22:23 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e0cb939b-3409-4179-893c-0ffd6c32898e req-30e98157-dedf-40ec-a47d-b6901db6bcfa service nova] Acquiring lock "refresh_cache-22fcbe70-f8b6-4a57-ac95-296bac414544" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:22:24 user nova-compute[72766]: DEBUG nova.network.neutron [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Updating instance_info_cache with network_info: [{"id": "f6796bc3-3d20-4f6b-83ef-0d97754ecf19", "address": "fa:16:3e:df:bc:df", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6796bc3-3d", "ovs_interfaceid": "f6796bc3-3d20-4f6b-83ef-0d97754ecf19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:22:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Releasing lock "refresh_cache-22fcbe70-f8b6-4a57-ac95-296bac414544" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:22:24 user nova-compute[72766]: DEBUG nova.compute.manager [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Instance network_info: |[{"id": "f6796bc3-3d20-4f6b-83ef-0d97754ecf19", "address": "fa:16:3e:df:bc:df", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6796bc3-3d", "ovs_interfaceid": "f6796bc3-3d20-4f6b-83ef-0d97754ecf19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 23:22:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e0cb939b-3409-4179-893c-0ffd6c32898e req-30e98157-dedf-40ec-a47d-b6901db6bcfa service nova] Acquired lock "refresh_cache-22fcbe70-f8b6-4a57-ac95-296bac414544" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:22:24 user nova-compute[72766]: DEBUG nova.network.neutron [req-e0cb939b-3409-4179-893c-0ffd6c32898e req-30e98157-dedf-40ec-a47d-b6901db6bcfa service nova] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Refreshing network info cache for port f6796bc3-3d20-4f6b-83ef-0d97754ecf19 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:22:24 user nova-compute[72766]: DEBUG nova.network.neutron [req-e0cb939b-3409-4179-893c-0ffd6c32898e req-30e98157-dedf-40ec-a47d-b6901db6bcfa service nova] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Updated VIF entry in instance network info cache for port f6796bc3-3d20-4f6b-83ef-0d97754ecf19. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:22:24 user nova-compute[72766]: DEBUG nova.network.neutron [req-e0cb939b-3409-4179-893c-0ffd6c32898e req-30e98157-dedf-40ec-a47d-b6901db6bcfa service nova] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Updating instance_info_cache with network_info: [{"id": "f6796bc3-3d20-4f6b-83ef-0d97754ecf19", "address": "fa:16:3e:df:bc:df", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6796bc3-3d", "ovs_interfaceid": "f6796bc3-3d20-4f6b-83ef-0d97754ecf19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:22:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e0cb939b-3409-4179-893c-0ffd6c32898e req-30e98157-dedf-40ec-a47d-b6901db6bcfa service nova] Releasing lock "refresh_cache-22fcbe70-f8b6-4a57-ac95-296bac414544" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:22:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG nova.compute.manager [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 23:22:31 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Creating image(s)
Aug 14 23:22:31 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Did not create local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Ensure instance console log exists: /opt/stack/data/nova/instances/22fcbe70-f8b6-4a57-ac95-296bac414544/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Start _get_guest_xml network_info=[{"id": "f6796bc3-3d20-4f6b-83ef-0d97754ecf19", "address": "fa:16:3e:df:bc:df", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6796bc3-3d", "ovs_interfaceid": "f6796bc3-3d20-4f6b-83ef-0d97754ecf19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': '39a384cb-8de2-479a-a367-9846403c02eb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vAMENZSR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '22fcbe70-f8b6-4a57-ac95-296bac414544', 'attached_at': '', 'detached_at': '', 'volume_id': '0d5442fe-5df3-46b0-9419-1403d2ddffe9', 'serial': '0d5442fe-5df3-46b0-9419-1403d2ddffe9'}, 'volume_type': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:22:31 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:22:31 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:22:31 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vAMENZSR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:22:31 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:22:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:22:31 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:22:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:22:31 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 23:22:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3f144e-7054-44a9-81c5-cc384721bc6f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 23:22:31 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4538187-76fc-4601-87bc-1229e7e78403]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9] added
Aug 14 23:22:31 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[020a20ec-4676-41b2-978b-3a124f7e036d]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e66518e-1fc6-4987-ad39-81ed3750d712]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vAMENZSR {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vAMENZSR" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efb9f5e-d5d2-40d8-8a23-f013a5a1522e]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vAMENZSR'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[f694168e-c355-4891-9c5b-6fb034844807]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cade941-cfa2-4f6d-b337-57199884240a]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f (non-flash)
Aug 14 23:22:31 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f (non-flash)
Aug 14 23:22:31 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ca1606-4020-4096-9d4f-00a2c595cd91]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9, portal: 172.16.0.220,3260]
Aug 14 23:22:31 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9, portal: 172.16.0.220,3260] successful.
Aug 14 23:22:31 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dfa33a6-722e-45d3-8dc8-2b4685c68e11]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a928683b-c58e-4de0-9a77-07038015d12f]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f (non-flash)
Aug 14 23:22:31 user nova-compute[72766]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 (non-flash)
Aug 14 23:22:31 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f (non-flash)
Aug 14 23:22:31 user nova-compute[72766]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 (non-flash)
Aug 14 23:22:31 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[53535136-302b-4abe-a0db-0047d8da8700]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:22:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vAMENZSR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b85353d3-ac98-479d-bdf9-9510e242f65b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "f658f249-cb92-4fc1-b1fb-cb6925cf7e1c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b85353d3-ac98-479d-bdf9-9510e242f65b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "f658f249-cb92-4fc1-b1fb-cb6925cf7e1c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:22:32 user nova-compute[72766]: INFO nova.compute.manager [None req-b85353d3-ac98-479d-bdf9-9510e242f65b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Detaching volume 31a29ca5-1ceb-49c0-a18b-535a0686c81f
Aug 14 23:22:32 user nova-compute[72766]: INFO nova.virt.block_device [None req-b85353d3-ac98-479d-bdf9-9510e242f65b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Attempting to driver detach volume 31a29ca5-1ceb-49c0-a18b-535a0686c81f from mountpoint /dev/vdb
Aug 14 23:22:32 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-b85353d3-ac98-479d-bdf9-9510e242f65b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Attempting to detach device vdb from instance f658f249-cb92-4fc1-b1fb-cb6925cf7e1c from the persistent domain config. {{(pid=72766) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-b85353d3-ac98-479d-bdf9-9510e242f65b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 23:22:32 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:22:32 user nova-compute[72766]:   <source dev="/dev/sdc"/>
Aug 14 23:22:32 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:22:32 user nova-compute[72766]:   <serial>31a29ca5-1ceb-49c0-a18b-535a0686c81f</serial>
Aug 14 23:22:32 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 23:22:32 user nova-compute[72766]: </disk>
Aug 14 23:22:32 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 23:22:32 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-b85353d3-ac98-479d-bdf9-9510e242f65b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Successfully detached device vdb from instance f658f249-cb92-4fc1-b1fb-cb6925cf7e1c from the persistent domain config.
Aug 14 23:22:32 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-b85353d3-ac98-479d-bdf9-9510e242f65b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f658f249-cb92-4fc1-b1fb-cb6925cf7e1c from the live domain config. {{(pid=72766) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-b85353d3-ac98-479d-bdf9-9510e242f65b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 23:22:32 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:22:32 user nova-compute[72766]:   <source dev="/dev/sdc"/>
Aug 14 23:22:32 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:22:32 user nova-compute[72766]:   <serial>31a29ca5-1ceb-49c0-a18b-535a0686c81f</serial>
Aug 14 23:22:32 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 23:22:32 user nova-compute[72766]: </disk>
Aug 14 23:22:32 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '26663306137326333', 'path': '/dev/sdb'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663306137326333', 'path': '/dev/sdb'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1099009683',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1099009683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1099009683',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPye+2Lkj7XI2Sw5lb8HB2S2ms8nUjn12L0XLLa6cQPHM5Xy1PdUZAf/NOq0XGO/67dPSmAfJNYFAyPRBYWICQxy9theS1S/+A6k5WEL9ray+YmGK23j/6koQDPdB87Xw==',key_name='tempest-keypair-1244970270',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3c9f53727cc497c94516ff7fa1bbf4f',ramdisk_id='',reservation_id='r-0mzzblil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-213280496',owner_user_name='tempest-TestVolumeBootPattern-213280496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:22:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='999390ac8e6240199c9a7484e234f3a7',uuid=22fcbe70-f8b6-4a57-ac95-296bac414544,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6796bc3-3d20-4f6b-83ef-0d97754ecf19", "address": "fa:16:3e:df:bc:df", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6796bc3-3d", "ovs_interfaceid": "f6796bc3-3d20-4f6b-83ef-0d97754ecf19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Converting VIF {"id": "f6796bc3-3d20-4f6b-83ef-0d97754ecf19", "address": "fa:16:3e:df:bc:df", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6796bc3-3d", "ovs_interfaceid": "f6796bc3-3d20-4f6b-83ef-0d97754ecf19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:bc:df,bridge_name='br-int',has_traffic_filtering=True,id=f6796bc3-3d20-4f6b-83ef-0d97754ecf19,network=Network(f418a384-bbac-4892-8e0f-c7af2e9464ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6796bc3-3d') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG nova.objects.instance [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lazy-loading 'pci_devices' on Instance uuid 22fcbe70-f8b6-4a57-ac95-296bac414544 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:22:32 user nova-compute[72766]:   <uuid>22fcbe70-f8b6-4a57-ac95-296bac414544</uuid>
Aug 14 23:22:32 user nova-compute[72766]:   <name>instance-00000025</name>
Aug 14 23:22:32 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:22:32 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:22:32 user nova-compute[72766]:   <metadata>
Aug 14 23:22:32 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:22:32 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:22:32 user nova-compute[72766]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1099009683</nova:name>
Aug 14 23:22:32 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:22:31</nova:creationTime>
Aug 14 23:22:32 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:22:32 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:22:32 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:22:32 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:22:32 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:22:32 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:22:32 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:22:32 user nova-compute[72766]:       <nova:owner>
Aug 14 23:22:32 user nova-compute[72766]:         <nova:user uuid="999390ac8e6240199c9a7484e234f3a7">tempest-TestVolumeBootPattern-213280496-project-member</nova:user>
Aug 14 23:22:32 user nova-compute[72766]:         <nova:project uuid="a3c9f53727cc497c94516ff7fa1bbf4f">tempest-TestVolumeBootPattern-213280496</nova:project>
Aug 14 23:22:32 user nova-compute[72766]:       </nova:owner>
Aug 14 23:22:32 user nova-compute[72766]:       <nova:ports>
Aug 14 23:22:32 user nova-compute[72766]:         <nova:port uuid="f6796bc3-3d20-4f6b-83ef-0d97754ecf19">
Aug 14 23:22:32 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 23:22:32 user nova-compute[72766]:         </nova:port>
Aug 14 23:22:32 user nova-compute[72766]:       </nova:ports>
Aug 14 23:22:32 user nova-compute[72766]:     </nova:instance>
Aug 14 23:22:32 user nova-compute[72766]:   </metadata>
Aug 14 23:22:32 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:22:32 user nova-compute[72766]:     <system>
Aug 14 23:22:32 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:22:32 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:22:32 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:22:32 user nova-compute[72766]:       <entry name="serial">22fcbe70-f8b6-4a57-ac95-296bac414544</entry>
Aug 14 23:22:32 user nova-compute[72766]:       <entry name="uuid">22fcbe70-f8b6-4a57-ac95-296bac414544</entry>
Aug 14 23:22:32 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:22:32 user nova-compute[72766]:     </system>
Aug 14 23:22:32 user nova-compute[72766]:   </sysinfo>
Aug 14 23:22:32 user nova-compute[72766]:   <os>
Aug 14 23:22:32 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:22:32 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:22:32 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:22:32 user nova-compute[72766]:   </os>
Aug 14 23:22:32 user nova-compute[72766]:   <features>
Aug 14 23:22:32 user nova-compute[72766]:     <acpi/>
Aug 14 23:22:32 user nova-compute[72766]:     <apic/>
Aug 14 23:22:32 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:22:32 user nova-compute[72766]:   </features>
Aug 14 23:22:32 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:22:32 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:22:32 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:22:32 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:22:32 user nova-compute[72766]:   </clock>
Aug 14 23:22:32 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:22:32 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:22:32 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:22:32 user nova-compute[72766]:   </cpu>
Aug 14 23:22:32 user nova-compute[72766]:   <devices>
Aug 14 23:22:32 user nova-compute[72766]:     <disk type="block" device="disk">
Aug 14 23:22:32 user nova-compute[72766]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:22:32 user nova-compute[72766]:       <source dev="/dev/sdb"/>
Aug 14 23:22:32 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:22:32 user nova-compute[72766]:       <serial>0d5442fe-5df3-46b0-9419-1403d2ddffe9</serial>
Aug 14 23:22:32 user nova-compute[72766]:     </disk>
Aug 14 23:22:32 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:22:32 user nova-compute[72766]:       <mac address="fa:16:3e:df:bc:df"/>
Aug 14 23:22:32 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:22:32 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:22:32 user nova-compute[72766]:       <target dev="tapf6796bc3-3d"/>
Aug 14 23:22:32 user nova-compute[72766]:     </interface>
Aug 14 23:22:32 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:22:32 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/22fcbe70-f8b6-4a57-ac95-296bac414544/console.log" append="off"/>
Aug 14 23:22:32 user nova-compute[72766]:     </serial>
Aug 14 23:22:32 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:22:32 user nova-compute[72766]:     <video>
Aug 14 23:22:32 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:22:32 user nova-compute[72766]:     </video>
Aug 14 23:22:32 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:22:32 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:22:32 user nova-compute[72766]:     </rng>
Aug 14 23:22:32 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:22:32 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:22:32 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:22:32 user nova-compute[72766]:     </memballoon>
Aug 14 23:22:32 user nova-compute[72766]:   </devices>
Aug 14 23:22:32 user nova-compute[72766]: </domain>
Aug 14 23:22:32 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1099009683',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1099009683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1099009683',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPye+2Lkj7XI2Sw5lb8HB2S2ms8nUjn12L0XLLa6cQPHM5Xy1PdUZAf/NOq0XGO/67dPSmAfJNYFAyPRBYWICQxy9theS1S/+A6k5WEL9ray+YmGK23j/6koQDPdB87Xw==',key_name='tempest-keypair-1244970270',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3c9f53727cc497c94516ff7fa1bbf4f',ramdisk_id='',reservation_id='r-0mzzblil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-213280496',owner_user_name='tempest-TestVolumeBootPattern-213280496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:22:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='999390ac8e6240199c9a7484e234f3a7',uuid=22fcbe70-f8b6-4a57-ac95-296bac414544,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6796bc3-3d20-4f6b-83ef-0d97754ecf19", "address": "fa:16:3e:df:bc:df", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6796bc3-3d", "ovs_interfaceid": "f6796bc3-3d20-4f6b-83ef-0d97754ecf19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Converting VIF {"id": "f6796bc3-3d20-4f6b-83ef-0d97754ecf19", "address": "fa:16:3e:df:bc:df", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6796bc3-3d", "ovs_interfaceid": "f6796bc3-3d20-4f6b-83ef-0d97754ecf19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:bc:df,bridge_name='br-int',has_traffic_filtering=True,id=f6796bc3-3d20-4f6b-83ef-0d97754ecf19,network=Network(f418a384-bbac-4892-8e0f-c7af2e9464ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6796bc3-3d') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG os_vif [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:bc:df,bridge_name='br-int',has_traffic_filtering=True,id=f6796bc3-3d20-4f6b-83ef-0d97754ecf19,network=Network(f418a384-bbac-4892-8e0f-c7af2e9464ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6796bc3-3d') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf6796bc3-3d, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf6796bc3-3d, col_values=(('external_ids', {'iface-id': 'f6796bc3-3d20-4f6b-83ef-0d97754ecf19', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:bc:df', 'vm-uuid': '22fcbe70-f8b6-4a57-ac95-296bac414544'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:22:32 user nova-compute[72766]: INFO os_vif [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:bc:df,bridge_name='br-int',has_traffic_filtering=True,id=f6796bc3-3d20-4f6b-83ef-0d97754ecf19,network=Network(f418a384-bbac-4892-8e0f-c7af2e9464ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6796bc3-3d')
Aug 14 23:22:32 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Received event <DeviceRemovedEvent: 1692055352.879468, f658f249-cb92-4fc1-b1fb-cb6925cf7e1c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72766) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] No VIF found with MAC fa:16:3e:df:bc:df, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-b85353d3-ac98-479d-bdf9-9510e242f65b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f658f249-cb92-4fc1-b1fb-cb6925cf7e1c {{(pid=72766) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 23:22:32 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-b85353d3-ac98-479d-bdf9-9510e242f65b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Successfully detached device vdb from instance f658f249-cb92-4fc1-b1fb-cb6925cf7e1c from the live domain config.
Aug 14 23:22:32 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b85353d3-ac98-479d-bdf9-9510e242f65b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85353d3-ac98-479d-bdf9-9510e242f65b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XqoPIKAs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:22:32 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-b85353d3-ac98-479d-bdf9-9510e242f65b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:22:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-b85353d3-ac98-479d-bdf9-9510e242f65b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-b85353d3-ac98-479d-bdf9-9510e242f65b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85353d3-ac98-479d-bdf9-9510e242f65b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0581b7-92c3-471d-996c-83a7106a5abf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7ba534-1a27-4e14-90fc-9f1619881806]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85353d3-ac98-479d-bdf9-9510e242f65b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f (non-flash)
Aug 14 23:22:32 user nova-compute[72766]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 (non-flash)
Aug 14 23:22:32 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85353d3-ac98-479d-bdf9-9510e242f65b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f (non-flash)
Aug 14 23:22:32 user nova-compute[72766]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 (non-flash)
Aug 14 23:22:32 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85353d3-ac98-479d-bdf9-9510e242f65b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff17402cc10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f'): ({'sdc'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b85353d3-ac98-479d-bdf9-9510e242f65b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Removing single pathed devices sdc {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd016b5-8ef6-4287-87a1-102978692b68]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01fe111-46ef-4aee-8a47-0f102c4e3662]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b85353d3-ac98-479d-bdf9-9510e242f65b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Flushing IO for device /dev/sdc {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:22:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:22:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:22:33 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39bcbc6-c3c6-4759-a81e-b54668095241]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:22:33 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b85353d3-ac98-479d-bdf9-9510e242f65b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:22:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:22:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.059s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:22:33 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdbdfa5-7fb9-433e-aea2-e3d6397a35fa]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:22:33 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b85353d3-ac98-479d-bdf9-9510e242f65b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:22:33 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b85353d3-ac98-479d-bdf9-9510e242f65b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] SCSI volumes sdc have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:22:33 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85353d3-ac98-479d-bdf9-9510e242f65b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:22:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:22:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:22:33 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a53e1a-19fa-4168-aabf-e9a629e872af]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:22:33 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85353d3-ac98-479d-bdf9-9510e242f65b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:22:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:22:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:22:33 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[f103128a-c032-4fae-8cb1-6e72032d58d3]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:22:33 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85353d3-ac98-479d-bdf9-9510e242f65b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f, portal: 172.16.0.220,3260]
Aug 14 23:22:33 user nova-compute[72766]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f, portal: 172.16.0.220,3260] successful.
Aug 14 23:22:33 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:22:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:22:33 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31a29ca5-1ceb-49c0-a18b-535a0686c81f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:22:33 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d65142-872b-4d64-ba45-e223dfb52b6a]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:22:33 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85353d3-ac98-479d-bdf9-9510e242f65b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:22:33 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-b85353d3-ac98-479d-bdf9-9510e242f65b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:22:33 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85353d3-ac98-479d-bdf9-9510e242f65b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] <== disconnect_volume: return (294ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:22:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b85353d3-ac98-479d-bdf9-9510e242f65b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:22:33 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:22:34 user nova-compute[72766]: DEBUG nova.objects.instance [None req-b85353d3-ac98-479d-bdf9-9510e242f65b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lazy-loading 'flavor' on Instance uuid f658f249-cb92-4fc1-b1fb-cb6925cf7e1c {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:22:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b85353d3-ac98-479d-bdf9-9510e242f65b tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "f658f249-cb92-4fc1-b1fb-cb6925cf7e1c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.735s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:22:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:22:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:22:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:22:34 user nova-compute[72766]: DEBUG nova.compute.manager [req-dee852fe-4849-4d77-b2e4-1da978b62dda req-721c7ac5-0ac3-43c2-931f-af7bec36d7e3 service nova] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Received event network-vif-plugged-f6796bc3-3d20-4f6b-83ef-0d97754ecf19 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:22:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-dee852fe-4849-4d77-b2e4-1da978b62dda req-721c7ac5-0ac3-43c2-931f-af7bec36d7e3 service nova] Acquiring lock "22fcbe70-f8b6-4a57-ac95-296bac414544-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:22:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-dee852fe-4849-4d77-b2e4-1da978b62dda req-721c7ac5-0ac3-43c2-931f-af7bec36d7e3 service nova] Lock "22fcbe70-f8b6-4a57-ac95-296bac414544-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:22:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-dee852fe-4849-4d77-b2e4-1da978b62dda req-721c7ac5-0ac3-43c2-931f-af7bec36d7e3 service nova] Lock "22fcbe70-f8b6-4a57-ac95-296bac414544-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:22:34 user nova-compute[72766]: DEBUG nova.compute.manager [req-dee852fe-4849-4d77-b2e4-1da978b62dda req-721c7ac5-0ac3-43c2-931f-af7bec36d7e3 service nova] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] No waiting events found dispatching network-vif-plugged-f6796bc3-3d20-4f6b-83ef-0d97754ecf19 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:22:34 user nova-compute[72766]: WARNING nova.compute.manager [req-dee852fe-4849-4d77-b2e4-1da978b62dda req-721c7ac5-0ac3-43c2-931f-af7bec36d7e3 service nova] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Received unexpected event network-vif-plugged-f6796bc3-3d20-4f6b-83ef-0d97754ecf19 for instance with vm_state building and task_state spawning.
Aug 14 23:22:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:22:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:22:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:22:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:22:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:22:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:22:35 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:22:35 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:22:35 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:22:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-f658f249-cb92-4fc1-b1fb-cb6925cf7e1c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:22:35 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-f658f249-cb92-4fc1-b1fb-cb6925cf7e1c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:22:35 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:22:36 user nova-compute[72766]: DEBUG nova.compute.manager [req-754a5cb5-ca21-491c-8427-7765a308b52a req-040c351d-5b99-440d-981b-41af491b2160 service nova] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Received event network-vif-plugged-f6796bc3-3d20-4f6b-83ef-0d97754ecf19 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:22:36 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-754a5cb5-ca21-491c-8427-7765a308b52a req-040c351d-5b99-440d-981b-41af491b2160 service nova] Acquiring lock "22fcbe70-f8b6-4a57-ac95-296bac414544-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:22:36 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-754a5cb5-ca21-491c-8427-7765a308b52a req-040c351d-5b99-440d-981b-41af491b2160 service nova] Lock "22fcbe70-f8b6-4a57-ac95-296bac414544-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:22:36 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-754a5cb5-ca21-491c-8427-7765a308b52a req-040c351d-5b99-440d-981b-41af491b2160 service nova] Lock "22fcbe70-f8b6-4a57-ac95-296bac414544-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:22:36 user nova-compute[72766]: DEBUG nova.compute.manager [req-754a5cb5-ca21-491c-8427-7765a308b52a req-040c351d-5b99-440d-981b-41af491b2160 service nova] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] No waiting events found dispatching network-vif-plugged-f6796bc3-3d20-4f6b-83ef-0d97754ecf19 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:22:36 user nova-compute[72766]: WARNING nova.compute.manager [req-754a5cb5-ca21-491c-8427-7765a308b52a req-040c351d-5b99-440d-981b-41af491b2160 service nova] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Received unexpected event network-vif-plugged-f6796bc3-3d20-4f6b-83ef-0d97754ecf19 for instance with vm_state building and task_state spawning.
Aug 14 23:22:36 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692055356.4483206, 22fcbe70-f8b6-4a57-ac95-296bac414544 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:22:36 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] VM Resumed (Lifecycle Event)
Aug 14 23:22:36 user nova-compute[72766]: DEBUG nova.compute.manager [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:22:36 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 23:22:36 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Instance spawned successfully.
Aug 14 23:22:36 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 23:22:36 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:22:36 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:22:36 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:22:36 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:22:36 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:22:36 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:22:36 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:22:36 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:22:36 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:22:36 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692055356.4484608, 22fcbe70-f8b6-4a57-ac95-296bac414544 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:22:36 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] VM Started (Lifecycle Event)
Aug 14 23:22:36 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:22:36 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:22:36 user nova-compute[72766]: INFO nova.compute.manager [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Took 5.23 seconds to spawn the instance on the hypervisor.
Aug 14 23:22:36 user nova-compute[72766]: DEBUG nova.compute.manager [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:22:36 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:22:36 user nova-compute[72766]: INFO nova.compute.manager [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Took 14.81 seconds to build instance.
Aug 14 23:22:36 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-19db6b7e-1133-48bf-b69b-7f61925852ed tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "22fcbe70-f8b6-4a57-ac95-296bac414544" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.905s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:22:36 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Updating instance_info_cache with network_info: [{"id": "1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80", "address": "fa:16:3e:e6:8a:ae", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd62d5e-81", "ovs_interfaceid": "1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:22:36 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-f658f249-cb92-4fc1-b1fb-cb6925cf7e1c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:22:36 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:22:37 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:22:37 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:22:37 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.005s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:22:37 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:22:37 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:22:37 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:22:37 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:22:37 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f658f249-cb92-4fc1-b1fb-cb6925cf7e1c/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:22:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f658f249-cb92-4fc1-b1fb-cb6925cf7e1c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:22:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f658f249-cb92-4fc1-b1fb-cb6925cf7e1c/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:22:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f658f249-cb92-4fc1-b1fb-cb6925cf7e1c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:22:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:22:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:22:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:22:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:22:38 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:22:39 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:22:39 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:22:39 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=8472MB free_disk=25.384353637695312GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:22:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:22:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:22:39 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance cbcf7851-e6f7-4f46-97cc-d773286ccddf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:22:39 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance f658f249-cb92-4fc1-b1fb-cb6925cf7e1c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:22:39 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 22fcbe70-f8b6-4a57-ac95-296bac414544 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:22:39 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:22:39 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:22:39 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:22:39 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:22:39 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:22:39 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:22:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.296s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:22:41 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:22:41 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:22:41 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:22:42 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:22:42 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:22:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:22:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:22:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:22:44 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:22:45 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:22:45 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:22:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Acquiring lock "fcb57162-d1da-4ea0-aca0-80da305537d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:22:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "fcb57162-d1da-4ea0-aca0-80da305537d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:22:47 user nova-compute[72766]: DEBUG nova.compute.manager [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 23:22:47 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:22:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:22:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:22:47 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 23:22:47 user nova-compute[72766]: INFO nova.compute.claims [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Claim successful on node user
Aug 14 23:22:48 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:22:48 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:22:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.310s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:22:48 user nova-compute[72766]: DEBUG nova.compute.manager [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 23:22:48 user nova-compute[72766]: DEBUG nova.compute.manager [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 23:22:48 user nova-compute[72766]: DEBUG nova.network.neutron [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 23:22:48 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 23:22:48 user nova-compute[72766]: DEBUG nova.compute.manager [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 23:22:48 user nova-compute[72766]: DEBUG nova.policy [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a2b1f48b1a594010befb4da227f8b473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd47fb3d5eb408aa751d1d49f198906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 23:22:48 user nova-compute[72766]: DEBUG nova.compute.manager [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 23:22:48 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 23:22:48 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Creating image(s)
Aug 14 23:22:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Acquiring lock "/opt/stack/data/nova/instances/fcb57162-d1da-4ea0-aca0-80da305537d1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:22:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "/opt/stack/data/nova/instances/fcb57162-d1da-4ea0-aca0-80da305537d1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:22:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "/opt/stack/data/nova/instances/fcb57162-d1da-4ea0-aca0-80da305537d1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:22:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Acquiring lock "3e5b3c8e9d2b0fe4ba9930f88be028915bfe298f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:22:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "3e5b3c8e9d2b0fe4ba9930f88be028915bfe298f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:22:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e5b3c8e9d2b0fe4ba9930f88be028915bfe298f.part --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:22:48 user nova-compute[72766]: DEBUG nova.network.neutron [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Successfully created port: 518eb684-a3b3-4886-a828-e818de5be54f {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 23:22:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e5b3c8e9d2b0fe4ba9930f88be028915bfe298f.part --force-share --output=json" returned: 0 in 0.193s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:22:49 user nova-compute[72766]: DEBUG nova.virt.images [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] 6abaf5d8-8c86-42c6-84a9-0a91e4bc711b was qcow2, converting to raw {{(pid=72766) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 23:22:49 user nova-compute[72766]: DEBUG nova.privsep.utils [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72766) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 23:22:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3e5b3c8e9d2b0fe4ba9930f88be028915bfe298f.part /opt/stack/data/nova/instances/_base/3e5b3c8e9d2b0fe4ba9930f88be028915bfe298f.converted {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:22:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:22:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3e5b3c8e9d2b0fe4ba9930f88be028915bfe298f.part /opt/stack/data/nova/instances/_base/3e5b3c8e9d2b0fe4ba9930f88be028915bfe298f.converted" returned: 0 in 0.406s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:22:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e5b3c8e9d2b0fe4ba9930f88be028915bfe298f.converted --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:22:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e5b3c8e9d2b0fe4ba9930f88be028915bfe298f.converted --force-share --output=json" returned: 0 in 0.198s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:22:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "3e5b3c8e9d2b0fe4ba9930f88be028915bfe298f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.306s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:22:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e5b3c8e9d2b0fe4ba9930f88be028915bfe298f --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:22:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e5b3c8e9d2b0fe4ba9930f88be028915bfe298f --force-share --output=json" returned: 0 in 0.179s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:22:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Acquiring lock "3e5b3c8e9d2b0fe4ba9930f88be028915bfe298f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:22:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "3e5b3c8e9d2b0fe4ba9930f88be028915bfe298f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:22:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e5b3c8e9d2b0fe4ba9930f88be028915bfe298f --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e5b3c8e9d2b0fe4ba9930f88be028915bfe298f --force-share --output=json" returned: 0 in 0.184s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e5b3c8e9d2b0fe4ba9930f88be028915bfe298f,backing_fmt=raw /opt/stack/data/nova/instances/fcb57162-d1da-4ea0-aca0-80da305537d1/disk 1073741824 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e5b3c8e9d2b0fe4ba9930f88be028915bfe298f,backing_fmt=raw /opt/stack/data/nova/instances/fcb57162-d1da-4ea0-aca0-80da305537d1/disk 1073741824" returned: 0 in 0.052s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "3e5b3c8e9d2b0fe4ba9930f88be028915bfe298f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e5b3c8e9d2b0fe4ba9930f88be028915bfe298f --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG nova.network.neutron [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Successfully updated port: 518eb684-a3b3-4886-a828-e818de5be54f {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG nova.compute.manager [req-0dacd539-6c24-4ff3-831c-a3f8592feb33 req-d0646287-5e15-4b96-87a8-5ce2ca72af8e service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Received event network-changed-518eb684-a3b3-4886-a828-e818de5be54f {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG nova.compute.manager [req-0dacd539-6c24-4ff3-831c-a3f8592feb33 req-d0646287-5e15-4b96-87a8-5ce2ca72af8e service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Refreshing instance network info cache due to event network-changed-518eb684-a3b3-4886-a828-e818de5be54f. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0dacd539-6c24-4ff3-831c-a3f8592feb33 req-d0646287-5e15-4b96-87a8-5ce2ca72af8e service nova] Acquiring lock "refresh_cache-fcb57162-d1da-4ea0-aca0-80da305537d1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0dacd539-6c24-4ff3-831c-a3f8592feb33 req-d0646287-5e15-4b96-87a8-5ce2ca72af8e service nova] Acquired lock "refresh_cache-fcb57162-d1da-4ea0-aca0-80da305537d1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG nova.network.neutron [req-0dacd539-6c24-4ff3-831c-a3f8592feb33 req-d0646287-5e15-4b96-87a8-5ce2ca72af8e service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Refreshing network info cache for port 518eb684-a3b3-4886-a828-e818de5be54f {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Acquiring lock "refresh_cache-fcb57162-d1da-4ea0-aca0-80da305537d1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG nova.network.neutron [req-0dacd539-6c24-4ff3-831c-a3f8592feb33 req-d0646287-5e15-4b96-87a8-5ce2ca72af8e service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e5b3c8e9d2b0fe4ba9930f88be028915bfe298f --force-share --output=json" returned: 0 in 0.194s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fcb57162-d1da-4ea0-aca0-80da305537d1/disk. size=1073741824 {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb57162-d1da-4ea0-aca0-80da305537d1/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG nova.network.neutron [req-0dacd539-6c24-4ff3-831c-a3f8592feb33 req-d0646287-5e15-4b96-87a8-5ce2ca72af8e service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0dacd539-6c24-4ff3-831c-a3f8592feb33 req-d0646287-5e15-4b96-87a8-5ce2ca72af8e service nova] Releasing lock "refresh_cache-fcb57162-d1da-4ea0-aca0-80da305537d1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Acquired lock "refresh_cache-fcb57162-d1da-4ea0-aca0-80da305537d1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG nova.network.neutron [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb57162-d1da-4ea0-aca0-80da305537d1/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Cannot resize image /opt/stack/data/nova/instances/fcb57162-d1da-4ea0-aca0-80da305537d1/disk to a smaller size. {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG nova.objects.instance [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lazy-loading 'migration_context' on Instance uuid fcb57162-d1da-4ea0-aca0-80da305537d1 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG nova.network.neutron [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Ensure instance console log exists: /opt/stack/data/nova/instances/fcb57162-d1da-4ea0-aca0-80da305537d1/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG nova.network.neutron [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Updating instance_info_cache with network_info: [{"id": "518eb684-a3b3-4886-a828-e818de5be54f", "address": "fa:16:3e:81:95:89", "network": {"id": "c7828c64-4d71-4c57-8df8-bb4524d9b9cb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-160068070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbd47fb3d5eb408aa751d1d49f198906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518eb684-a3", "ovs_interfaceid": "518eb684-a3b3-4886-a828-e818de5be54f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Releasing lock "refresh_cache-fcb57162-d1da-4ea0-aca0-80da305537d1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG nova.compute.manager [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Instance network_info: |[{"id": "518eb684-a3b3-4886-a828-e818de5be54f", "address": "fa:16:3e:81:95:89", "network": {"id": "c7828c64-4d71-4c57-8df8-bb4524d9b9cb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-160068070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbd47fb3d5eb408aa751d1d49f198906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518eb684-a3", "ovs_interfaceid": "518eb684-a3b3-4886-a828-e818de5be54f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Start _get_guest_xml network_info=[{"id": "518eb684-a3b3-4886-a828-e818de5be54f", "address": "fa:16:3e:81:95:89", "network": {"id": "c7828c64-4d71-4c57-8df8-bb4524d9b9cb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-160068070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbd47fb3d5eb408aa751d1d49f198906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518eb684-a3", "ovs_interfaceid": "518eb684-a3b3-4886-a828-e818de5be54f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T23:22:45Z,direct_url=<?>,disk_format='qcow2',id=6abaf5d8-8c86-42c6-84a9-0a91e4bc711b,min_disk=0,min_ram=0,name='tempest-scenario-img--1964317768',owner='cbd47fb3d5eb408aa751d1d49f198906',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T23:22:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '6abaf5d8-8c86-42c6-84a9-0a91e4bc711b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:22:50 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:22:50 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:22:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T23:22:45Z,direct_url=<?>,disk_format='qcow2',id=6abaf5d8-8c86-42c6-84a9-0a91e4bc711b,min_disk=0,min_ram=0,name='tempest-scenario-img--1964317768',owner='cbd47fb3d5eb408aa751d1d49f198906',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T23:22:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:22:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1086401159',display_name='tempest-TestMinimumBasicScenario-server-1086401159',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1086401159',id=38,image_ref='6abaf5d8-8c86-42c6-84a9-0a91e4bc711b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIT4sWowgwzBSgSQSR4/nQGYejOWmEvcMvkPagaWavJ4GtHuJlXtb9tn4Ifw16P3BWGIzuruDEdE7i2Q5+xQOQqPuO67WUM//mFBoSm7QzgYYOgilspdEBNyYzBUZBj/gg==',key_name='tempest-TestMinimumBasicScenario-1137169698',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cbd47fb3d5eb408aa751d1d49f198906',ramdisk_id='',reservation_id='r-6keiuhzz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6abaf5d8-8c86-42c6-84a9-0a91e4bc711b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1491062679',owner_user_name='tempest-TestMinimumBasicScenario-1491062679-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:22:48Z,user_data=None,user_id='a2b1f48b1a594010befb4da227f8b473',uuid=fcb57162-d1da-4ea0-aca0-80da305537d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "518eb684-a3b3-4886-a828-e818de5be54f", "address": "fa:16:3e:81:95:89", "network": {"id": "c7828c64-4d71-4c57-8df8-bb4524d9b9cb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-160068070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbd47fb3d5eb408aa751d1d49f198906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518eb684-a3", "ovs_interfaceid": "518eb684-a3b3-4886-a828-e818de5be54f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Converting VIF {"id": "518eb684-a3b3-4886-a828-e818de5be54f", "address": "fa:16:3e:81:95:89", "network": {"id": "c7828c64-4d71-4c57-8df8-bb4524d9b9cb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-160068070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbd47fb3d5eb408aa751d1d49f198906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518eb684-a3", "ovs_interfaceid": "518eb684-a3b3-4886-a828-e818de5be54f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:95:89,bridge_name='br-int',has_traffic_filtering=True,id=518eb684-a3b3-4886-a828-e818de5be54f,network=Network(c7828c64-4d71-4c57-8df8-bb4524d9b9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap518eb684-a3') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG nova.objects.instance [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lazy-loading 'pci_devices' on Instance uuid fcb57162-d1da-4ea0-aca0-80da305537d1 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:22:50 user nova-compute[72766]:   <uuid>fcb57162-d1da-4ea0-aca0-80da305537d1</uuid>
Aug 14 23:22:50 user nova-compute[72766]:   <name>instance-00000026</name>
Aug 14 23:22:50 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:22:50 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:22:50 user nova-compute[72766]:   <metadata>
Aug 14 23:22:50 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:22:50 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:22:50 user nova-compute[72766]:       <nova:name>tempest-TestMinimumBasicScenario-server-1086401159</nova:name>
Aug 14 23:22:50 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:22:50</nova:creationTime>
Aug 14 23:22:50 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:22:50 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:22:50 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:22:50 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:22:50 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:22:50 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:22:50 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:22:50 user nova-compute[72766]:       <nova:owner>
Aug 14 23:22:50 user nova-compute[72766]:         <nova:user uuid="a2b1f48b1a594010befb4da227f8b473">tempest-TestMinimumBasicScenario-1491062679-project-member</nova:user>
Aug 14 23:22:50 user nova-compute[72766]:         <nova:project uuid="cbd47fb3d5eb408aa751d1d49f198906">tempest-TestMinimumBasicScenario-1491062679</nova:project>
Aug 14 23:22:50 user nova-compute[72766]:       </nova:owner>
Aug 14 23:22:50 user nova-compute[72766]:       <nova:root type="image" uuid="6abaf5d8-8c86-42c6-84a9-0a91e4bc711b"/>
Aug 14 23:22:50 user nova-compute[72766]:       <nova:ports>
Aug 14 23:22:50 user nova-compute[72766]:         <nova:port uuid="518eb684-a3b3-4886-a828-e818de5be54f">
Aug 14 23:22:50 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 14 23:22:50 user nova-compute[72766]:         </nova:port>
Aug 14 23:22:50 user nova-compute[72766]:       </nova:ports>
Aug 14 23:22:50 user nova-compute[72766]:     </nova:instance>
Aug 14 23:22:50 user nova-compute[72766]:   </metadata>
Aug 14 23:22:50 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:22:50 user nova-compute[72766]:     <system>
Aug 14 23:22:50 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:22:50 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:22:50 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:22:50 user nova-compute[72766]:       <entry name="serial">fcb57162-d1da-4ea0-aca0-80da305537d1</entry>
Aug 14 23:22:50 user nova-compute[72766]:       <entry name="uuid">fcb57162-d1da-4ea0-aca0-80da305537d1</entry>
Aug 14 23:22:50 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:22:50 user nova-compute[72766]:     </system>
Aug 14 23:22:50 user nova-compute[72766]:   </sysinfo>
Aug 14 23:22:50 user nova-compute[72766]:   <os>
Aug 14 23:22:50 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:22:50 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:22:50 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:22:50 user nova-compute[72766]:   </os>
Aug 14 23:22:50 user nova-compute[72766]:   <features>
Aug 14 23:22:50 user nova-compute[72766]:     <acpi/>
Aug 14 23:22:50 user nova-compute[72766]:     <apic/>
Aug 14 23:22:50 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:22:50 user nova-compute[72766]:   </features>
Aug 14 23:22:50 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:22:50 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:22:50 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:22:50 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:22:50 user nova-compute[72766]:   </clock>
Aug 14 23:22:50 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:22:50 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:22:50 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:22:50 user nova-compute[72766]:   </cpu>
Aug 14 23:22:50 user nova-compute[72766]:   <devices>
Aug 14 23:22:50 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 23:22:50 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 23:22:50 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/fcb57162-d1da-4ea0-aca0-80da305537d1/disk"/>
Aug 14 23:22:50 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:22:50 user nova-compute[72766]:     </disk>
Aug 14 23:22:50 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:22:50 user nova-compute[72766]:       <mac address="fa:16:3e:81:95:89"/>
Aug 14 23:22:50 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:22:50 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:22:50 user nova-compute[72766]:       <target dev="tap518eb684-a3"/>
Aug 14 23:22:50 user nova-compute[72766]:     </interface>
Aug 14 23:22:50 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:22:50 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/fcb57162-d1da-4ea0-aca0-80da305537d1/console.log" append="off"/>
Aug 14 23:22:50 user nova-compute[72766]:     </serial>
Aug 14 23:22:50 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:22:50 user nova-compute[72766]:     <video>
Aug 14 23:22:50 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:22:50 user nova-compute[72766]:     </video>
Aug 14 23:22:50 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:22:50 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:22:50 user nova-compute[72766]:     </rng>
Aug 14 23:22:50 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:22:50 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:22:50 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:22:50 user nova-compute[72766]:     </memballoon>
Aug 14 23:22:50 user nova-compute[72766]:   </devices>
Aug 14 23:22:50 user nova-compute[72766]: </domain>
Aug 14 23:22:50 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:22:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1086401159',display_name='tempest-TestMinimumBasicScenario-server-1086401159',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1086401159',id=38,image_ref='6abaf5d8-8c86-42c6-84a9-0a91e4bc711b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIT4sWowgwzBSgSQSR4/nQGYejOWmEvcMvkPagaWavJ4GtHuJlXtb9tn4Ifw16P3BWGIzuruDEdE7i2Q5+xQOQqPuO67WUM//mFBoSm7QzgYYOgilspdEBNyYzBUZBj/gg==',key_name='tempest-TestMinimumBasicScenario-1137169698',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cbd47fb3d5eb408aa751d1d49f198906',ramdisk_id='',reservation_id='r-6keiuhzz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6abaf5d8-8c86-42c6-84a9-0a91e4bc711b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1491062679',owner_user_name='tempest-TestMinimumBasicScenario-1491062679-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:22:48Z,user_data=None,user_id='a2b1f48b1a594010befb4da227f8b473',uuid=fcb57162-d1da-4ea0-aca0-80da305537d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "518eb684-a3b3-4886-a828-e818de5be54f", "address": "fa:16:3e:81:95:89", "network": {"id": "c7828c64-4d71-4c57-8df8-bb4524d9b9cb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-160068070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbd47fb3d5eb408aa751d1d49f198906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518eb684-a3", "ovs_interfaceid": "518eb684-a3b3-4886-a828-e818de5be54f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Converting VIF {"id": "518eb684-a3b3-4886-a828-e818de5be54f", "address": "fa:16:3e:81:95:89", "network": {"id": "c7828c64-4d71-4c57-8df8-bb4524d9b9cb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-160068070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbd47fb3d5eb408aa751d1d49f198906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518eb684-a3", "ovs_interfaceid": "518eb684-a3b3-4886-a828-e818de5be54f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:95:89,bridge_name='br-int',has_traffic_filtering=True,id=518eb684-a3b3-4886-a828-e818de5be54f,network=Network(c7828c64-4d71-4c57-8df8-bb4524d9b9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap518eb684-a3') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG os_vif [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:95:89,bridge_name='br-int',has_traffic_filtering=True,id=518eb684-a3b3-4886-a828-e818de5be54f,network=Network(c7828c64-4d71-4c57-8df8-bb4524d9b9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap518eb684-a3') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap518eb684-a3, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap518eb684-a3, col_values=(('external_ids', {'iface-id': '518eb684-a3b3-4886-a828-e818de5be54f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:95:89', 'vm-uuid': 'fcb57162-d1da-4ea0-aca0-80da305537d1'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:22:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:22:50 user nova-compute[72766]: INFO os_vif [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:95:89,bridge_name='br-int',has_traffic_filtering=True,id=518eb684-a3b3-4886-a828-e818de5be54f,network=Network(c7828c64-4d71-4c57-8df8-bb4524d9b9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap518eb684-a3')
Aug 14 23:22:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:22:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] No VIF found with MAC fa:16:3e:81:95:89, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:22:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:22:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:22:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:22:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:22:52 user nova-compute[72766]: DEBUG nova.compute.manager [req-3a474c7f-f749-4bda-84c3-dc3b5d47c8f9 req-2c77dc65-9973-4cbc-acde-597707be2501 service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Received event network-vif-plugged-518eb684-a3b3-4886-a828-e818de5be54f {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:22:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-3a474c7f-f749-4bda-84c3-dc3b5d47c8f9 req-2c77dc65-9973-4cbc-acde-597707be2501 service nova] Acquiring lock "fcb57162-d1da-4ea0-aca0-80da305537d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:22:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-3a474c7f-f749-4bda-84c3-dc3b5d47c8f9 req-2c77dc65-9973-4cbc-acde-597707be2501 service nova] Lock "fcb57162-d1da-4ea0-aca0-80da305537d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:22:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-3a474c7f-f749-4bda-84c3-dc3b5d47c8f9 req-2c77dc65-9973-4cbc-acde-597707be2501 service nova] Lock "fcb57162-d1da-4ea0-aca0-80da305537d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:22:52 user nova-compute[72766]: DEBUG nova.compute.manager [req-3a474c7f-f749-4bda-84c3-dc3b5d47c8f9 req-2c77dc65-9973-4cbc-acde-597707be2501 service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] No waiting events found dispatching network-vif-plugged-518eb684-a3b3-4886-a828-e818de5be54f {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:22:52 user nova-compute[72766]: WARNING nova.compute.manager [req-3a474c7f-f749-4bda-84c3-dc3b5d47c8f9 req-2c77dc65-9973-4cbc-acde-597707be2501 service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Received unexpected event network-vif-plugged-518eb684-a3b3-4886-a828-e818de5be54f for instance with vm_state building and task_state spawning.
Aug 14 23:22:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:22:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:22:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:22:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:22:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:22:54 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692055374.5219133, fcb57162-d1da-4ea0-aca0-80da305537d1 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:22:54 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] VM Resumed (Lifecycle Event)
Aug 14 23:22:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:22:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 23:22:54 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Instance spawned successfully.
Aug 14 23:22:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 23:22:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:22:54 user nova-compute[72766]: DEBUG nova.compute.manager [req-c2d2aa89-9c5d-4eb1-afc5-de7764f1f417 req-25c341d2-faea-4369-969f-498cf4411b66 service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Received event network-vif-plugged-518eb684-a3b3-4886-a828-e818de5be54f {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:22:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-c2d2aa89-9c5d-4eb1-afc5-de7764f1f417 req-25c341d2-faea-4369-969f-498cf4411b66 service nova] Acquiring lock "fcb57162-d1da-4ea0-aca0-80da305537d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:22:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-c2d2aa89-9c5d-4eb1-afc5-de7764f1f417 req-25c341d2-faea-4369-969f-498cf4411b66 service nova] Lock "fcb57162-d1da-4ea0-aca0-80da305537d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:22:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-c2d2aa89-9c5d-4eb1-afc5-de7764f1f417 req-25c341d2-faea-4369-969f-498cf4411b66 service nova] Lock "fcb57162-d1da-4ea0-aca0-80da305537d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:22:54 user nova-compute[72766]: DEBUG nova.compute.manager [req-c2d2aa89-9c5d-4eb1-afc5-de7764f1f417 req-25c341d2-faea-4369-969f-498cf4411b66 service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] No waiting events found dispatching network-vif-plugged-518eb684-a3b3-4886-a828-e818de5be54f {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:22:54 user nova-compute[72766]: WARNING nova.compute.manager [req-c2d2aa89-9c5d-4eb1-afc5-de7764f1f417 req-25c341d2-faea-4369-969f-498cf4411b66 service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Received unexpected event network-vif-plugged-518eb684-a3b3-4886-a828-e818de5be54f for instance with vm_state building and task_state spawning.
Aug 14 23:22:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:22:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:22:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:22:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:22:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:22:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:22:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:22:54 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:22:54 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692055374.5235896, fcb57162-d1da-4ea0-aca0-80da305537d1 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:22:54 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] VM Started (Lifecycle Event)
Aug 14 23:22:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:22:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:22:54 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:22:54 user nova-compute[72766]: INFO nova.compute.manager [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Took 6.27 seconds to spawn the instance on the hypervisor.
Aug 14 23:22:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:22:54 user nova-compute[72766]: INFO nova.compute.manager [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Took 6.95 seconds to build instance.
Aug 14 23:22:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-125475e0-4065-47f5-9207-0f95f3287866 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "fcb57162-d1da-4ea0-aca0-80da305537d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.068s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:22:55 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:22:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:23:00 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:23:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:23:05 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:23:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:23:10 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:23:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:23:15 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:23:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:23:20 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:23:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-08c72f87-dc33-453d-9c55-dd2813014da4 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "f658f249-cb92-4fc1-b1fb-cb6925cf7e1c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:23:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-08c72f87-dc33-453d-9c55-dd2813014da4 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "f658f249-cb92-4fc1-b1fb-cb6925cf7e1c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:23:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-08c72f87-dc33-453d-9c55-dd2813014da4 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "f658f249-cb92-4fc1-b1fb-cb6925cf7e1c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:23:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-08c72f87-dc33-453d-9c55-dd2813014da4 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "f658f249-cb92-4fc1-b1fb-cb6925cf7e1c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:23:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-08c72f87-dc33-453d-9c55-dd2813014da4 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "f658f249-cb92-4fc1-b1fb-cb6925cf7e1c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:23:22 user nova-compute[72766]: INFO nova.compute.manager [None req-08c72f87-dc33-453d-9c55-dd2813014da4 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Terminating instance
Aug 14 23:23:22 user nova-compute[72766]: DEBUG nova.compute.manager [None req-08c72f87-dc33-453d-9c55-dd2813014da4 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:23:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:23:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:23:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:23:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:23:22 user nova-compute[72766]: DEBUG nova.compute.manager [req-ffdc2e50-ca75-426e-a7ea-6f41f820a0da req-21dab96c-fd40-4fbf-b83f-a8eff3d72770 service nova] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Received event network-vif-unplugged-1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:23:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ffdc2e50-ca75-426e-a7ea-6f41f820a0da req-21dab96c-fd40-4fbf-b83f-a8eff3d72770 service nova] Acquiring lock "f658f249-cb92-4fc1-b1fb-cb6925cf7e1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:23:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ffdc2e50-ca75-426e-a7ea-6f41f820a0da req-21dab96c-fd40-4fbf-b83f-a8eff3d72770 service nova] Lock "f658f249-cb92-4fc1-b1fb-cb6925cf7e1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:23:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ffdc2e50-ca75-426e-a7ea-6f41f820a0da req-21dab96c-fd40-4fbf-b83f-a8eff3d72770 service nova] Lock "f658f249-cb92-4fc1-b1fb-cb6925cf7e1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:23:22 user nova-compute[72766]: DEBUG nova.compute.manager [req-ffdc2e50-ca75-426e-a7ea-6f41f820a0da req-21dab96c-fd40-4fbf-b83f-a8eff3d72770 service nova] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] No waiting events found dispatching network-vif-unplugged-1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:23:22 user nova-compute[72766]: DEBUG nova.compute.manager [req-ffdc2e50-ca75-426e-a7ea-6f41f820a0da req-21dab96c-fd40-4fbf-b83f-a8eff3d72770 service nova] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Received event network-vif-unplugged-1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80 for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:23:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:23:23 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Instance destroyed successfully.
Aug 14 23:23:23 user nova-compute[72766]: DEBUG nova.objects.instance [None req-08c72f87-dc33-453d-9c55-dd2813014da4 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lazy-loading 'resources' on Instance uuid f658f249-cb92-4fc1-b1fb-cb6925cf7e1c {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:23:23 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-08c72f87-dc33-453d-9c55-dd2813014da4 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:17:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-124714953',display_name='tempest-AttachVolumeNegativeTest-server-124714953',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-124714953',id=34,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrRn6VM/NodMaXXlsqEjdmlXYxNoRhk02FHcFcLdqKqnHp5m2XSVm+/WhEBmEJ+jICRGE+e9+W/QBsRf/wWdpOkZe0RE6NOHzo9Sw5AvU5eZzq13+Tgc1PhqhXXmEDrVQ==',key_name='tempest-keypair-170593372',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:17:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3785d8cff6cd41a4aff8becf528e3a4c',ramdisk_id='',reservation_id='r-wkfmniy8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1623363641',owner_user_name='tempest-AttachVolumeNegativeTest-1623363641-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:17:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90e68d4dfd6048d99037fce632788b57',uuid=f658f249-cb92-4fc1-b1fb-cb6925cf7e1c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80", "address": "fa:16:3e:e6:8a:ae", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd62d5e-81", "ovs_interfaceid": "1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:23:23 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-08c72f87-dc33-453d-9c55-dd2813014da4 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Converting VIF {"id": "1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80", "address": "fa:16:3e:e6:8a:ae", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd62d5e-81", "ovs_interfaceid": "1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:23:23 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-08c72f87-dc33-453d-9c55-dd2813014da4 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:8a:ae,bridge_name='br-int',has_traffic_filtering=True,id=1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80,network=Network(9491b8be-e6b2-4770-a591-370db9a96785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fd62d5e-81') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:23:23 user nova-compute[72766]: DEBUG os_vif [None req-08c72f87-dc33-453d-9c55-dd2813014da4 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:8a:ae,bridge_name='br-int',has_traffic_filtering=True,id=1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80,network=Network(9491b8be-e6b2-4770-a591-370db9a96785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fd62d5e-81') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:23:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:23:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1fd62d5e-81, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:23:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:23:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:23:23 user nova-compute[72766]: INFO os_vif [None req-08c72f87-dc33-453d-9c55-dd2813014da4 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:8a:ae,bridge_name='br-int',has_traffic_filtering=True,id=1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80,network=Network(9491b8be-e6b2-4770-a591-370db9a96785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fd62d5e-81')
Aug 14 23:23:23 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-08c72f87-dc33-453d-9c55-dd2813014da4 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Deleting instance files /opt/stack/data/nova/instances/f658f249-cb92-4fc1-b1fb-cb6925cf7e1c_del
Aug 14 23:23:23 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-08c72f87-dc33-453d-9c55-dd2813014da4 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Deletion of /opt/stack/data/nova/instances/f658f249-cb92-4fc1-b1fb-cb6925cf7e1c_del complete
Aug 14 23:23:23 user nova-compute[72766]: INFO nova.compute.manager [None req-08c72f87-dc33-453d-9c55-dd2813014da4 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 14 23:23:23 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-08c72f87-dc33-453d-9c55-dd2813014da4 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:23:23 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:23:23 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:23:24 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:23:24 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Took 0.70 seconds to deallocate network for instance.
Aug 14 23:23:24 user nova-compute[72766]: DEBUG nova.compute.manager [req-f31e651d-00fb-46ec-a1c8-73bc0a44eb33 req-a95fd736-b302-4d24-9632-30afa6b040b7 service nova] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Received event network-vif-deleted-1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:23:24 user nova-compute[72766]: INFO nova.compute.manager [req-f31e651d-00fb-46ec-a1c8-73bc0a44eb33 req-a95fd736-b302-4d24-9632-30afa6b040b7 service nova] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Neutron deleted interface 1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80; detaching it from the instance and deleting it from the info cache
Aug 14 23:23:24 user nova-compute[72766]: DEBUG nova.network.neutron [req-f31e651d-00fb-46ec-a1c8-73bc0a44eb33 req-a95fd736-b302-4d24-9632-30afa6b040b7 service nova] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:23:24 user nova-compute[72766]: DEBUG nova.compute.manager [req-f31e651d-00fb-46ec-a1c8-73bc0a44eb33 req-a95fd736-b302-4d24-9632-30afa6b040b7 service nova] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Detach interface failed, port_id=1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80, reason: Instance f658f249-cb92-4fc1-b1fb-cb6925cf7e1c could not be found. {{(pid=72766) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 23:23:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-08c72f87-dc33-453d-9c55-dd2813014da4 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:23:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-08c72f87-dc33-453d-9c55-dd2813014da4 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:23:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:23:24 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-08c72f87-dc33-453d-9c55-dd2813014da4 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:23:24 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-08c72f87-dc33-453d-9c55-dd2813014da4 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:23:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-08c72f87-dc33-453d-9c55-dd2813014da4 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.182s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:23:24 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-08c72f87-dc33-453d-9c55-dd2813014da4 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Deleted allocations for instance f658f249-cb92-4fc1-b1fb-cb6925cf7e1c
Aug 14 23:23:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-08c72f87-dc33-453d-9c55-dd2813014da4 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "f658f249-cb92-4fc1-b1fb-cb6925cf7e1c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.955s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:23:25 user nova-compute[72766]: DEBUG nova.compute.manager [req-ec4e1392-3a95-49a9-8d9e-7fc12e2dd140 req-07ebba2a-7f39-4e3e-bac9-9fda478cd01d service nova] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Received event network-vif-plugged-1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:23:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ec4e1392-3a95-49a9-8d9e-7fc12e2dd140 req-07ebba2a-7f39-4e3e-bac9-9fda478cd01d service nova] Acquiring lock "f658f249-cb92-4fc1-b1fb-cb6925cf7e1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:23:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ec4e1392-3a95-49a9-8d9e-7fc12e2dd140 req-07ebba2a-7f39-4e3e-bac9-9fda478cd01d service nova] Lock "f658f249-cb92-4fc1-b1fb-cb6925cf7e1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:23:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ec4e1392-3a95-49a9-8d9e-7fc12e2dd140 req-07ebba2a-7f39-4e3e-bac9-9fda478cd01d service nova] Lock "f658f249-cb92-4fc1-b1fb-cb6925cf7e1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:23:25 user nova-compute[72766]: DEBUG nova.compute.manager [req-ec4e1392-3a95-49a9-8d9e-7fc12e2dd140 req-07ebba2a-7f39-4e3e-bac9-9fda478cd01d service nova] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] No waiting events found dispatching network-vif-plugged-1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:23:25 user nova-compute[72766]: WARNING nova.compute.manager [req-ec4e1392-3a95-49a9-8d9e-7fc12e2dd140 req-07ebba2a-7f39-4e3e-bac9-9fda478cd01d service nova] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Received unexpected event network-vif-plugged-1fd62d5e-81a2-4aba-b4be-6d2e77ed7a80 for instance with vm_state deleted and task_state None.
Aug 14 23:23:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:23:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:23:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:23:34 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:23:36 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:23:36 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:23:36 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:23:36 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Rebuilding the list of instances to heal {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 23:23:36 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-cbcf7851-e6f7-4f46-97cc-d773286ccddf" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:23:36 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-cbcf7851-e6f7-4f46-97cc-d773286ccddf" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:23:36 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:23:36 user nova-compute[72766]: DEBUG nova.objects.instance [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lazy-loading 'info_cache' on Instance uuid cbcf7851-e6f7-4f46-97cc-d773286ccddf {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:23:37 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Updating instance_info_cache with network_info: [{"id": "8f65f8f0-60fe-4fdb-af66-424a85b12caf", "address": "fa:16:3e:70:30:66", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f65f8f0-60", "ovs_interfaceid": "8f65f8f0-60fe-4fdb-af66-424a85b12caf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:23:37 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-cbcf7851-e6f7-4f46-97cc-d773286ccddf" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:23:37 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:23:38 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692055403.478889, f658f249-cb92-4fc1-b1fb-cb6925cf7e1c => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:23:38 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] VM Stopped (Lifecycle Event)
Aug 14 23:23:38 user nova-compute[72766]: DEBUG nova.compute.manager [None req-3c770775-737d-49af-ae3f-807b80640bec None None] [instance: f658f249-cb92-4fc1-b1fb-cb6925cf7e1c] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:23:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:23:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:23:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:23:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:23:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:23:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:23:38 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:23:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:23:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:23:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:23:38 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:23:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb57162-d1da-4ea0-aca0-80da305537d1/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:23:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb57162-d1da-4ea0-aca0-80da305537d1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:23:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb57162-d1da-4ea0-aca0-80da305537d1/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:23:39 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb57162-d1da-4ea0-aca0-80da305537d1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:23:39 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:23:39 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:23:39 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:23:39 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:23:39 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:23:39 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:23:39 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:23:39 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=8421MB free_disk=25.32132339477539GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:23:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:23:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:23:40 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance cbcf7851-e6f7-4f46-97cc-d773286ccddf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:23:40 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 22fcbe70-f8b6-4a57-ac95-296bac414544 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:23:40 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance fcb57162-d1da-4ea0-aca0-80da305537d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:23:40 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:23:40 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:23:40 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:23:40 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:23:40 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:23:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.242s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:23:42 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:23:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:23:43 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:23:43 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:23:44 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:23:46 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:23:47 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:23:47 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:23:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:23:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:23:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:24:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:24:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:24:12 user nova-compute[72766]: DEBUG nova.compute.manager [req-70e82a95-4798-463c-97f6-a4503dbf1d25 req-11be4ce9-2de9-4ff1-a5fe-5d2274ed64fb service nova] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Received event network-changed-f6796bc3-3d20-4f6b-83ef-0d97754ecf19 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:24:12 user nova-compute[72766]: DEBUG nova.compute.manager [req-70e82a95-4798-463c-97f6-a4503dbf1d25 req-11be4ce9-2de9-4ff1-a5fe-5d2274ed64fb service nova] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Refreshing instance network info cache due to event network-changed-f6796bc3-3d20-4f6b-83ef-0d97754ecf19. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:24:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-70e82a95-4798-463c-97f6-a4503dbf1d25 req-11be4ce9-2de9-4ff1-a5fe-5d2274ed64fb service nova] Acquiring lock "refresh_cache-22fcbe70-f8b6-4a57-ac95-296bac414544" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:24:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-70e82a95-4798-463c-97f6-a4503dbf1d25 req-11be4ce9-2de9-4ff1-a5fe-5d2274ed64fb service nova] Acquired lock "refresh_cache-22fcbe70-f8b6-4a57-ac95-296bac414544" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:24:12 user nova-compute[72766]: DEBUG nova.network.neutron [req-70e82a95-4798-463c-97f6-a4503dbf1d25 req-11be4ce9-2de9-4ff1-a5fe-5d2274ed64fb service nova] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Refreshing network info cache for port f6796bc3-3d20-4f6b-83ef-0d97754ecf19 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:24:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:24:13 user nova-compute[72766]: DEBUG nova.network.neutron [req-70e82a95-4798-463c-97f6-a4503dbf1d25 req-11be4ce9-2de9-4ff1-a5fe-5d2274ed64fb service nova] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Updated VIF entry in instance network info cache for port f6796bc3-3d20-4f6b-83ef-0d97754ecf19. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:24:13 user nova-compute[72766]: DEBUG nova.network.neutron [req-70e82a95-4798-463c-97f6-a4503dbf1d25 req-11be4ce9-2de9-4ff1-a5fe-5d2274ed64fb service nova] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Updating instance_info_cache with network_info: [{"id": "f6796bc3-3d20-4f6b-83ef-0d97754ecf19", "address": "fa:16:3e:df:bc:df", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6796bc3-3d", "ovs_interfaceid": "f6796bc3-3d20-4f6b-83ef-0d97754ecf19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:24:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-70e82a95-4798-463c-97f6-a4503dbf1d25 req-11be4ce9-2de9-4ff1-a5fe-5d2274ed64fb service nova] Releasing lock "refresh_cache-22fcbe70-f8b6-4a57-ac95-296bac414544" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:24:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:24:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:24:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:24:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:24:16 user nova-compute[72766]: DEBUG nova.compute.manager [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 23:24:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:24:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:24:16 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 23:24:16 user nova-compute[72766]: INFO nova.compute.claims [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Claim successful on node user
Aug 14 23:24:16 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:24:16 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:24:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.273s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:24:16 user nova-compute[72766]: DEBUG nova.compute.manager [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 23:24:16 user nova-compute[72766]: DEBUG nova.compute.manager [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 23:24:16 user nova-compute[72766]: DEBUG nova.network.neutron [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 23:24:17 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 23:24:17 user nova-compute[72766]: DEBUG nova.compute.manager [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 23:24:17 user nova-compute[72766]: DEBUG nova.policy [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '90e68d4dfd6048d99037fce632788b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785d8cff6cd41a4aff8becf528e3a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 23:24:17 user nova-compute[72766]: DEBUG nova.compute.manager [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 23:24:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 23:24:17 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Creating image(s)
Aug 14 23:24:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "/opt/stack/data/nova/instances/49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:24:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "/opt/stack/data/nova/instances/49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:24:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "/opt/stack/data/nova/instances/49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:24:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:24:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.179s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:24:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:24:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:24:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:24:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.185s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:24:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a/disk 1073741824 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:24:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a/disk 1073741824" returned: 0 in 0.057s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:24:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:24:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:24:17 user nova-compute[72766]: DEBUG nova.network.neutron [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Successfully created port: 751d95bb-6ad7-4767-b4f6-21d9767002f4 {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 23:24:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.236s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:24:17 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Checking if we can resize image /opt/stack/data/nova/instances/49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a/disk. size=1073741824 {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 23:24:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:24:18 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:24:18 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Cannot resize image /opt/stack/data/nova/instances/49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a/disk to a smaller size. {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 23:24:18 user nova-compute[72766]: DEBUG nova.objects.instance [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lazy-loading 'migration_context' on Instance uuid 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:24:18 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 23:24:18 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Ensure instance console log exists: /opt/stack/data/nova/instances/49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 23:24:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:24:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:24:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:24:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:24:18 user nova-compute[72766]: DEBUG nova.network.neutron [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Successfully updated port: 751d95bb-6ad7-4767-b4f6-21d9767002f4 {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 23:24:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "refresh_cache-49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:24:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquired lock "refresh_cache-49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:24:18 user nova-compute[72766]: DEBUG nova.network.neutron [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:24:18 user nova-compute[72766]: DEBUG nova.compute.manager [req-26ec1f81-1de7-462d-a980-5076fd5d0846 req-69507eba-fc02-4678-8646-4685dc0bbd5d service nova] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Received event network-changed-751d95bb-6ad7-4767-b4f6-21d9767002f4 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:24:18 user nova-compute[72766]: DEBUG nova.compute.manager [req-26ec1f81-1de7-462d-a980-5076fd5d0846 req-69507eba-fc02-4678-8646-4685dc0bbd5d service nova] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Refreshing instance network info cache due to event network-changed-751d95bb-6ad7-4767-b4f6-21d9767002f4. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:24:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-26ec1f81-1de7-462d-a980-5076fd5d0846 req-69507eba-fc02-4678-8646-4685dc0bbd5d service nova] Acquiring lock "refresh_cache-49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:24:18 user nova-compute[72766]: DEBUG nova.network.neutron [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 23:24:19 user nova-compute[72766]: DEBUG nova.network.neutron [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Updating instance_info_cache with network_info: [{"id": "751d95bb-6ad7-4767-b4f6-21d9767002f4", "address": "fa:16:3e:32:4a:65", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap751d95bb-6a", "ovs_interfaceid": "751d95bb-6ad7-4767-b4f6-21d9767002f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:24:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Releasing lock "refresh_cache-49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:24:19 user nova-compute[72766]: DEBUG nova.compute.manager [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Instance network_info: |[{"id": "751d95bb-6ad7-4767-b4f6-21d9767002f4", "address": "fa:16:3e:32:4a:65", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap751d95bb-6a", "ovs_interfaceid": "751d95bb-6ad7-4767-b4f6-21d9767002f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 23:24:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-26ec1f81-1de7-462d-a980-5076fd5d0846 req-69507eba-fc02-4678-8646-4685dc0bbd5d service nova] Acquired lock "refresh_cache-49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:24:19 user nova-compute[72766]: DEBUG nova.network.neutron [req-26ec1f81-1de7-462d-a980-5076fd5d0846 req-69507eba-fc02-4678-8646-4685dc0bbd5d service nova] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Refreshing network info cache for port 751d95bb-6ad7-4767-b4f6-21d9767002f4 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:24:19 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Start _get_guest_xml network_info=[{"id": "751d95bb-6ad7-4767-b4f6-21d9767002f4", "address": "fa:16:3e:32:4a:65", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap751d95bb-6a", "ovs_interfaceid": "751d95bb-6ad7-4767-b4f6-21d9767002f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd2900d30-2c4c-4d57-9135-d45564c0c596'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:24:19 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:24:19 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:24:19 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:24:19 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:24:19 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:24:19 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:24:19 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:24:19 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:24:19 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:24:19 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:24:19 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:24:19 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:24:19 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:24:19 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:24:19 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:24:19 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:24:19 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:24:19 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:24:19 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:24:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-48162781',display_name='tempest-AttachVolumeNegativeTest-server-48162781',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-48162781',id=39,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo09XeJ1pAggSESyIJoxiSZQ8juetrPHWR/cVeQ0wVdhKYrGPF4XiepVoSIbYa/ryzhHlNQH6XsTml3GUAeseDtSVcfWl4aDRZOb17E7U3oazL6G9BakjUPk8QKYRQoig==',key_name='tempest-keypair-679375113',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3785d8cff6cd41a4aff8becf528e3a4c',ramdisk_id='',reservation_id='r-eeyaciv5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1623363641',owner_user_name='tempest-AttachVolumeNegativeTest-1623363641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:24:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90e68d4dfd6048d99037fce632788b57',uuid=49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "751d95bb-6ad7-4767-b4f6-21d9767002f4", "address": "fa:16:3e:32:4a:65", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap751d95bb-6a", "ovs_interfaceid": "751d95bb-6ad7-4767-b4f6-21d9767002f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:24:19 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Converting VIF {"id": "751d95bb-6ad7-4767-b4f6-21d9767002f4", "address": "fa:16:3e:32:4a:65", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap751d95bb-6a", "ovs_interfaceid": "751d95bb-6ad7-4767-b4f6-21d9767002f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:24:19 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:4a:65,bridge_name='br-int',has_traffic_filtering=True,id=751d95bb-6ad7-4767-b4f6-21d9767002f4,network=Network(9491b8be-e6b2-4770-a591-370db9a96785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap751d95bb-6a') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:24:19 user nova-compute[72766]: DEBUG nova.objects.instance [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lazy-loading 'pci_devices' on Instance uuid 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:24:19 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:24:19 user nova-compute[72766]:   <uuid>49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a</uuid>
Aug 14 23:24:19 user nova-compute[72766]:   <name>instance-00000027</name>
Aug 14 23:24:19 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:24:19 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:24:19 user nova-compute[72766]:   <metadata>
Aug 14 23:24:19 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:24:19 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:24:19 user nova-compute[72766]:       <nova:name>tempest-AttachVolumeNegativeTest-server-48162781</nova:name>
Aug 14 23:24:19 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:24:19</nova:creationTime>
Aug 14 23:24:19 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:24:19 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:24:19 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:24:19 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:24:19 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:24:19 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:24:19 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:24:19 user nova-compute[72766]:       <nova:owner>
Aug 14 23:24:19 user nova-compute[72766]:         <nova:user uuid="90e68d4dfd6048d99037fce632788b57">tempest-AttachVolumeNegativeTest-1623363641-project-member</nova:user>
Aug 14 23:24:19 user nova-compute[72766]:         <nova:project uuid="3785d8cff6cd41a4aff8becf528e3a4c">tempest-AttachVolumeNegativeTest-1623363641</nova:project>
Aug 14 23:24:19 user nova-compute[72766]:       </nova:owner>
Aug 14 23:24:19 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 23:24:19 user nova-compute[72766]:       <nova:ports>
Aug 14 23:24:19 user nova-compute[72766]:         <nova:port uuid="751d95bb-6ad7-4767-b4f6-21d9767002f4">
Aug 14 23:24:19 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 14 23:24:19 user nova-compute[72766]:         </nova:port>
Aug 14 23:24:19 user nova-compute[72766]:       </nova:ports>
Aug 14 23:24:19 user nova-compute[72766]:     </nova:instance>
Aug 14 23:24:19 user nova-compute[72766]:   </metadata>
Aug 14 23:24:19 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:24:19 user nova-compute[72766]:     <system>
Aug 14 23:24:19 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:24:19 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:24:19 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:24:19 user nova-compute[72766]:       <entry name="serial">49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a</entry>
Aug 14 23:24:19 user nova-compute[72766]:       <entry name="uuid">49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a</entry>
Aug 14 23:24:19 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:24:19 user nova-compute[72766]:     </system>
Aug 14 23:24:19 user nova-compute[72766]:   </sysinfo>
Aug 14 23:24:19 user nova-compute[72766]:   <os>
Aug 14 23:24:19 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:24:19 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:24:19 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:24:19 user nova-compute[72766]:   </os>
Aug 14 23:24:19 user nova-compute[72766]:   <features>
Aug 14 23:24:19 user nova-compute[72766]:     <acpi/>
Aug 14 23:24:19 user nova-compute[72766]:     <apic/>
Aug 14 23:24:19 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:24:19 user nova-compute[72766]:   </features>
Aug 14 23:24:19 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:24:19 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:24:19 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:24:19 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:24:19 user nova-compute[72766]:   </clock>
Aug 14 23:24:19 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:24:19 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:24:19 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:24:19 user nova-compute[72766]:   </cpu>
Aug 14 23:24:19 user nova-compute[72766]:   <devices>
Aug 14 23:24:19 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 23:24:19 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 23:24:19 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a/disk"/>
Aug 14 23:24:19 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:24:19 user nova-compute[72766]:     </disk>
Aug 14 23:24:19 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:24:19 user nova-compute[72766]:       <mac address="fa:16:3e:32:4a:65"/>
Aug 14 23:24:19 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:24:19 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:24:19 user nova-compute[72766]:       <target dev="tap751d95bb-6a"/>
Aug 14 23:24:19 user nova-compute[72766]:     </interface>
Aug 14 23:24:19 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:24:19 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a/console.log" append="off"/>
Aug 14 23:24:19 user nova-compute[72766]:     </serial>
Aug 14 23:24:19 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:24:19 user nova-compute[72766]:     <video>
Aug 14 23:24:19 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:24:19 user nova-compute[72766]:     </video>
Aug 14 23:24:19 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:24:19 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:24:19 user nova-compute[72766]:     </rng>
Aug 14 23:24:19 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:24:19 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:24:19 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:24:19 user nova-compute[72766]:     </memballoon>
Aug 14 23:24:19 user nova-compute[72766]:   </devices>
Aug 14 23:24:19 user nova-compute[72766]: </domain>
Aug 14 23:24:19 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:24:19 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:24:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-48162781',display_name='tempest-AttachVolumeNegativeTest-server-48162781',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-48162781',id=39,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo09XeJ1pAggSESyIJoxiSZQ8juetrPHWR/cVeQ0wVdhKYrGPF4XiepVoSIbYa/ryzhHlNQH6XsTml3GUAeseDtSVcfWl4aDRZOb17E7U3oazL6G9BakjUPk8QKYRQoig==',key_name='tempest-keypair-679375113',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3785d8cff6cd41a4aff8becf528e3a4c',ramdisk_id='',reservation_id='r-eeyaciv5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1623363641',owner_user_name='tempest-AttachVolumeNegativeTest-1623363641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:24:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90e68d4dfd6048d99037fce632788b57',uuid=49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "751d95bb-6ad7-4767-b4f6-21d9767002f4", "address": "fa:16:3e:32:4a:65", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap751d95bb-6a", "ovs_interfaceid": "751d95bb-6ad7-4767-b4f6-21d9767002f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:24:19 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Converting VIF {"id": "751d95bb-6ad7-4767-b4f6-21d9767002f4", "address": "fa:16:3e:32:4a:65", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap751d95bb-6a", "ovs_interfaceid": "751d95bb-6ad7-4767-b4f6-21d9767002f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:24:19 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:4a:65,bridge_name='br-int',has_traffic_filtering=True,id=751d95bb-6ad7-4767-b4f6-21d9767002f4,network=Network(9491b8be-e6b2-4770-a591-370db9a96785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap751d95bb-6a') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:24:19 user nova-compute[72766]: DEBUG os_vif [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:4a:65,bridge_name='br-int',has_traffic_filtering=True,id=751d95bb-6ad7-4767-b4f6-21d9767002f4,network=Network(9491b8be-e6b2-4770-a591-370db9a96785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap751d95bb-6a') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:24:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:24:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:24:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:24:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:24:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap751d95bb-6a, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:24:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap751d95bb-6a, col_values=(('external_ids', {'iface-id': '751d95bb-6ad7-4767-b4f6-21d9767002f4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:4a:65', 'vm-uuid': '49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:24:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:24:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:24:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:24:19 user nova-compute[72766]: INFO os_vif [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:4a:65,bridge_name='br-int',has_traffic_filtering=True,id=751d95bb-6ad7-4767-b4f6-21d9767002f4,network=Network(9491b8be-e6b2-4770-a591-370db9a96785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap751d95bb-6a')
Aug 14 23:24:19 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:24:19 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] No VIF found with MAC fa:16:3e:32:4a:65, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:24:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:24:19 user nova-compute[72766]: DEBUG nova.network.neutron [req-26ec1f81-1de7-462d-a980-5076fd5d0846 req-69507eba-fc02-4678-8646-4685dc0bbd5d service nova] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Updated VIF entry in instance network info cache for port 751d95bb-6ad7-4767-b4f6-21d9767002f4. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:24:19 user nova-compute[72766]: DEBUG nova.network.neutron [req-26ec1f81-1de7-462d-a980-5076fd5d0846 req-69507eba-fc02-4678-8646-4685dc0bbd5d service nova] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Updating instance_info_cache with network_info: [{"id": "751d95bb-6ad7-4767-b4f6-21d9767002f4", "address": "fa:16:3e:32:4a:65", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap751d95bb-6a", "ovs_interfaceid": "751d95bb-6ad7-4767-b4f6-21d9767002f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:24:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-26ec1f81-1de7-462d-a980-5076fd5d0846 req-69507eba-fc02-4678-8646-4685dc0bbd5d service nova] Releasing lock "refresh_cache-49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:24:20 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:24:20 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:24:20 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:24:20 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:24:20 user nova-compute[72766]: DEBUG nova.compute.manager [req-41679631-cfe9-4754-b5d1-fc78c9e2540c req-4e432218-a6bb-4a54-a89b-5b0b5ccad1fe service nova] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Received event network-vif-plugged-751d95bb-6ad7-4767-b4f6-21d9767002f4 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:24:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-41679631-cfe9-4754-b5d1-fc78c9e2540c req-4e432218-a6bb-4a54-a89b-5b0b5ccad1fe service nova] Acquiring lock "49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:24:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-41679631-cfe9-4754-b5d1-fc78c9e2540c req-4e432218-a6bb-4a54-a89b-5b0b5ccad1fe service nova] Lock "49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:24:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-41679631-cfe9-4754-b5d1-fc78c9e2540c req-4e432218-a6bb-4a54-a89b-5b0b5ccad1fe service nova] Lock "49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:24:20 user nova-compute[72766]: DEBUG nova.compute.manager [req-41679631-cfe9-4754-b5d1-fc78c9e2540c req-4e432218-a6bb-4a54-a89b-5b0b5ccad1fe service nova] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] No waiting events found dispatching network-vif-plugged-751d95bb-6ad7-4767-b4f6-21d9767002f4 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:24:20 user nova-compute[72766]: WARNING nova.compute.manager [req-41679631-cfe9-4754-b5d1-fc78c9e2540c req-4e432218-a6bb-4a54-a89b-5b0b5ccad1fe service nova] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Received unexpected event network-vif-plugged-751d95bb-6ad7-4767-b4f6-21d9767002f4 for instance with vm_state building and task_state spawning.
Aug 14 23:24:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:24:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:24:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:24:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:24:22 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692055462.761143, 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:24:22 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] VM Resumed (Lifecycle Event)
Aug 14 23:24:22 user nova-compute[72766]: DEBUG nova.compute.manager [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:24:22 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 23:24:22 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Instance spawned successfully.
Aug 14 23:24:22 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 23:24:22 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:24:22 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:24:22 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:24:22 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:24:22 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:24:22 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:24:22 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:24:22 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:24:22 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:24:22 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692055462.7636466, 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:24:22 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] VM Started (Lifecycle Event)
Aug 14 23:24:22 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:24:22 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:24:22 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:24:22 user nova-compute[72766]: INFO nova.compute.manager [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Took 5.76 seconds to spawn the instance on the hypervisor.
Aug 14 23:24:22 user nova-compute[72766]: DEBUG nova.compute.manager [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:24:22 user nova-compute[72766]: DEBUG nova.compute.manager [req-4ea2cb54-42e7-4db6-9457-043768d2f5fb req-49be6af8-470c-4544-9f56-838ed35a74c3 service nova] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Received event network-vif-plugged-751d95bb-6ad7-4767-b4f6-21d9767002f4 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:24:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-4ea2cb54-42e7-4db6-9457-043768d2f5fb req-49be6af8-470c-4544-9f56-838ed35a74c3 service nova] Acquiring lock "49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:24:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-4ea2cb54-42e7-4db6-9457-043768d2f5fb req-49be6af8-470c-4544-9f56-838ed35a74c3 service nova] Lock "49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:24:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-4ea2cb54-42e7-4db6-9457-043768d2f5fb req-49be6af8-470c-4544-9f56-838ed35a74c3 service nova] Lock "49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:24:22 user nova-compute[72766]: DEBUG nova.compute.manager [req-4ea2cb54-42e7-4db6-9457-043768d2f5fb req-49be6af8-470c-4544-9f56-838ed35a74c3 service nova] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] No waiting events found dispatching network-vif-plugged-751d95bb-6ad7-4767-b4f6-21d9767002f4 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:24:22 user nova-compute[72766]: WARNING nova.compute.manager [req-4ea2cb54-42e7-4db6-9457-043768d2f5fb req-49be6af8-470c-4544-9f56-838ed35a74c3 service nova] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Received unexpected event network-vif-plugged-751d95bb-6ad7-4767-b4f6-21d9767002f4 for instance with vm_state building and task_state spawning.
Aug 14 23:24:23 user nova-compute[72766]: INFO nova.compute.manager [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Took 6.38 seconds to build instance.
Aug 14 23:24:23 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-871bd50d-091d-43d9-b6b0-7a817ed8b17e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.473s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:24:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:24:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:24:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "b86c4ecf-c169-464e-ad4d-5a6ead88adf5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:24:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "b86c4ecf-c169-464e-ad4d-5a6ead88adf5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:24:24 user nova-compute[72766]: DEBUG nova.compute.manager [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 23:24:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:24:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:24:24 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 23:24:24 user nova-compute[72766]: INFO nova.compute.claims [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Claim successful on node user
Aug 14 23:24:24 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:24:24 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:24:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.309s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:24:24 user nova-compute[72766]: DEBUG nova.compute.manager [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 23:24:24 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 23:24:24 user nova-compute[72766]: DEBUG nova.compute.manager [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 23:24:24 user nova-compute[72766]: DEBUG nova.network.neutron [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 23:24:25 user nova-compute[72766]: DEBUG nova.compute.manager [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 23:24:25 user nova-compute[72766]: INFO nova.virt.block_device [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Booting with volume snapshot 24e2fcef-3ba0-4ec4-877f-55dd5e615d08 at /dev/vda
Aug 14 23:24:25 user nova-compute[72766]: DEBUG nova.policy [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '999390ac8e6240199c9a7484e234f3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c9f53727cc497c94516ff7fa1bbf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 23:24:25 user nova-compute[72766]: DEBUG nova.network.neutron [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Successfully created port: 01270e8f-0ff7-464d-9a4d-c86efbb0f7a3 {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 23:24:26 user nova-compute[72766]: DEBUG nova.network.neutron [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Successfully updated port: 01270e8f-0ff7-464d-9a4d-c86efbb0f7a3 {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 23:24:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "refresh_cache-b86c4ecf-c169-464e-ad4d-5a6ead88adf5" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:24:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquired lock "refresh_cache-b86c4ecf-c169-464e-ad4d-5a6ead88adf5" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:24:26 user nova-compute[72766]: DEBUG nova.network.neutron [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:24:26 user nova-compute[72766]: DEBUG nova.compute.manager [req-28ad89b3-9c16-431f-8800-f5f5886cfc55 req-6af7b6e8-f4b3-4452-aba6-9be40a1f9ed3 service nova] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Received event network-changed-01270e8f-0ff7-464d-9a4d-c86efbb0f7a3 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:24:26 user nova-compute[72766]: DEBUG nova.compute.manager [req-28ad89b3-9c16-431f-8800-f5f5886cfc55 req-6af7b6e8-f4b3-4452-aba6-9be40a1f9ed3 service nova] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Refreshing instance network info cache due to event network-changed-01270e8f-0ff7-464d-9a4d-c86efbb0f7a3. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:24:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-28ad89b3-9c16-431f-8800-f5f5886cfc55 req-6af7b6e8-f4b3-4452-aba6-9be40a1f9ed3 service nova] Acquiring lock "refresh_cache-b86c4ecf-c169-464e-ad4d-5a6ead88adf5" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:24:26 user nova-compute[72766]: DEBUG nova.network.neutron [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 23:24:26 user nova-compute[72766]: DEBUG nova.network.neutron [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Updating instance_info_cache with network_info: [{"id": "01270e8f-0ff7-464d-9a4d-c86efbb0f7a3", "address": "fa:16:3e:ba:08:50", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01270e8f-0f", "ovs_interfaceid": "01270e8f-0ff7-464d-9a4d-c86efbb0f7a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:24:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Releasing lock "refresh_cache-b86c4ecf-c169-464e-ad4d-5a6ead88adf5" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:24:27 user nova-compute[72766]: DEBUG nova.compute.manager [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Instance network_info: |[{"id": "01270e8f-0ff7-464d-9a4d-c86efbb0f7a3", "address": "fa:16:3e:ba:08:50", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01270e8f-0f", "ovs_interfaceid": "01270e8f-0ff7-464d-9a4d-c86efbb0f7a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 23:24:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-28ad89b3-9c16-431f-8800-f5f5886cfc55 req-6af7b6e8-f4b3-4452-aba6-9be40a1f9ed3 service nova] Acquired lock "refresh_cache-b86c4ecf-c169-464e-ad4d-5a6ead88adf5" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:24:27 user nova-compute[72766]: DEBUG nova.network.neutron [req-28ad89b3-9c16-431f-8800-f5f5886cfc55 req-6af7b6e8-f4b3-4452-aba6-9be40a1f9ed3 service nova] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Refreshing network info cache for port 01270e8f-0ff7-464d-9a4d-c86efbb0f7a3 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:24:27 user nova-compute[72766]: DEBUG nova.network.neutron [req-28ad89b3-9c16-431f-8800-f5f5886cfc55 req-6af7b6e8-f4b3-4452-aba6-9be40a1f9ed3 service nova] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Updated VIF entry in instance network info cache for port 01270e8f-0ff7-464d-9a4d-c86efbb0f7a3. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:24:27 user nova-compute[72766]: DEBUG nova.network.neutron [req-28ad89b3-9c16-431f-8800-f5f5886cfc55 req-6af7b6e8-f4b3-4452-aba6-9be40a1f9ed3 service nova] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Updating instance_info_cache with network_info: [{"id": "01270e8f-0ff7-464d-9a4d-c86efbb0f7a3", "address": "fa:16:3e:ba:08:50", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01270e8f-0f", "ovs_interfaceid": "01270e8f-0ff7-464d-9a4d-c86efbb0f7a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:24:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-28ad89b3-9c16-431f-8800-f5f5886cfc55 req-6af7b6e8-f4b3-4452-aba6-9be40a1f9ed3 service nova] Releasing lock "refresh_cache-b86c4ecf-c169-464e-ad4d-5a6ead88adf5" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:24:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:24:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:24:30 user nova-compute[72766]: DEBUG os_brick.utils [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:24:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:24:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:24:30 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f2b5ba-ed2d-4f55-ac35-e1e9a6b6ea11]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:24:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:24:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:24:30 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b43a828-a8a0-48fa-83ae-cd06c194c151]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:24:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:24:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:24:30 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[10deebce-9c12-45eb-928d-2566ed0a1f4d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:24:31 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[749ca2bc-c33a-4124-ad0f-e086f221aee0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:24:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:24:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:24:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 23:24:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:24:31 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:24:31 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 23:24:31 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba811956-9b9f-4996-8b4d-85f7026d597f]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:24:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 23:24:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 23:24:31 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 23:24:31 user nova-compute[72766]: DEBUG os_brick.utils [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:24:31 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Updating existing volume attachment record: a5105c00-9d76-407e-b13a-764e1bfae886 {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 23:24:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:24:35 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:24:37 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:24:37 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:24:37 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:24:37 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:24:37 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:24:38 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Updating instance_info_cache with network_info: [{"id": "0df45a26-6026-4baa-bdaa-a761d2d3c2a6", "address": "fa:16:3e:89:96:a5", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0df45a26-60", "ovs_interfaceid": "0df45a26-6026-4baa-bdaa-a761d2d3c2a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:24:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:24:38 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:24:38 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:24:38 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:24:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:24:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:24:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:24:38 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:24:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb57162-d1da-4ea0-aca0-80da305537d1/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:24:39 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb57162-d1da-4ea0-aca0-80da305537d1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:24:39 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb57162-d1da-4ea0-aca0-80da305537d1/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:24:39 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb57162-d1da-4ea0-aca0-80da305537d1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:24:39 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:24:39 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:24:39 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:24:39 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:24:39 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:24:39 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:24:39 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:24:39 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:24:39 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:24:39 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:24:39 user nova-compute[72766]: DEBUG nova.compute.manager [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 23:24:39 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 23:24:39 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Creating image(s)
Aug 14 23:24:39 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Did not create local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 23:24:39 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Ensure instance console log exists: /opt/stack/data/nova/instances/b86c4ecf-c169-464e-ad4d-5a6ead88adf5/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 23:24:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:24:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:24:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:24:39 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Start _get_guest_xml network_info=[{"id": "01270e8f-0ff7-464d-9a4d-c86efbb0f7a3", "address": "fa:16:3e:ba:08:50", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01270e8f-0f", "ovs_interfaceid": "01270e8f-0ff7-464d-9a4d-c86efbb0f7a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-14T23:24:14Z,direct_url=<?>,disk_format='qcow2',id=fd5e2e55-f6ec-4c41-8b00-b233b6128c4c,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1486116829',owner='a3c9f53727cc497c94516ff7fa1bbf4f',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-14T23:24:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': 'a5105c00-9d76-407e-b13a-764e1bfae886', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QywMBPgv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b86c4ecf-c169-464e-ad4d-5a6ead88adf5', 'attached_at': '', 'detached_at': '', 'volume_id': '7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae', 'serial': '7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae'}, 'volume_type': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:24:39 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:24:39 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:24:39 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:24:39 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:24:39 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:24:39 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:24:39 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:24:39 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-14T23:24:14Z,direct_url=<?>,disk_format='qcow2',id=fd5e2e55-f6ec-4c41-8b00-b233b6128c4c,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1486116829',owner='a3c9f53727cc497c94516ff7fa1bbf4f',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-14T23:24:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:24:39 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:24:39 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:24:39 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:24:39 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:24:39 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:24:39 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:24:39 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:24:39 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:24:39 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:24:39 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:24:39 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 23:24:39 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QywMBPgv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:24:39 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:24:39 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:24:39 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:24:39 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:24:39 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:24:39 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:24:39 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 23:24:39 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8083af02-978c-472a-81e1-2af867ef3208]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 23:24:40 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d6f84f-b379-4df0-88b4-82a418625cfc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae] added
Aug 14 23:24:40 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c180c015-f001-4211-8a23-655a71b10b5e]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ce39da-1df4-4670-a834-14c3348b3ed0]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QywMBPgv {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QywMBPgv" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7d977e-7253-474c-807d-6d73a6629c20]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QywMBPgv'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:24:40 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:24:40 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:24:40 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=8266MB free_disk=25.29238510131836GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca684457-c8d2-4c78-9c86-01b01ab8b21c]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7e1b54-ad9c-47d6-bed8-ba41575a59a1]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 (non-flash)
Aug 14 23:24:40 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 (non-flash)
Aug 14 23:24:40 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[33abd514-e98c-4241-99aa-2127bea1a044]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae, portal: 172.16.0.220,3260]
Aug 14 23:24:40 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae, portal: 172.16.0.220,3260] successful.
Aug 14 23:24:40 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance cbcf7851-e6f7-4f46-97cc-d773286ccddf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 22fcbe70-f8b6-4a57-ac95-296bac414544 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance fcb57162-d1da-4ea0-aca0-80da305537d1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance b86c4ecf-c169-464e-ad4d-5a6ead88adf5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[230644a3-c027-4500-9a66-a69b48f85b4e]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3701b9-3b87-4c11-b288-30cc363c96bd]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 (non-flash)
Aug 14 23:24:40 user nova-compute[72766]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae (non-flash)
Aug 14 23:24:40 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 (non-flash)
Aug 14 23:24:40 user nova-compute[72766]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae (non-flash)
Aug 14 23:24:40 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.679s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[df186c45-7535-4787-835f-31c5d20dafa4]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QywMBPgv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:24:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.333s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:24:41 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.712s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:24:41 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] <== connect_volume: return (1713ms) {'type': 'block', 'scsi_wwn': '23764303065643966', 'path': '/dev/sdc'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:24:41 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764303065643966', 'path': '/dev/sdc'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 23:24:41 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:24:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1074514974',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1074514974',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1074514974',id=40,image_ref='fd5e2e55-f6ec-4c41-8b00-b233b6128c4c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFCxo1GwGB/CPzufzEw0qqOU/yRYLoCh4NmFt0hmPPmKpX0fdF/HiP4TKa66FcuLasjrTtYsnNYCAAvZdDRk6VxLM5yuhkoxxoReF7LuhI8a43McBqSIat3gJ9JumXtWQ==',key_name='tempest-keypair-1351044208',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3c9f53727cc497c94516ff7fa1bbf4f',ramdisk_id='',reservation_id='r-hwpzcs9m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-213280496',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-213280496-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-213280496',owner_user_name='tempest-TestVolumeBootPattern-213280496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:24:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='999390ac8e6240199c9a7484e234f3a7',uuid=b86c4ecf-c169-464e-ad4d-5a6ead88adf5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01270e8f-0ff7-464d-9a4d-c86efbb0f7a3", "address": "fa:16:3e:ba:08:50", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01270e8f-0f", "ovs_interfaceid": "01270e8f-0ff7-464d-9a4d-c86efbb0f7a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:24:41 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Converting VIF {"id": "01270e8f-0ff7-464d-9a4d-c86efbb0f7a3", "address": "fa:16:3e:ba:08:50", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01270e8f-0f", "ovs_interfaceid": "01270e8f-0ff7-464d-9a4d-c86efbb0f7a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:24:41 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:08:50,bridge_name='br-int',has_traffic_filtering=True,id=01270e8f-0ff7-464d-9a4d-c86efbb0f7a3,network=Network(f418a384-bbac-4892-8e0f-c7af2e9464ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01270e8f-0f') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:24:41 user nova-compute[72766]: DEBUG nova.objects.instance [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lazy-loading 'pci_devices' on Instance uuid b86c4ecf-c169-464e-ad4d-5a6ead88adf5 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:24:41 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:24:41 user nova-compute[72766]:   <uuid>b86c4ecf-c169-464e-ad4d-5a6ead88adf5</uuid>
Aug 14 23:24:41 user nova-compute[72766]:   <name>instance-00000028</name>
Aug 14 23:24:41 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:24:41 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:24:41 user nova-compute[72766]:   <metadata>
Aug 14 23:24:41 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:24:41 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:24:41 user nova-compute[72766]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1074514974</nova:name>
Aug 14 23:24:41 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:24:39</nova:creationTime>
Aug 14 23:24:41 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:24:41 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:24:41 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:24:41 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:24:41 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:24:41 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:24:41 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:24:41 user nova-compute[72766]:       <nova:owner>
Aug 14 23:24:41 user nova-compute[72766]:         <nova:user uuid="999390ac8e6240199c9a7484e234f3a7">tempest-TestVolumeBootPattern-213280496-project-member</nova:user>
Aug 14 23:24:41 user nova-compute[72766]:         <nova:project uuid="a3c9f53727cc497c94516ff7fa1bbf4f">tempest-TestVolumeBootPattern-213280496</nova:project>
Aug 14 23:24:41 user nova-compute[72766]:       </nova:owner>
Aug 14 23:24:41 user nova-compute[72766]:       <nova:root type="image" uuid="fd5e2e55-f6ec-4c41-8b00-b233b6128c4c"/>
Aug 14 23:24:41 user nova-compute[72766]:       <nova:ports>
Aug 14 23:24:41 user nova-compute[72766]:         <nova:port uuid="01270e8f-0ff7-464d-9a4d-c86efbb0f7a3">
Aug 14 23:24:41 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 14 23:24:41 user nova-compute[72766]:         </nova:port>
Aug 14 23:24:41 user nova-compute[72766]:       </nova:ports>
Aug 14 23:24:41 user nova-compute[72766]:     </nova:instance>
Aug 14 23:24:41 user nova-compute[72766]:   </metadata>
Aug 14 23:24:41 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:24:41 user nova-compute[72766]:     <system>
Aug 14 23:24:41 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:24:41 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:24:41 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:24:41 user nova-compute[72766]:       <entry name="serial">b86c4ecf-c169-464e-ad4d-5a6ead88adf5</entry>
Aug 14 23:24:41 user nova-compute[72766]:       <entry name="uuid">b86c4ecf-c169-464e-ad4d-5a6ead88adf5</entry>
Aug 14 23:24:41 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:24:41 user nova-compute[72766]:     </system>
Aug 14 23:24:41 user nova-compute[72766]:   </sysinfo>
Aug 14 23:24:41 user nova-compute[72766]:   <os>
Aug 14 23:24:41 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:24:41 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:24:41 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:24:41 user nova-compute[72766]:   </os>
Aug 14 23:24:41 user nova-compute[72766]:   <features>
Aug 14 23:24:41 user nova-compute[72766]:     <acpi/>
Aug 14 23:24:41 user nova-compute[72766]:     <apic/>
Aug 14 23:24:41 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:24:41 user nova-compute[72766]:   </features>
Aug 14 23:24:41 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:24:41 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:24:41 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:24:41 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:24:41 user nova-compute[72766]:   </clock>
Aug 14 23:24:41 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:24:41 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:24:41 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:24:41 user nova-compute[72766]:   </cpu>
Aug 14 23:24:41 user nova-compute[72766]:   <devices>
Aug 14 23:24:41 user nova-compute[72766]:     <disk type="block" device="disk">
Aug 14 23:24:41 user nova-compute[72766]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:24:41 user nova-compute[72766]:       <source dev="/dev/sdc"/>
Aug 14 23:24:41 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:24:41 user nova-compute[72766]:       <serial>7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae</serial>
Aug 14 23:24:41 user nova-compute[72766]:     </disk>
Aug 14 23:24:41 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:24:41 user nova-compute[72766]:       <mac address="fa:16:3e:ba:08:50"/>
Aug 14 23:24:41 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:24:41 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:24:41 user nova-compute[72766]:       <target dev="tap01270e8f-0f"/>
Aug 14 23:24:41 user nova-compute[72766]:     </interface>
Aug 14 23:24:41 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:24:41 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/b86c4ecf-c169-464e-ad4d-5a6ead88adf5/console.log" append="off"/>
Aug 14 23:24:41 user nova-compute[72766]:     </serial>
Aug 14 23:24:41 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:24:41 user nova-compute[72766]:     <video>
Aug 14 23:24:41 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:24:41 user nova-compute[72766]:     </video>
Aug 14 23:24:41 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:24:41 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:24:41 user nova-compute[72766]:     </rng>
Aug 14 23:24:41 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:24:41 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:24:41 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:24:41 user nova-compute[72766]:     </memballoon>
Aug 14 23:24:41 user nova-compute[72766]:   </devices>
Aug 14 23:24:41 user nova-compute[72766]: </domain>
Aug 14 23:24:41 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:24:41 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:24:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1074514974',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1074514974',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1074514974',id=40,image_ref='fd5e2e55-f6ec-4c41-8b00-b233b6128c4c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFCxo1GwGB/CPzufzEw0qqOU/yRYLoCh4NmFt0hmPPmKpX0fdF/HiP4TKa66FcuLasjrTtYsnNYCAAvZdDRk6VxLM5yuhkoxxoReF7LuhI8a43McBqSIat3gJ9JumXtWQ==',key_name='tempest-keypair-1351044208',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3c9f53727cc497c94516ff7fa1bbf4f',ramdisk_id='',reservation_id='r-hwpzcs9m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-213280496',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-213280496-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-213280496',owner_user_name='tempest-TestVolumeBootPattern-213280496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:24:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='999390ac8e6240199c9a7484e234f3a7',uuid=b86c4ecf-c169-464e-ad4d-5a6ead88adf5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01270e8f-0ff7-464d-9a4d-c86efbb0f7a3", "address": "fa:16:3e:ba:08:50", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01270e8f-0f", "ovs_interfaceid": "01270e8f-0ff7-464d-9a4d-c86efbb0f7a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:24:41 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Converting VIF {"id": "01270e8f-0ff7-464d-9a4d-c86efbb0f7a3", "address": "fa:16:3e:ba:08:50", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01270e8f-0f", "ovs_interfaceid": "01270e8f-0ff7-464d-9a4d-c86efbb0f7a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:24:41 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:08:50,bridge_name='br-int',has_traffic_filtering=True,id=01270e8f-0ff7-464d-9a4d-c86efbb0f7a3,network=Network(f418a384-bbac-4892-8e0f-c7af2e9464ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01270e8f-0f') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:24:41 user nova-compute[72766]: DEBUG os_vif [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:08:50,bridge_name='br-int',has_traffic_filtering=True,id=01270e8f-0ff7-464d-9a4d-c86efbb0f7a3,network=Network(f418a384-bbac-4892-8e0f-c7af2e9464ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01270e8f-0f') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:24:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:24:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:24:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:24:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:24:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01270e8f-0f, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:24:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap01270e8f-0f, col_values=(('external_ids', {'iface-id': '01270e8f-0ff7-464d-9a4d-c86efbb0f7a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:08:50', 'vm-uuid': 'b86c4ecf-c169-464e-ad4d-5a6ead88adf5'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:24:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:24:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:24:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:24:41 user nova-compute[72766]: INFO os_vif [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:08:50,bridge_name='br-int',has_traffic_filtering=True,id=01270e8f-0ff7-464d-9a4d-c86efbb0f7a3,network=Network(f418a384-bbac-4892-8e0f-c7af2e9464ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01270e8f-0f')
Aug 14 23:24:41 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:24:41 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] No VIF found with MAC fa:16:3e:ba:08:50, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:24:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Acquiring lock "fcb57162-d1da-4ea0-aca0-80da305537d1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:24:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "fcb57162-d1da-4ea0-aca0-80da305537d1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:24:42 user nova-compute[72766]: DEBUG nova.objects.instance [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lazy-loading 'flavor' on Instance uuid fcb57162-d1da-4ea0-aca0-80da305537d1 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:24:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "fcb57162-d1da-4ea0-aca0-80da305537d1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:24:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Acquiring lock "fcb57162-d1da-4ea0-aca0-80da305537d1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:24:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "fcb57162-d1da-4ea0-aca0-80da305537d1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:24:42 user nova-compute[72766]: INFO nova.compute.manager [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Attaching volume 7ce97945-fbe1-4773-b504-1b6da655becc to /dev/vdb
Aug 14 23:24:42 user nova-compute[72766]: DEBUG os_brick.utils [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:24:42 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:24:42 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:24:42 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[140646fa-fa39-40ce-8e57-4aa5e1e8a37e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:24:42 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:24:42 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:24:42 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c980d0-699f-4685-af34-72055494456e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:24:42 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:24:42 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:24:42 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f091b66-0d7c-4432-b189-d28dc3cff9f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:24:42 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e2b88e-b240-4313-973a-2888304168e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:24:42 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:24:42 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:24:42 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 23:24:42 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:24:42 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:24:42 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 23:24:42 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[77dfe980-88c3-404c-9370-1e0038a4fa68]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:24:42 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 23:24:42 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 23:24:42 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 23:24:42 user nova-compute[72766]: DEBUG os_brick.utils [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:24:42 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Updating existing volume attachment record: 6a155acf-2390-4446-b799-7010ff31f583 {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 23:24:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:24:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:24:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:24:43 user nova-compute[72766]: DEBUG nova.compute.manager [req-064db0b7-908a-4a94-9828-a17068d20848 req-9040e018-b5f7-479d-b398-85e2b2d6d530 service nova] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Received event network-vif-plugged-01270e8f-0ff7-464d-9a4d-c86efbb0f7a3 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:24:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-064db0b7-908a-4a94-9828-a17068d20848 req-9040e018-b5f7-479d-b398-85e2b2d6d530 service nova] Acquiring lock "b86c4ecf-c169-464e-ad4d-5a6ead88adf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:24:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-064db0b7-908a-4a94-9828-a17068d20848 req-9040e018-b5f7-479d-b398-85e2b2d6d530 service nova] Lock "b86c4ecf-c169-464e-ad4d-5a6ead88adf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:24:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-064db0b7-908a-4a94-9828-a17068d20848 req-9040e018-b5f7-479d-b398-85e2b2d6d530 service nova] Lock "b86c4ecf-c169-464e-ad4d-5a6ead88adf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:24:43 user nova-compute[72766]: DEBUG nova.compute.manager [req-064db0b7-908a-4a94-9828-a17068d20848 req-9040e018-b5f7-479d-b398-85e2b2d6d530 service nova] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] No waiting events found dispatching network-vif-plugged-01270e8f-0ff7-464d-9a4d-c86efbb0f7a3 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:24:43 user nova-compute[72766]: WARNING nova.compute.manager [req-064db0b7-908a-4a94-9828-a17068d20848 req-9040e018-b5f7-479d-b398-85e2b2d6d530 service nova] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Received unexpected event network-vif-plugged-01270e8f-0ff7-464d-9a4d-c86efbb0f7a3 for instance with vm_state building and task_state spawning.
Aug 14 23:24:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:24:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:24:43 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:24:43 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:24:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:24:45 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692055485.1803558, b86c4ecf-c169-464e-ad4d-5a6ead88adf5 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:24:45 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] VM Resumed (Lifecycle Event)
Aug 14 23:24:45 user nova-compute[72766]: DEBUG nova.compute.manager [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:24:45 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 23:24:45 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Instance spawned successfully.
Aug 14 23:24:45 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 23:24:45 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:24:45 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:24:45 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:24:45 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:24:45 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:24:45 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692055485.1823413, b86c4ecf-c169-464e-ad4d-5a6ead88adf5 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:24:45 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] VM Started (Lifecycle Event)
Aug 14 23:24:45 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:24:45 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:24:45 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:24:45 user nova-compute[72766]: INFO nova.compute.manager [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Took 5.37 seconds to spawn the instance on the hypervisor.
Aug 14 23:24:45 user nova-compute[72766]: DEBUG nova.compute.manager [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:24:45 user nova-compute[72766]: DEBUG nova.compute.manager [req-73e74cfc-b718-4518-a01a-543d98e21b5f req-ddbdfa8b-909a-4612-8cdc-08137f315f41 service nova] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Received event network-vif-plugged-01270e8f-0ff7-464d-9a4d-c86efbb0f7a3 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:24:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-73e74cfc-b718-4518-a01a-543d98e21b5f req-ddbdfa8b-909a-4612-8cdc-08137f315f41 service nova] Acquiring lock "b86c4ecf-c169-464e-ad4d-5a6ead88adf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:24:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-73e74cfc-b718-4518-a01a-543d98e21b5f req-ddbdfa8b-909a-4612-8cdc-08137f315f41 service nova] Lock "b86c4ecf-c169-464e-ad4d-5a6ead88adf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:24:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-73e74cfc-b718-4518-a01a-543d98e21b5f req-ddbdfa8b-909a-4612-8cdc-08137f315f41 service nova] Lock "b86c4ecf-c169-464e-ad4d-5a6ead88adf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:24:45 user nova-compute[72766]: DEBUG nova.compute.manager [req-73e74cfc-b718-4518-a01a-543d98e21b5f req-ddbdfa8b-909a-4612-8cdc-08137f315f41 service nova] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] No waiting events found dispatching network-vif-plugged-01270e8f-0ff7-464d-9a4d-c86efbb0f7a3 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:24:45 user nova-compute[72766]: WARNING nova.compute.manager [req-73e74cfc-b718-4518-a01a-543d98e21b5f req-ddbdfa8b-909a-4612-8cdc-08137f315f41 service nova] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Received unexpected event network-vif-plugged-01270e8f-0ff7-464d-9a4d-c86efbb0f7a3 for instance with vm_state building and task_state spawning.
Aug 14 23:24:45 user nova-compute[72766]: INFO nova.compute.manager [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Took 20.83 seconds to build instance.
Aug 14 23:24:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6dca35f7-1177-4ff6-b75f-034119c42dae tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "b86c4ecf-c169-464e-ad4d-5a6ead88adf5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.949s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:24:45 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:24:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:24:47 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:24:47 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:24:47 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:24:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fnJMmLAk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:24:51 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:24:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:24:51 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:24:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:24:51 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 23:24:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e074f5e0-aead-404d-9079-7a51e2d0b36e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 23:24:51 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e325153e-9a7d-410f-9c23-4efff4192742]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc] added
Aug 14 23:24:51 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d40820-5e1e-4886-b1d6-e17785a41f68]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a1b852-6ac2-4ba2-b177-bd773910b83f]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fnJMmLAk {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fnJMmLAk" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[966ddc4a-9963-4df3-af16-f7baf1361fcc]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fnJMmLAk'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[346ea93a-d4f2-4f9c-bfec-e3c3413aaabb]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea1b140-ab2c-4100-99ce-67890eb08400]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 (non-flash)
Aug 14 23:24:51 user nova-compute[72766]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae (non-flash)
Aug 14 23:24:51 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 (non-flash)
Aug 14 23:24:51 user nova-compute[72766]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae (non-flash)
Aug 14 23:24:51 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[89eee0c7-fd27-4be3-9c31-11982997816a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc, portal: 172.16.0.220,3260]
Aug 14 23:24:51 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc, portal: 172.16.0.220,3260] successful.
Aug 14 23:24:51 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c980e6-0cf5-4932-ad77-e4ee518ae2d5]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad47bfc-3339-4f92-9b16-5172e51edee2]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 (non-flash)
Aug 14 23:24:51 user nova-compute[72766]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae (non-flash)
Aug 14 23:24:51 user nova-compute[72766]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc (non-flash)
Aug 14 23:24:51 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 (non-flash)
Aug 14 23:24:51 user nova-compute[72766]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae (non-flash)
Aug 14 23:24:51 user nova-compute[72766]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc (non-flash)
Aug 14 23:24:51 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] HCTL ('35', '-', '-', 0) found on session 50 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[016ebf93-d0f2-4e96-92d6-d85c93f081d6]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fnJMmLAk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 23:24:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:24:52 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:24:52 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23334336438333636', 'path': '/dev/sdd'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:24:52 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334336438333636', 'path': '/dev/sdd'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 23:24:52 user nova-compute[72766]: DEBUG nova.objects.instance [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lazy-loading 'flavor' on Instance uuid fcb57162-d1da-4ea0-aca0-80da305537d1 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:24:52 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 23:24:52 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:24:52 user nova-compute[72766]:   <source dev="/dev/sdd"/>
Aug 14 23:24:52 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:24:52 user nova-compute[72766]:   <serial>7ce97945-fbe1-4773-b504-1b6da655becc</serial>
Aug 14 23:24:52 user nova-compute[72766]: </disk>
Aug 14 23:24:52 user nova-compute[72766]:  {{(pid=72766) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 23:24:52 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:24:52 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:24:52 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] No VIF found with MAC fa:16:3e:81:95:89, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:24:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a21d9f40-08aa-4a6f-90b8-c7657136e8e6 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "fcb57162-d1da-4ea0-aca0-80da305537d1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.872s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:24:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:24:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:24:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:25:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:25:03 user nova-compute[72766]: DEBUG nova.compute.manager [req-955faf4e-bdd9-4b09-83f2-96eca3801ecd req-0e1a1225-5a76-4925-a0df-ac4ab192df2f service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Received event network-changed-518eb684-a3b3-4886-a828-e818de5be54f {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:25:03 user nova-compute[72766]: DEBUG nova.compute.manager [req-955faf4e-bdd9-4b09-83f2-96eca3801ecd req-0e1a1225-5a76-4925-a0df-ac4ab192df2f service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Refreshing instance network info cache due to event network-changed-518eb684-a3b3-4886-a828-e818de5be54f. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:25:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-955faf4e-bdd9-4b09-83f2-96eca3801ecd req-0e1a1225-5a76-4925-a0df-ac4ab192df2f service nova] Acquiring lock "refresh_cache-fcb57162-d1da-4ea0-aca0-80da305537d1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:25:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-955faf4e-bdd9-4b09-83f2-96eca3801ecd req-0e1a1225-5a76-4925-a0df-ac4ab192df2f service nova] Acquired lock "refresh_cache-fcb57162-d1da-4ea0-aca0-80da305537d1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:25:03 user nova-compute[72766]: DEBUG nova.network.neutron [req-955faf4e-bdd9-4b09-83f2-96eca3801ecd req-0e1a1225-5a76-4925-a0df-ac4ab192df2f service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Refreshing network info cache for port 518eb684-a3b3-4886-a828-e818de5be54f {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:25:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:25:04 user nova-compute[72766]: DEBUG nova.network.neutron [req-955faf4e-bdd9-4b09-83f2-96eca3801ecd req-0e1a1225-5a76-4925-a0df-ac4ab192df2f service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Updated VIF entry in instance network info cache for port 518eb684-a3b3-4886-a828-e818de5be54f. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:25:04 user nova-compute[72766]: DEBUG nova.network.neutron [req-955faf4e-bdd9-4b09-83f2-96eca3801ecd req-0e1a1225-5a76-4925-a0df-ac4ab192df2f service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Updating instance_info_cache with network_info: [{"id": "518eb684-a3b3-4886-a828-e818de5be54f", "address": "fa:16:3e:81:95:89", "network": {"id": "c7828c64-4d71-4c57-8df8-bb4524d9b9cb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-160068070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbd47fb3d5eb408aa751d1d49f198906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518eb684-a3", "ovs_interfaceid": "518eb684-a3b3-4886-a828-e818de5be54f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:25:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-955faf4e-bdd9-4b09-83f2-96eca3801ecd req-0e1a1225-5a76-4925-a0df-ac4ab192df2f service nova] Releasing lock "refresh_cache-fcb57162-d1da-4ea0-aca0-80da305537d1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:25:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:25:05 user nova-compute[72766]: DEBUG nova.compute.manager [req-5f5cc50b-eb22-4423-885a-937873d8b756 req-03395577-be86-4899-907c-8fd700acf529 service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Received event network-changed-518eb684-a3b3-4886-a828-e818de5be54f {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:25:05 user nova-compute[72766]: DEBUG nova.compute.manager [req-5f5cc50b-eb22-4423-885a-937873d8b756 req-03395577-be86-4899-907c-8fd700acf529 service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Refreshing instance network info cache due to event network-changed-518eb684-a3b3-4886-a828-e818de5be54f. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:25:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-5f5cc50b-eb22-4423-885a-937873d8b756 req-03395577-be86-4899-907c-8fd700acf529 service nova] Acquiring lock "refresh_cache-fcb57162-d1da-4ea0-aca0-80da305537d1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:25:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-5f5cc50b-eb22-4423-885a-937873d8b756 req-03395577-be86-4899-907c-8fd700acf529 service nova] Acquired lock "refresh_cache-fcb57162-d1da-4ea0-aca0-80da305537d1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:25:05 user nova-compute[72766]: DEBUG nova.network.neutron [req-5f5cc50b-eb22-4423-885a-937873d8b756 req-03395577-be86-4899-907c-8fd700acf529 service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Refreshing network info cache for port 518eb684-a3b3-4886-a828-e818de5be54f {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:25:06 user nova-compute[72766]: DEBUG nova.network.neutron [req-5f5cc50b-eb22-4423-885a-937873d8b756 req-03395577-be86-4899-907c-8fd700acf529 service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Updated VIF entry in instance network info cache for port 518eb684-a3b3-4886-a828-e818de5be54f. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:25:06 user nova-compute[72766]: DEBUG nova.network.neutron [req-5f5cc50b-eb22-4423-885a-937873d8b756 req-03395577-be86-4899-907c-8fd700acf529 service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Updating instance_info_cache with network_info: [{"id": "518eb684-a3b3-4886-a828-e818de5be54f", "address": "fa:16:3e:81:95:89", "network": {"id": "c7828c64-4d71-4c57-8df8-bb4524d9b9cb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-160068070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbd47fb3d5eb408aa751d1d49f198906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518eb684-a3", "ovs_interfaceid": "518eb684-a3b3-4886-a828-e818de5be54f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:25:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-5f5cc50b-eb22-4423-885a-937873d8b756 req-03395577-be86-4899-907c-8fd700acf529 service nova] Releasing lock "refresh_cache-fcb57162-d1da-4ea0-aca0-80da305537d1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:25:06 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:25:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:25:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Acquiring lock "fcb57162-d1da-4ea0-aca0-80da305537d1" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:25:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "fcb57162-d1da-4ea0-aca0-80da305537d1" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:25:11 user nova-compute[72766]: INFO nova.compute.manager [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Rebooting instance
Aug 14 23:25:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Acquiring lock "refresh_cache-fcb57162-d1da-4ea0-aca0-80da305537d1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:25:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Acquired lock "refresh_cache-fcb57162-d1da-4ea0-aca0-80da305537d1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:25:11 user nova-compute[72766]: DEBUG nova.network.neutron [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:25:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:25:12 user nova-compute[72766]: DEBUG nova.network.neutron [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Updating instance_info_cache with network_info: [{"id": "518eb684-a3b3-4886-a828-e818de5be54f", "address": "fa:16:3e:81:95:89", "network": {"id": "c7828c64-4d71-4c57-8df8-bb4524d9b9cb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-160068070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbd47fb3d5eb408aa751d1d49f198906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518eb684-a3", "ovs_interfaceid": "518eb684-a3b3-4886-a828-e818de5be54f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:25:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Releasing lock "refresh_cache-fcb57162-d1da-4ea0-aca0-80da305537d1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:25:12 user nova-compute[72766]: DEBUG nova.compute.manager [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:25:12 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:25:12 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:25:12 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:25:12 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:25:12 user nova-compute[72766]: DEBUG nova.compute.manager [req-85966e94-a601-4e8b-8909-c9ee4515d13f req-9ec1cc49-5e91-405a-a27e-3c766be1af9f service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Received event network-vif-unplugged-518eb684-a3b3-4886-a828-e818de5be54f {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:25:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-85966e94-a601-4e8b-8909-c9ee4515d13f req-9ec1cc49-5e91-405a-a27e-3c766be1af9f service nova] Acquiring lock "fcb57162-d1da-4ea0-aca0-80da305537d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:25:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-85966e94-a601-4e8b-8909-c9ee4515d13f req-9ec1cc49-5e91-405a-a27e-3c766be1af9f service nova] Lock "fcb57162-d1da-4ea0-aca0-80da305537d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:25:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-85966e94-a601-4e8b-8909-c9ee4515d13f req-9ec1cc49-5e91-405a-a27e-3c766be1af9f service nova] Lock "fcb57162-d1da-4ea0-aca0-80da305537d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:25:12 user nova-compute[72766]: DEBUG nova.compute.manager [req-85966e94-a601-4e8b-8909-c9ee4515d13f req-9ec1cc49-5e91-405a-a27e-3c766be1af9f service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] No waiting events found dispatching network-vif-unplugged-518eb684-a3b3-4886-a828-e818de5be54f {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:25:12 user nova-compute[72766]: WARNING nova.compute.manager [req-85966e94-a601-4e8b-8909-c9ee4515d13f req-9ec1cc49-5e91-405a-a27e-3c766be1af9f service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Received unexpected event network-vif-unplugged-518eb684-a3b3-4886-a828-e818de5be54f for instance with vm_state active and task_state reboot_started_hard.
Aug 14 23:25:12 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:25:12 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:25:12 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:25:13 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Instance destroyed successfully.
Aug 14 23:25:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG nova.objects.instance [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lazy-loading 'resources' on Instance uuid fcb57162-d1da-4ea0-aca0-80da305537d1 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:22:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1086401159',display_name='tempest-TestMinimumBasicScenario-server-1086401159',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1086401159',id=38,image_ref='6abaf5d8-8c86-42c6-84a9-0a91e4bc711b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIT4sWowgwzBSgSQSR4/nQGYejOWmEvcMvkPagaWavJ4GtHuJlXtb9tn4Ifw16P3BWGIzuruDEdE7i2Q5+xQOQqPuO67WUM//mFBoSm7QzgYYOgilspdEBNyYzBUZBj/gg==',key_name='tempest-TestMinimumBasicScenario-1137169698',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:22:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cbd47fb3d5eb408aa751d1d49f198906',ramdisk_id='',reservation_id='r-6keiuhzz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6abaf5d8-8c86-42c6-84a9-0a91e4bc711b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1491062679',owner_user_name='tempest-TestMinimumBasicScenario-1491062679-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:25:12Z,user_data=None,user_id='a2b1f48b1a594010befb4da227f8b473',uuid=fcb57162-d1da-4ea0-aca0-80da305537d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "518eb684-a3b3-4886-a828-e818de5be54f", "address": "fa:16:3e:81:95:89", "network": {"id": "c7828c64-4d71-4c57-8df8-bb4524d9b9cb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-160068070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbd47fb3d5eb408aa751d1d49f198906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518eb684-a3", "ovs_interfaceid": "518eb684-a3b3-4886-a828-e818de5be54f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Converting VIF {"id": "518eb684-a3b3-4886-a828-e818de5be54f", "address": "fa:16:3e:81:95:89", "network": {"id": "c7828c64-4d71-4c57-8df8-bb4524d9b9cb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-160068070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbd47fb3d5eb408aa751d1d49f198906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518eb684-a3", "ovs_interfaceid": "518eb684-a3b3-4886-a828-e818de5be54f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:95:89,bridge_name='br-int',has_traffic_filtering=True,id=518eb684-a3b3-4886-a828-e818de5be54f,network=Network(c7828c64-4d71-4c57-8df8-bb4524d9b9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap518eb684-a3') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG os_vif [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:95:89,bridge_name='br-int',has_traffic_filtering=True,id=518eb684-a3b3-4886-a828-e818de5be54f,network=Network(c7828c64-4d71-4c57-8df8-bb4524d9b9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap518eb684-a3') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap518eb684-a3, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:25:13 user nova-compute[72766]: INFO os_vif [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:95:89,bridge_name='br-int',has_traffic_filtering=True,id=518eb684-a3b3-4886-a828-e818de5be54f,network=Network(c7828c64-4d71-4c57-8df8-bb4524d9b9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap518eb684-a3')
Aug 14 23:25:13 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fnJMmLAk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:25:13 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:25:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[781e70f1-c6c8-477c-bb0e-144a71e46136]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c8edb3-ad26-4ac3-9da9-de765726a2fa]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 (non-flash)
Aug 14 23:25:13 user nova-compute[72766]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae (non-flash)
Aug 14 23:25:13 user nova-compute[72766]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc (non-flash)
Aug 14 23:25:13 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 (non-flash)
Aug 14 23:25:13 user nova-compute[72766]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae (non-flash)
Aug 14 23:25:13 user nova-compute[72766]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc (non-flash)
Aug 14 23:25:13 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff16c139090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc'): ({'sdd'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Removing single pathed devices sdd {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[952fe959-9cba-41df-9720-809bb115e0de]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b5a31c-581f-4b4d-b800-a88b51d4e464]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Flushing IO for device /dev/sdd {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f286b88-f8c5-4eba-828f-6dd01d80f548]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ac9686-6321-4e25-a204-3a34aa014d75]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] SCSI volumes sdd have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[59059c3e-6c2a-4db0-9602-e879e37d6e8e]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e02bfa-1594-4439-907a-e5c4d33da89d]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc, portal: 172.16.0.220,3260]
Aug 14 23:25:13 user nova-compute[72766]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc, portal: 172.16.0.220,3260] successful.
Aug 14 23:25:13 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[0518708f-836e-49b2-89bd-ca5e07b09a5e]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] <== disconnect_volume: return (320ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Start _get_guest_xml network_info=[{"id": "518eb684-a3b3-4886-a828-e818de5be54f", "address": "fa:16:3e:81:95:89", "network": {"id": "c7828c64-4d71-4c57-8df8-bb4524d9b9cb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-160068070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbd47fb3d5eb408aa751d1d49f198906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518eb684-a3", "ovs_interfaceid": "518eb684-a3b3-4886-a828-e818de5be54f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6abaf5d8-8c86-42c6-84a9-0a91e4bc711b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '6abaf5d8-8c86-42c6-84a9-0a91e4bc711b'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '6a155acf-2390-4446-b799-7010ff31f583', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fnJMmLAk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'fcb57162-d1da-4ea0-aca0-80da305537d1', 'attached_at': '', 'detached_at': '', 'volume_id': '7ce97945-fbe1-4773-b504-1b6da655becc', 'serial': '7ce97945-fbe1-4773-b504-1b6da655becc'}, 'volume_type': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:25:13 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:25:13 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:25:13 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6abaf5d8-8c86-42c6-84a9-0a91e4bc711b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG nova.objects.instance [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lazy-loading 'vcpu_model' on Instance uuid fcb57162-d1da-4ea0-aca0-80da305537d1 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fnJMmLAk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:25:13 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:25:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:25:13 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:25:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:25:13 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4b3cd7-6746-4b81-871b-1dcc3e0d7f68]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 23:25:13 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.084s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[164e01f8-4b07-4a7e-a41a-80722a8451bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc] added
Aug 14 23:25:13 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2390bcea-a635-41d2-a9dc-0f3060f2086b]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5b5e53-762d-45f2-b792-982292ac0cd6]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fnJMmLAk {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fnJMmLAk" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8030e9-f764-4854-91ed-dcdb26ece8ae]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fnJMmLAk'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[87676a01-d838-47a4-ac22-ceba0f97018d]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48c06fc-3519-4388-92f8-3e4357275356]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 (non-flash)
Aug 14 23:25:13 user nova-compute[72766]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae (non-flash)
Aug 14 23:25:13 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 (non-flash)
Aug 14 23:25:13 user nova-compute[72766]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae (non-flash)
Aug 14 23:25:13 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef08dcec-eb3e-49fa-85e9-d77d507cd4f0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc, portal: 172.16.0.220,3260]
Aug 14 23:25:13 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc, portal: 172.16.0.220,3260] successful.
Aug 14 23:25:13 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[3346c224-e032-4ec3-96d7-c12f455239fc]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e099ba8-2c0f-4aab-914e-c6925ab01080]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 (non-flash)
Aug 14 23:25:13 user nova-compute[72766]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae (non-flash)
Aug 14 23:25:13 user nova-compute[72766]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc (non-flash)
Aug 14 23:25:13 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 (non-flash)
Aug 14 23:25:13 user nova-compute[72766]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae (non-flash)
Aug 14 23:25:13 user nova-compute[72766]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc (non-flash)
Aug 14 23:25:13 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] HCTL ('35', '-', '-', 0) found on session 51 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8aa3abb-2a1a-4e96-8544-318747eebd4b]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:25:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fnJMmLAk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 23:25:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:25:14 user nova-compute[72766]: DEBUG nova.compute.manager [req-2591b1a9-2b2c-4f2b-a7fb-8a96aa7f5f41 req-76b61295-ed5f-4bb4-a506-61b77c4d9078 service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Received event network-vif-plugged-518eb684-a3b3-4886-a828-e818de5be54f {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:25:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2591b1a9-2b2c-4f2b-a7fb-8a96aa7f5f41 req-76b61295-ed5f-4bb4-a506-61b77c4d9078 service nova] Acquiring lock "fcb57162-d1da-4ea0-aca0-80da305537d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:25:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2591b1a9-2b2c-4f2b-a7fb-8a96aa7f5f41 req-76b61295-ed5f-4bb4-a506-61b77c4d9078 service nova] Lock "fcb57162-d1da-4ea0-aca0-80da305537d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:25:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2591b1a9-2b2c-4f2b-a7fb-8a96aa7f5f41 req-76b61295-ed5f-4bb4-a506-61b77c4d9078 service nova] Lock "fcb57162-d1da-4ea0-aca0-80da305537d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:25:14 user nova-compute[72766]: DEBUG nova.compute.manager [req-2591b1a9-2b2c-4f2b-a7fb-8a96aa7f5f41 req-76b61295-ed5f-4bb4-a506-61b77c4d9078 service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] No waiting events found dispatching network-vif-plugged-518eb684-a3b3-4886-a828-e818de5be54f {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:25:14 user nova-compute[72766]: WARNING nova.compute.manager [req-2591b1a9-2b2c-4f2b-a7fb-8a96aa7f5f41 req-76b61295-ed5f-4bb4-a506-61b77c4d9078 service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Received unexpected event network-vif-plugged-518eb684-a3b3-4886-a828-e818de5be54f for instance with vm_state active and task_state reboot_started_hard.
Aug 14 23:25:14 user nova-compute[72766]: DEBUG nova.compute.manager [req-2591b1a9-2b2c-4f2b-a7fb-8a96aa7f5f41 req-76b61295-ed5f-4bb4-a506-61b77c4d9078 service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Received event network-vif-plugged-518eb684-a3b3-4886-a828-e818de5be54f {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:25:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2591b1a9-2b2c-4f2b-a7fb-8a96aa7f5f41 req-76b61295-ed5f-4bb4-a506-61b77c4d9078 service nova] Acquiring lock "fcb57162-d1da-4ea0-aca0-80da305537d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:25:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2591b1a9-2b2c-4f2b-a7fb-8a96aa7f5f41 req-76b61295-ed5f-4bb4-a506-61b77c4d9078 service nova] Lock "fcb57162-d1da-4ea0-aca0-80da305537d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:25:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2591b1a9-2b2c-4f2b-a7fb-8a96aa7f5f41 req-76b61295-ed5f-4bb4-a506-61b77c4d9078 service nova] Lock "fcb57162-d1da-4ea0-aca0-80da305537d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:25:14 user nova-compute[72766]: DEBUG nova.compute.manager [req-2591b1a9-2b2c-4f2b-a7fb-8a96aa7f5f41 req-76b61295-ed5f-4bb4-a506-61b77c4d9078 service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] No waiting events found dispatching network-vif-plugged-518eb684-a3b3-4886-a828-e818de5be54f {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:25:14 user nova-compute[72766]: WARNING nova.compute.manager [req-2591b1a9-2b2c-4f2b-a7fb-8a96aa7f5f41 req-76b61295-ed5f-4bb4-a506-61b77c4d9078 service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Received unexpected event network-vif-plugged-518eb684-a3b3-4886-a828-e818de5be54f for instance with vm_state active and task_state reboot_started_hard.
Aug 14 23:25:14 user nova-compute[72766]: DEBUG nova.compute.manager [req-2591b1a9-2b2c-4f2b-a7fb-8a96aa7f5f41 req-76b61295-ed5f-4bb4-a506-61b77c4d9078 service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Received event network-vif-plugged-518eb684-a3b3-4886-a828-e818de5be54f {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:25:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2591b1a9-2b2c-4f2b-a7fb-8a96aa7f5f41 req-76b61295-ed5f-4bb4-a506-61b77c4d9078 service nova] Acquiring lock "fcb57162-d1da-4ea0-aca0-80da305537d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:25:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2591b1a9-2b2c-4f2b-a7fb-8a96aa7f5f41 req-76b61295-ed5f-4bb4-a506-61b77c4d9078 service nova] Lock "fcb57162-d1da-4ea0-aca0-80da305537d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:25:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2591b1a9-2b2c-4f2b-a7fb-8a96aa7f5f41 req-76b61295-ed5f-4bb4-a506-61b77c4d9078 service nova] Lock "fcb57162-d1da-4ea0-aca0-80da305537d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:25:14 user nova-compute[72766]: DEBUG nova.compute.manager [req-2591b1a9-2b2c-4f2b-a7fb-8a96aa7f5f41 req-76b61295-ed5f-4bb4-a506-61b77c4d9078 service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] No waiting events found dispatching network-vif-plugged-518eb684-a3b3-4886-a828-e818de5be54f {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:25:14 user nova-compute[72766]: WARNING nova.compute.manager [req-2591b1a9-2b2c-4f2b-a7fb-8a96aa7f5f41 req-76b61295-ed5f-4bb4-a506-61b77c4d9078 service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Received unexpected event network-vif-plugged-518eb684-a3b3-4886-a828-e818de5be54f for instance with vm_state active and task_state reboot_started_hard.
Aug 14 23:25:14 user nova-compute[72766]: DEBUG nova.compute.manager [req-2591b1a9-2b2c-4f2b-a7fb-8a96aa7f5f41 req-76b61295-ed5f-4bb4-a506-61b77c4d9078 service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Received event network-vif-unplugged-518eb684-a3b3-4886-a828-e818de5be54f {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:25:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2591b1a9-2b2c-4f2b-a7fb-8a96aa7f5f41 req-76b61295-ed5f-4bb4-a506-61b77c4d9078 service nova] Acquiring lock "fcb57162-d1da-4ea0-aca0-80da305537d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:25:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2591b1a9-2b2c-4f2b-a7fb-8a96aa7f5f41 req-76b61295-ed5f-4bb4-a506-61b77c4d9078 service nova] Lock "fcb57162-d1da-4ea0-aca0-80da305537d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:25:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2591b1a9-2b2c-4f2b-a7fb-8a96aa7f5f41 req-76b61295-ed5f-4bb4-a506-61b77c4d9078 service nova] Lock "fcb57162-d1da-4ea0-aca0-80da305537d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:25:14 user nova-compute[72766]: DEBUG nova.compute.manager [req-2591b1a9-2b2c-4f2b-a7fb-8a96aa7f5f41 req-76b61295-ed5f-4bb4-a506-61b77c4d9078 service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] No waiting events found dispatching network-vif-unplugged-518eb684-a3b3-4886-a828-e818de5be54f {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:25:14 user nova-compute[72766]: WARNING nova.compute.manager [req-2591b1a9-2b2c-4f2b-a7fb-8a96aa7f5f41 req-76b61295-ed5f-4bb4-a506-61b77c4d9078 service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Received unexpected event network-vif-unplugged-518eb684-a3b3-4886-a828-e818de5be54f for instance with vm_state active and task_state reboot_started_hard.
Aug 14 23:25:14 user nova-compute[72766]: DEBUG nova.compute.manager [req-2591b1a9-2b2c-4f2b-a7fb-8a96aa7f5f41 req-76b61295-ed5f-4bb4-a506-61b77c4d9078 service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Received event network-vif-plugged-518eb684-a3b3-4886-a828-e818de5be54f {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:25:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2591b1a9-2b2c-4f2b-a7fb-8a96aa7f5f41 req-76b61295-ed5f-4bb4-a506-61b77c4d9078 service nova] Acquiring lock "fcb57162-d1da-4ea0-aca0-80da305537d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:25:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2591b1a9-2b2c-4f2b-a7fb-8a96aa7f5f41 req-76b61295-ed5f-4bb4-a506-61b77c4d9078 service nova] Lock "fcb57162-d1da-4ea0-aca0-80da305537d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:25:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2591b1a9-2b2c-4f2b-a7fb-8a96aa7f5f41 req-76b61295-ed5f-4bb4-a506-61b77c4d9078 service nova] Lock "fcb57162-d1da-4ea0-aca0-80da305537d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:25:14 user nova-compute[72766]: DEBUG nova.compute.manager [req-2591b1a9-2b2c-4f2b-a7fb-8a96aa7f5f41 req-76b61295-ed5f-4bb4-a506-61b77c4d9078 service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] No waiting events found dispatching network-vif-plugged-518eb684-a3b3-4886-a828-e818de5be54f {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:25:14 user nova-compute[72766]: WARNING nova.compute.manager [req-2591b1a9-2b2c-4f2b-a7fb-8a96aa7f5f41 req-76b61295-ed5f-4bb4-a506-61b77c4d9078 service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Received unexpected event network-vif-plugged-518eb684-a3b3-4886-a828-e818de5be54f for instance with vm_state active and task_state reboot_started_hard.
Aug 14 23:25:14 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:25:14 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '23334336438333636', 'path': '/dev/sdd'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:25:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334336438333636', 'path': '/dev/sdd'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 23:25:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:22:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1086401159',display_name='tempest-TestMinimumBasicScenario-server-1086401159',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1086401159',id=38,image_ref='6abaf5d8-8c86-42c6-84a9-0a91e4bc711b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIT4sWowgwzBSgSQSR4/nQGYejOWmEvcMvkPagaWavJ4GtHuJlXtb9tn4Ifw16P3BWGIzuruDEdE7i2Q5+xQOQqPuO67WUM//mFBoSm7QzgYYOgilspdEBNyYzBUZBj/gg==',key_name='tempest-TestMinimumBasicScenario-1137169698',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:22:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cbd47fb3d5eb408aa751d1d49f198906',ramdisk_id='',reservation_id='r-6keiuhzz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6abaf5d8-8c86-42c6-84a9-0a91e4bc711b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1491062679',owner_user_name='tempest-TestMinimumBasicScenario-1491062679-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:25:12Z,user_data=None,user_id='a2b1f48b1a594010befb4da227f8b473',uuid=fcb57162-d1da-4ea0-aca0-80da305537d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "518eb684-a3b3-4886-a828-e818de5be54f", "address": "fa:16:3e:81:95:89", "network": {"id": "c7828c64-4d71-4c57-8df8-bb4524d9b9cb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-160068070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbd47fb3d5eb408aa751d1d49f198906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518eb684-a3", "ovs_interfaceid": "518eb684-a3b3-4886-a828-e818de5be54f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:25:14 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Converting VIF {"id": "518eb684-a3b3-4886-a828-e818de5be54f", "address": "fa:16:3e:81:95:89", "network": {"id": "c7828c64-4d71-4c57-8df8-bb4524d9b9cb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-160068070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbd47fb3d5eb408aa751d1d49f198906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518eb684-a3", "ovs_interfaceid": "518eb684-a3b3-4886-a828-e818de5be54f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:25:14 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:95:89,bridge_name='br-int',has_traffic_filtering=True,id=518eb684-a3b3-4886-a828-e818de5be54f,network=Network(c7828c64-4d71-4c57-8df8-bb4524d9b9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap518eb684-a3') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:25:14 user nova-compute[72766]: DEBUG nova.objects.instance [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lazy-loading 'pci_devices' on Instance uuid fcb57162-d1da-4ea0-aca0-80da305537d1 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:25:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:25:14 user nova-compute[72766]:   <uuid>fcb57162-d1da-4ea0-aca0-80da305537d1</uuid>
Aug 14 23:25:14 user nova-compute[72766]:   <name>instance-00000026</name>
Aug 14 23:25:14 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:25:14 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:25:14 user nova-compute[72766]:   <metadata>
Aug 14 23:25:14 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:25:14 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:25:14 user nova-compute[72766]:       <nova:name>tempest-TestMinimumBasicScenario-server-1086401159</nova:name>
Aug 14 23:25:14 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:25:13</nova:creationTime>
Aug 14 23:25:14 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:25:14 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:25:14 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:25:14 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:25:14 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:25:14 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:25:14 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:25:14 user nova-compute[72766]:       <nova:owner>
Aug 14 23:25:14 user nova-compute[72766]:         <nova:user uuid="a2b1f48b1a594010befb4da227f8b473">tempest-TestMinimumBasicScenario-1491062679-project-member</nova:user>
Aug 14 23:25:14 user nova-compute[72766]:         <nova:project uuid="cbd47fb3d5eb408aa751d1d49f198906">tempest-TestMinimumBasicScenario-1491062679</nova:project>
Aug 14 23:25:14 user nova-compute[72766]:       </nova:owner>
Aug 14 23:25:14 user nova-compute[72766]:       <nova:root type="image" uuid="6abaf5d8-8c86-42c6-84a9-0a91e4bc711b"/>
Aug 14 23:25:14 user nova-compute[72766]:       <nova:ports>
Aug 14 23:25:14 user nova-compute[72766]:         <nova:port uuid="518eb684-a3b3-4886-a828-e818de5be54f">
Aug 14 23:25:14 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 14 23:25:14 user nova-compute[72766]:         </nova:port>
Aug 14 23:25:14 user nova-compute[72766]:       </nova:ports>
Aug 14 23:25:14 user nova-compute[72766]:     </nova:instance>
Aug 14 23:25:14 user nova-compute[72766]:   </metadata>
Aug 14 23:25:14 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:25:14 user nova-compute[72766]:     <system>
Aug 14 23:25:14 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:25:14 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:25:14 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:25:14 user nova-compute[72766]:       <entry name="serial">fcb57162-d1da-4ea0-aca0-80da305537d1</entry>
Aug 14 23:25:14 user nova-compute[72766]:       <entry name="uuid">fcb57162-d1da-4ea0-aca0-80da305537d1</entry>
Aug 14 23:25:14 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:25:14 user nova-compute[72766]:     </system>
Aug 14 23:25:14 user nova-compute[72766]:   </sysinfo>
Aug 14 23:25:14 user nova-compute[72766]:   <os>
Aug 14 23:25:14 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:25:14 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:25:14 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:25:14 user nova-compute[72766]:   </os>
Aug 14 23:25:14 user nova-compute[72766]:   <features>
Aug 14 23:25:14 user nova-compute[72766]:     <acpi/>
Aug 14 23:25:14 user nova-compute[72766]:     <apic/>
Aug 14 23:25:14 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:25:14 user nova-compute[72766]:   </features>
Aug 14 23:25:14 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:25:14 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:25:14 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:25:14 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:25:14 user nova-compute[72766]:   </clock>
Aug 14 23:25:14 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:25:14 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:25:14 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:25:14 user nova-compute[72766]:   </cpu>
Aug 14 23:25:14 user nova-compute[72766]:   <devices>
Aug 14 23:25:14 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 23:25:14 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 23:25:14 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/fcb57162-d1da-4ea0-aca0-80da305537d1/disk"/>
Aug 14 23:25:14 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:25:14 user nova-compute[72766]:     </disk>
Aug 14 23:25:14 user nova-compute[72766]:     <disk type="block" device="disk">
Aug 14 23:25:14 user nova-compute[72766]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:25:14 user nova-compute[72766]:       <source dev="/dev/sdd"/>
Aug 14 23:25:14 user nova-compute[72766]:       <target dev="vdb" bus="virtio"/>
Aug 14 23:25:14 user nova-compute[72766]:       <serial>7ce97945-fbe1-4773-b504-1b6da655becc</serial>
Aug 14 23:25:14 user nova-compute[72766]:     </disk>
Aug 14 23:25:14 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:25:14 user nova-compute[72766]:       <mac address="fa:16:3e:81:95:89"/>
Aug 14 23:25:14 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:25:14 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:25:14 user nova-compute[72766]:       <target dev="tap518eb684-a3"/>
Aug 14 23:25:14 user nova-compute[72766]:     </interface>
Aug 14 23:25:14 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:25:14 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/fcb57162-d1da-4ea0-aca0-80da305537d1/console.log" append="off"/>
Aug 14 23:25:14 user nova-compute[72766]:     </serial>
Aug 14 23:25:14 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:25:14 user nova-compute[72766]:     <video>
Aug 14 23:25:14 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:25:14 user nova-compute[72766]:     </video>
Aug 14 23:25:14 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:25:14 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:25:14 user nova-compute[72766]:     </rng>
Aug 14 23:25:14 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:25:14 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:25:14 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:25:14 user nova-compute[72766]:     </memballoon>
Aug 14 23:25:14 user nova-compute[72766]:   </devices>
Aug 14 23:25:14 user nova-compute[72766]: </domain>
Aug 14 23:25:14 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:25:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb57162-d1da-4ea0-aca0-80da305537d1/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:25:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb57162-d1da-4ea0-aca0-80da305537d1/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:25:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb57162-d1da-4ea0-aca0-80da305537d1/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:25:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb57162-d1da-4ea0-aca0-80da305537d1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:25:15 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:25:15 user nova-compute[72766]: DEBUG nova.objects.instance [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lazy-loading 'trusted_certs' on Instance uuid fcb57162-d1da-4ea0-aca0-80da305537d1 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:25:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e5b3c8e9d2b0fe4ba9930f88be028915bfe298f --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:25:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e5b3c8e9d2b0fe4ba9930f88be028915bfe298f --force-share --output=json" returned: 0 in 0.182s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:25:15 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fcb57162-d1da-4ea0-aca0-80da305537d1/disk. size=1073741824 {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 23:25:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb57162-d1da-4ea0-aca0-80da305537d1/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:25:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb57162-d1da-4ea0-aca0-80da305537d1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:25:15 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Cannot resize image /opt/stack/data/nova/instances/fcb57162-d1da-4ea0-aca0-80da305537d1/disk to a smaller size. {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 23:25:15 user nova-compute[72766]: DEBUG nova.objects.instance [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lazy-loading 'migration_context' on Instance uuid fcb57162-d1da-4ea0-aca0-80da305537d1 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:25:15 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:22:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1086401159',display_name='tempest-TestMinimumBasicScenario-server-1086401159',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1086401159',id=38,image_ref='6abaf5d8-8c86-42c6-84a9-0a91e4bc711b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIT4sWowgwzBSgSQSR4/nQGYejOWmEvcMvkPagaWavJ4GtHuJlXtb9tn4Ifw16P3BWGIzuruDEdE7i2Q5+xQOQqPuO67WUM//mFBoSm7QzgYYOgilspdEBNyYzBUZBj/gg==',key_name='tempest-TestMinimumBasicScenario-1137169698',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:22:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='cbd47fb3d5eb408aa751d1d49f198906',ramdisk_id='',reservation_id='r-6keiuhzz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6abaf5d8-8c86-42c6-84a9-0a91e4bc711b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1491062679',owner_user_name='tempest-TestMinimumBasicScenario-1491062679-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:25:12Z,user_data=None,user_id='a2b1f48b1a594010befb4da227f8b473',uuid=fcb57162-d1da-4ea0-aca0-80da305537d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "518eb684-a3b3-4886-a828-e818de5be54f", "address": "fa:16:3e:81:95:89", "network": {"id": "c7828c64-4d71-4c57-8df8-bb4524d9b9cb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-160068070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbd47fb3d5eb408aa751d1d49f198906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518eb684-a3", "ovs_interfaceid": "518eb684-a3b3-4886-a828-e818de5be54f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:25:15 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Converting VIF {"id": "518eb684-a3b3-4886-a828-e818de5be54f", "address": "fa:16:3e:81:95:89", "network": {"id": "c7828c64-4d71-4c57-8df8-bb4524d9b9cb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-160068070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbd47fb3d5eb408aa751d1d49f198906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518eb684-a3", "ovs_interfaceid": "518eb684-a3b3-4886-a828-e818de5be54f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:25:15 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:95:89,bridge_name='br-int',has_traffic_filtering=True,id=518eb684-a3b3-4886-a828-e818de5be54f,network=Network(c7828c64-4d71-4c57-8df8-bb4524d9b9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap518eb684-a3') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:25:15 user nova-compute[72766]: DEBUG os_vif [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:95:89,bridge_name='br-int',has_traffic_filtering=True,id=518eb684-a3b3-4886-a828-e818de5be54f,network=Network(c7828c64-4d71-4c57-8df8-bb4524d9b9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap518eb684-a3') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:25:15 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:25:15 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:25:15 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:25:15 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:25:15 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap518eb684-a3, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:25:15 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap518eb684-a3, col_values=(('external_ids', {'iface-id': '518eb684-a3b3-4886-a828-e818de5be54f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:95:89', 'vm-uuid': 'fcb57162-d1da-4ea0-aca0-80da305537d1'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:25:15 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:25:15 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:25:15 user nova-compute[72766]: INFO os_vif [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:95:89,bridge_name='br-int',has_traffic_filtering=True,id=518eb684-a3b3-4886-a828-e818de5be54f,network=Network(c7828c64-4d71-4c57-8df8-bb4524d9b9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap518eb684-a3')
Aug 14 23:25:17 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:25:17 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:25:17 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:25:17 user nova-compute[72766]: DEBUG nova.compute.manager [req-886ab206-6c0a-4ac9-97fb-2b53b24ca3ac req-96f4c9e2-5522-4af5-a7e2-47933534c0bb service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Received event network-vif-plugged-518eb684-a3b3-4886-a828-e818de5be54f {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:25:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-886ab206-6c0a-4ac9-97fb-2b53b24ca3ac req-96f4c9e2-5522-4af5-a7e2-47933534c0bb service nova] Acquiring lock "fcb57162-d1da-4ea0-aca0-80da305537d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:25:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-886ab206-6c0a-4ac9-97fb-2b53b24ca3ac req-96f4c9e2-5522-4af5-a7e2-47933534c0bb service nova] Lock "fcb57162-d1da-4ea0-aca0-80da305537d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:25:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-886ab206-6c0a-4ac9-97fb-2b53b24ca3ac req-96f4c9e2-5522-4af5-a7e2-47933534c0bb service nova] Lock "fcb57162-d1da-4ea0-aca0-80da305537d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:25:17 user nova-compute[72766]: DEBUG nova.compute.manager [req-886ab206-6c0a-4ac9-97fb-2b53b24ca3ac req-96f4c9e2-5522-4af5-a7e2-47933534c0bb service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] No waiting events found dispatching network-vif-plugged-518eb684-a3b3-4886-a828-e818de5be54f {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:25:17 user nova-compute[72766]: WARNING nova.compute.manager [req-886ab206-6c0a-4ac9-97fb-2b53b24ca3ac req-96f4c9e2-5522-4af5-a7e2-47933534c0bb service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Received unexpected event network-vif-plugged-518eb684-a3b3-4886-a828-e818de5be54f for instance with vm_state active and task_state reboot_started_hard.
Aug 14 23:25:17 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:25:17 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:25:17 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:25:19 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Removed pending event for fcb57162-d1da-4ea0-aca0-80da305537d1 due to event {{(pid=72766) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 23:25:19 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692055519.1214411, fcb57162-d1da-4ea0-aca0-80da305537d1 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:25:19 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] VM Resumed (Lifecycle Event)
Aug 14 23:25:19 user nova-compute[72766]: DEBUG nova.compute.manager [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:25:19 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Instance rebooted successfully.
Aug 14 23:25:19 user nova-compute[72766]: DEBUG nova.compute.manager [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:25:19 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:25:19 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:25:19 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 14 23:25:19 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692055519.1229792, fcb57162-d1da-4ea0-aca0-80da305537d1 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:25:19 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] VM Started (Lifecycle Event)
Aug 14 23:25:19 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:25:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-65744f7f-9c1b-4b37-aeba-90130d546472 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "fcb57162-d1da-4ea0-aca0-80da305537d1" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.573s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:25:19 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:25:19 user nova-compute[72766]: DEBUG nova.compute.manager [req-18b0d449-3ae3-4be0-b852-19541a29a198 req-7c22f004-db50-4363-8eaa-1c7b37963932 service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Received event network-vif-plugged-518eb684-a3b3-4886-a828-e818de5be54f {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:25:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-18b0d449-3ae3-4be0-b852-19541a29a198 req-7c22f004-db50-4363-8eaa-1c7b37963932 service nova] Acquiring lock "fcb57162-d1da-4ea0-aca0-80da305537d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:25:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-18b0d449-3ae3-4be0-b852-19541a29a198 req-7c22f004-db50-4363-8eaa-1c7b37963932 service nova] Lock "fcb57162-d1da-4ea0-aca0-80da305537d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:25:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-18b0d449-3ae3-4be0-b852-19541a29a198 req-7c22f004-db50-4363-8eaa-1c7b37963932 service nova] Lock "fcb57162-d1da-4ea0-aca0-80da305537d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:25:19 user nova-compute[72766]: DEBUG nova.compute.manager [req-18b0d449-3ae3-4be0-b852-19541a29a198 req-7c22f004-db50-4363-8eaa-1c7b37963932 service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] No waiting events found dispatching network-vif-plugged-518eb684-a3b3-4886-a828-e818de5be54f {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:25:19 user nova-compute[72766]: WARNING nova.compute.manager [req-18b0d449-3ae3-4be0-b852-19541a29a198 req-7c22f004-db50-4363-8eaa-1c7b37963932 service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Received unexpected event network-vif-plugged-518eb684-a3b3-4886-a828-e818de5be54f for instance with vm_state active and task_state None.
Aug 14 23:25:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:25:20 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:25:25 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:25:30 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:25:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:25:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:25:37 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:25:39 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:25:39 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:25:39 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:25:39 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:25:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-22fcbe70-f8b6-4a57-ac95-296bac414544" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:25:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-22fcbe70-f8b6-4a57-ac95-296bac414544" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:25:39 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:25:40 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Updating instance_info_cache with network_info: [{"id": "f6796bc3-3d20-4f6b-83ef-0d97754ecf19", "address": "fa:16:3e:df:bc:df", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6796bc3-3d", "ovs_interfaceid": "f6796bc3-3d20-4f6b-83ef-0d97754ecf19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:25:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-22fcbe70-f8b6-4a57-ac95-296bac414544" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:25:40 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:25:40 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:25:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:25:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:25:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:25:40 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:25:40 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:25:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb57162-d1da-4ea0-aca0-80da305537d1/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:25:41 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb57162-d1da-4ea0-aca0-80da305537d1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:25:41 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb57162-d1da-4ea0-aca0-80da305537d1/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:25:41 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb57162-d1da-4ea0-aca0-80da305537d1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:25:41 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:25:41 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:25:41 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:25:41 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:25:41 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:25:41 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:25:41 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:25:41 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:25:41 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:25:41 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:25:41 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:25:42 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:25:42 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:25:42 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=8153MB free_disk=25.271587371826172GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:25:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:25:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:25:42 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance cbcf7851-e6f7-4f46-97cc-d773286ccddf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:25:42 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 22fcbe70-f8b6-4a57-ac95-296bac414544 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:25:42 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance fcb57162-d1da-4ea0-aca0-80da305537d1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:25:42 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:25:42 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance b86c4ecf-c169-464e-ad4d-5a6ead88adf5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:25:42 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:25:42 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:25:42 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:25:42 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:25:42 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:25:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.311s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:25:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:25:45 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:25:45 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:25:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:25:46 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:25:48 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:25:48 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:25:48 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:25:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:25:49 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:25:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:25:55 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:26:00 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:26:05 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:26:07 user nova-compute[72766]: DEBUG nova.compute.manager [req-e642e023-b544-4d3b-9485-bac93f5a6321 req-ada75604-a4f4-4637-aabe-01e3117dcb67 service nova] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Received event network-changed-751d95bb-6ad7-4767-b4f6-21d9767002f4 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:26:07 user nova-compute[72766]: DEBUG nova.compute.manager [req-e642e023-b544-4d3b-9485-bac93f5a6321 req-ada75604-a4f4-4637-aabe-01e3117dcb67 service nova] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Refreshing instance network info cache due to event network-changed-751d95bb-6ad7-4767-b4f6-21d9767002f4. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:26:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e642e023-b544-4d3b-9485-bac93f5a6321 req-ada75604-a4f4-4637-aabe-01e3117dcb67 service nova] Acquiring lock "refresh_cache-49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:26:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e642e023-b544-4d3b-9485-bac93f5a6321 req-ada75604-a4f4-4637-aabe-01e3117dcb67 service nova] Acquired lock "refresh_cache-49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:26:07 user nova-compute[72766]: DEBUG nova.network.neutron [req-e642e023-b544-4d3b-9485-bac93f5a6321 req-ada75604-a4f4-4637-aabe-01e3117dcb67 service nova] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Refreshing network info cache for port 751d95bb-6ad7-4767-b4f6-21d9767002f4 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:26:08 user nova-compute[72766]: DEBUG nova.network.neutron [req-e642e023-b544-4d3b-9485-bac93f5a6321 req-ada75604-a4f4-4637-aabe-01e3117dcb67 service nova] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Updated VIF entry in instance network info cache for port 751d95bb-6ad7-4767-b4f6-21d9767002f4. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:26:08 user nova-compute[72766]: DEBUG nova.network.neutron [req-e642e023-b544-4d3b-9485-bac93f5a6321 req-ada75604-a4f4-4637-aabe-01e3117dcb67 service nova] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Updating instance_info_cache with network_info: [{"id": "751d95bb-6ad7-4767-b4f6-21d9767002f4", "address": "fa:16:3e:32:4a:65", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap751d95bb-6a", "ovs_interfaceid": "751d95bb-6ad7-4767-b4f6-21d9767002f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:26:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-e642e023-b544-4d3b-9485-bac93f5a6321 req-ada75604-a4f4-4637-aabe-01e3117dcb67 service nova] Releasing lock "refresh_cache-49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:26:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:26:10 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:26:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:26:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:26:11 user nova-compute[72766]: DEBUG nova.objects.instance [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lazy-loading 'flavor' on Instance uuid 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:26:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:26:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:26:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:26:11 user nova-compute[72766]: INFO nova.compute.manager [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Attaching volume a63dfb3a-0a60-4987-bbba-c16192b41d65 to /dev/vdb
Aug 14 23:26:11 user nova-compute[72766]: DEBUG os_brick.utils [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:26:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:26:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:26:11 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[00832d6f-d97d-48e1-b987-d50fa9991cd8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:26:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:26:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:26:11 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[78617fcb-c71a-442f-a463-e6e46924b5ff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:26:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:26:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:26:11 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[456c6a3b-4227-4558-84a6-1299cfd8e7e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:26:11 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea6e54f-151e-4bed-ae4c-ce005b143d8f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:26:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:26:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:26:11 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 23:26:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:26:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:26:11 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 23:26:11 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fe3956-c95f-4de5-bcf7-eac75ae62280]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:26:11 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 23:26:11 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 23:26:11 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 23:26:11 user nova-compute[72766]: DEBUG os_brick.utils [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:26:11 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Updating existing volume attachment record: 536db186-b724-4fdd-a500-e0af0c90f3a5 {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 23:26:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:26:15 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:26:15 user nova-compute[72766]: DEBUG nova.compute.manager [req-68426542-4d64-46d4-9051-58555735cbd9 req-7d3b82cb-833b-4cf3-a95b-bcc79356e3f6 service nova] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Received event network-changed-01270e8f-0ff7-464d-9a4d-c86efbb0f7a3 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:26:15 user nova-compute[72766]: DEBUG nova.compute.manager [req-68426542-4d64-46d4-9051-58555735cbd9 req-7d3b82cb-833b-4cf3-a95b-bcc79356e3f6 service nova] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Refreshing instance network info cache due to event network-changed-01270e8f-0ff7-464d-9a4d-c86efbb0f7a3. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:26:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-68426542-4d64-46d4-9051-58555735cbd9 req-7d3b82cb-833b-4cf3-a95b-bcc79356e3f6 service nova] Acquiring lock "refresh_cache-b86c4ecf-c169-464e-ad4d-5a6ead88adf5" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:26:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-68426542-4d64-46d4-9051-58555735cbd9 req-7d3b82cb-833b-4cf3-a95b-bcc79356e3f6 service nova] Acquired lock "refresh_cache-b86c4ecf-c169-464e-ad4d-5a6ead88adf5" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:26:15 user nova-compute[72766]: DEBUG nova.network.neutron [req-68426542-4d64-46d4-9051-58555735cbd9 req-7d3b82cb-833b-4cf3-a95b-bcc79356e3f6 service nova] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Refreshing network info cache for port 01270e8f-0ff7-464d-9a4d-c86efbb0f7a3 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:26:16 user nova-compute[72766]: DEBUG nova.network.neutron [req-68426542-4d64-46d4-9051-58555735cbd9 req-7d3b82cb-833b-4cf3-a95b-bcc79356e3f6 service nova] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Updated VIF entry in instance network info cache for port 01270e8f-0ff7-464d-9a4d-c86efbb0f7a3. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:26:16 user nova-compute[72766]: DEBUG nova.network.neutron [req-68426542-4d64-46d4-9051-58555735cbd9 req-7d3b82cb-833b-4cf3-a95b-bcc79356e3f6 service nova] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Updating instance_info_cache with network_info: [{"id": "01270e8f-0ff7-464d-9a4d-c86efbb0f7a3", "address": "fa:16:3e:ba:08:50", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01270e8f-0f", "ovs_interfaceid": "01270e8f-0ff7-464d-9a4d-c86efbb0f7a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:26:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-68426542-4d64-46d4-9051-58555735cbd9 req-7d3b82cb-833b-4cf3-a95b-bcc79356e3f6 service nova] Releasing lock "refresh_cache-b86c4ecf-c169-464e-ad4d-5a6ead88adf5" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:26:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "b86c4ecf-c169-464e-ad4d-5a6ead88adf5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:26:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "b86c4ecf-c169-464e-ad4d-5a6ead88adf5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:26:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "b86c4ecf-c169-464e-ad4d-5a6ead88adf5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:26:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "b86c4ecf-c169-464e-ad4d-5a6ead88adf5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:26:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "b86c4ecf-c169-464e-ad4d-5a6ead88adf5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:26:16 user nova-compute[72766]: INFO nova.compute.manager [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Terminating instance
Aug 14 23:26:16 user nova-compute[72766]: DEBUG nova.compute.manager [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:26:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:26:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:26:16 user nova-compute[72766]: DEBUG nova.compute.manager [req-3883b917-1fc7-4f15-bda4-dca84b93f872 req-07841f9d-2b0e-456a-914f-408015c1573c service nova] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Received event network-vif-unplugged-01270e8f-0ff7-464d-9a4d-c86efbb0f7a3 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:26:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-3883b917-1fc7-4f15-bda4-dca84b93f872 req-07841f9d-2b0e-456a-914f-408015c1573c service nova] Acquiring lock "b86c4ecf-c169-464e-ad4d-5a6ead88adf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:26:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-3883b917-1fc7-4f15-bda4-dca84b93f872 req-07841f9d-2b0e-456a-914f-408015c1573c service nova] Lock "b86c4ecf-c169-464e-ad4d-5a6ead88adf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:26:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-3883b917-1fc7-4f15-bda4-dca84b93f872 req-07841f9d-2b0e-456a-914f-408015c1573c service nova] Lock "b86c4ecf-c169-464e-ad4d-5a6ead88adf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:26:16 user nova-compute[72766]: DEBUG nova.compute.manager [req-3883b917-1fc7-4f15-bda4-dca84b93f872 req-07841f9d-2b0e-456a-914f-408015c1573c service nova] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] No waiting events found dispatching network-vif-unplugged-01270e8f-0ff7-464d-9a4d-c86efbb0f7a3 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:26:16 user nova-compute[72766]: DEBUG nova.compute.manager [req-3883b917-1fc7-4f15-bda4-dca84b93f872 req-07841f9d-2b0e-456a-914f-408015c1573c service nova] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Received event network-vif-unplugged-01270e8f-0ff7-464d-9a4d-c86efbb0f7a3 for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:26:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:26:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:26:17 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Instance destroyed successfully.
Aug 14 23:26:17 user nova-compute[72766]: DEBUG nova.objects.instance [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lazy-loading 'resources' on Instance uuid b86c4ecf-c169-464e-ad4d-5a6ead88adf5 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:24:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1074514974',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1074514974',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1074514974',id=40,image_ref='fd5e2e55-f6ec-4c41-8b00-b233b6128c4c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFCxo1GwGB/CPzufzEw0qqOU/yRYLoCh4NmFt0hmPPmKpX0fdF/HiP4TKa66FcuLasjrTtYsnNYCAAvZdDRk6VxLM5yuhkoxxoReF7LuhI8a43McBqSIat3gJ9JumXtWQ==',key_name='tempest-keypair-1351044208',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:24:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3c9f53727cc497c94516ff7fa1bbf4f',ramdisk_id='',reservation_id='r-hwpzcs9m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-213280496',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-213280496-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-213280496',owner_user_name='tempest-TestVolumeBootPattern-213280496-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:24:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='999390ac8e6240199c9a7484e234f3a7',uuid=b86c4ecf-c169-464e-ad4d-5a6ead88adf5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01270e8f-0ff7-464d-9a4d-c86efbb0f7a3", "address": "fa:16:3e:ba:08:50", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01270e8f-0f", "ovs_interfaceid": "01270e8f-0ff7-464d-9a4d-c86efbb0f7a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Converting VIF {"id": "01270e8f-0ff7-464d-9a4d-c86efbb0f7a3", "address": "fa:16:3e:ba:08:50", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01270e8f-0f", "ovs_interfaceid": "01270e8f-0ff7-464d-9a4d-c86efbb0f7a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:08:50,bridge_name='br-int',has_traffic_filtering=True,id=01270e8f-0ff7-464d-9a4d-c86efbb0f7a3,network=Network(f418a384-bbac-4892-8e0f-c7af2e9464ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01270e8f-0f') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG os_vif [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:08:50,bridge_name='br-int',has_traffic_filtering=True,id=01270e8f-0ff7-464d-9a4d-c86efbb0f7a3,network=Network(f418a384-bbac-4892-8e0f-c7af2e9464ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01270e8f-0f') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01270e8f-0f, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:26:17 user nova-compute[72766]: INFO os_vif [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:08:50,bridge_name='br-int',has_traffic_filtering=True,id=01270e8f-0ff7-464d-9a4d-c86efbb0f7a3,network=Network(f418a384-bbac-4892-8e0f-c7af2e9464ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01270e8f-0f')
Aug 14 23:26:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QywMBPgv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:26:17 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:26:17 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93f3c28-022c-481f-ba72-3992df7c6f25]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfb9076-67e1-437b-a641-5d8913bbd2da]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 (non-flash)
Aug 14 23:26:17 user nova-compute[72766]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae (non-flash)
Aug 14 23:26:17 user nova-compute[72766]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc (non-flash)
Aug 14 23:26:17 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 (non-flash)
Aug 14 23:26:17 user nova-compute[72766]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae (non-flash)
Aug 14 23:26:17 user nova-compute[72766]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc (non-flash)
Aug 14 23:26:17 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff1543dea70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae'): ({'sdc'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Removing single pathed devices sdc {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ed8231-baa6-4a79-935f-deb2311d556e]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[19aba1f3-24cf-4bd2-8dc9-d2f11cdb4b2e]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Flushing IO for device /dev/sdc {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1aa1233-d761-423e-9e96-25de04498454]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae01fa8-c08e-4df0-a63d-f05e0663cde3]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] SCSI volumes sdc have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23764303065643966', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_44cf7206', '/dev/disk/by-id/scsi-1SCST_BIO44cf7206-7d00ed9f524dca10') {{(pid=83651) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9e719c-ad7e-4419-8daa-56ad682e454c]: (4, None) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[55239db9-9dcc-4a5c-8c73-f06671373fa4]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[98930123-0771-4ce4-8d0b-28598600bb9e]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae, portal: 172.16.0.220,3260]
Aug 14 23:26:17 user nova-compute[72766]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae, portal: 172.16.0.220,3260] successful.
Aug 14 23:26:17 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad29ffe-72ad-4d22-924a-b897ec8bfd29]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] <== disconnect_volume: return (289ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:26:17 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Deleting instance files /opt/stack/data/nova/instances/b86c4ecf-c169-464e-ad4d-5a6ead88adf5_del
Aug 14 23:26:17 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Deletion of /opt/stack/data/nova/instances/b86c4ecf-c169-464e-ad4d-5a6ead88adf5_del complete
Aug 14 23:26:17 user nova-compute[72766]: INFO nova.compute.manager [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 14 23:26:17 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:26:17 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:26:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:26:18 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:26:18 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Took 0.79 seconds to deallocate network for instance.
Aug 14 23:26:18 user nova-compute[72766]: DEBUG nova.compute.manager [req-7c20e9e7-9ca7-4b8a-85b9-ed3f002540a3 req-7bb93748-f62b-4063-ac1b-67525a190d8f service nova] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Received event network-vif-plugged-01270e8f-0ff7-464d-9a4d-c86efbb0f7a3 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:26:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7c20e9e7-9ca7-4b8a-85b9-ed3f002540a3 req-7bb93748-f62b-4063-ac1b-67525a190d8f service nova] Acquiring lock "b86c4ecf-c169-464e-ad4d-5a6ead88adf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:26:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7c20e9e7-9ca7-4b8a-85b9-ed3f002540a3 req-7bb93748-f62b-4063-ac1b-67525a190d8f service nova] Lock "b86c4ecf-c169-464e-ad4d-5a6ead88adf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:26:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7c20e9e7-9ca7-4b8a-85b9-ed3f002540a3 req-7bb93748-f62b-4063-ac1b-67525a190d8f service nova] Lock "b86c4ecf-c169-464e-ad4d-5a6ead88adf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:26:18 user nova-compute[72766]: DEBUG nova.compute.manager [req-7c20e9e7-9ca7-4b8a-85b9-ed3f002540a3 req-7bb93748-f62b-4063-ac1b-67525a190d8f service nova] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] No waiting events found dispatching network-vif-plugged-01270e8f-0ff7-464d-9a4d-c86efbb0f7a3 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:26:18 user nova-compute[72766]: WARNING nova.compute.manager [req-7c20e9e7-9ca7-4b8a-85b9-ed3f002540a3 req-7bb93748-f62b-4063-ac1b-67525a190d8f service nova] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Received unexpected event network-vif-plugged-01270e8f-0ff7-464d-9a4d-c86efbb0f7a3 for instance with vm_state active and task_state deleting.
Aug 14 23:26:18 user nova-compute[72766]: DEBUG nova.compute.manager [req-7c20e9e7-9ca7-4b8a-85b9-ed3f002540a3 req-7bb93748-f62b-4063-ac1b-67525a190d8f service nova] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Received event network-vif-deleted-01270e8f-0ff7-464d-9a4d-c86efbb0f7a3 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:26:19 user nova-compute[72766]: INFO nova.compute.manager [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Took 0.74 seconds to detach 1 volumes for instance.
Aug 14 23:26:19 user nova-compute[72766]: DEBUG nova.compute.manager [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Deleting volume: 7bc8d00c-ca94-49c8-ad2f-f77e1feda9ae {{(pid=72766) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 23:26:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:26:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:26:19 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:26:19 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:26:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:26:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.249s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:26:19 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Deleted allocations for instance b86c4ecf-c169-464e-ad4d-5a6ead88adf5
Aug 14 23:26:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-56254a97-57f4-4a8f-a70c-20f820869630 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "b86c4ecf-c169-464e-ad4d-5a6ead88adf5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.200s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:26:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:26:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jvFsZtcK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:26:26 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:26:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:26:26 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:26:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:26:26 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 23:26:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65 -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fbf031-a970-4658-ad0b-a33737e7d786]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 23:26:26 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65 -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ed7e79-f1b1-4019-a079-90e68fc64421]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65] added
Aug 14 23:26:26 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea86ee2e-9a8c-4422-9bf9-6241fa876eb4]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bcb444-7c42-465b-a9fb-d2604b87865d]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jvFsZtcK {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jvFsZtcK" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ab536a-162d-41e5-a135-7833030896f2]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jvFsZtcK'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c077cff9-c9e7-465c-86de-2761ea98feb7]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb4830a-68a7-40cd-afcc-bdb385f2376d]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 (non-flash)
Aug 14 23:26:26 user nova-compute[72766]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc (non-flash)
Aug 14 23:26:26 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 (non-flash)
Aug 14 23:26:26 user nova-compute[72766]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc (non-flash)
Aug 14 23:26:26 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65 -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6414ef-c450-4ead-8793-3594afe8ad59]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65, portal: 172.16.0.220,3260]
Aug 14 23:26:26 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65, portal: 172.16.0.220,3260] successful.
Aug 14 23:26:26 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0790c1-1d12-4800-9db6-8932788e7c9c]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98a21d2-0a07-45e5-939c-47913610a05b]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 (non-flash)
Aug 14 23:26:26 user nova-compute[72766]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc (non-flash)
Aug 14 23:26:26 user nova-compute[72766]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65 (non-flash)
Aug 14 23:26:26 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 (non-flash)
Aug 14 23:26:26 user nova-compute[72766]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc (non-flash)
Aug 14 23:26:26 user nova-compute[72766]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65 (non-flash)
Aug 14 23:26:26 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6f1227-b5ea-4de3-ba5d-a96d8ea066e6]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:26:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jvFsZtcK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 23:26:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:26:27 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:26:27 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '26162643061653631', 'path': '/dev/sdc'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:26:27 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162643061653631', 'path': '/dev/sdc'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 23:26:27 user nova-compute[72766]: DEBUG nova.objects.instance [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lazy-loading 'flavor' on Instance uuid 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:26:27 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 23:26:27 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:26:27 user nova-compute[72766]:   <source dev="/dev/sdc"/>
Aug 14 23:26:27 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:26:27 user nova-compute[72766]:   <serial>a63dfb3a-0a60-4987-bbba-c16192b41d65</serial>
Aug 14 23:26:27 user nova-compute[72766]: </disk>
Aug 14 23:26:27 user nova-compute[72766]:  {{(pid=72766) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 23:26:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:26:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:26:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] No VIF found with MAC fa:16:3e:32:4a:65, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:26:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-487784e1-c234-4979-9283-80c26714c67e tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.858s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:26:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a29082b7-d488-4fd5-9763-a689ca6c4793 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:26:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a29082b7-d488-4fd5-9763-a689ca6c4793 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:26:29 user nova-compute[72766]: INFO nova.compute.manager [None req-a29082b7-d488-4fd5-9763-a689ca6c4793 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Detaching volume a63dfb3a-0a60-4987-bbba-c16192b41d65
Aug 14 23:26:29 user nova-compute[72766]: INFO nova.virt.block_device [None req-a29082b7-d488-4fd5-9763-a689ca6c4793 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Attempting to driver detach volume a63dfb3a-0a60-4987-bbba-c16192b41d65 from mountpoint /dev/vdb
Aug 14 23:26:29 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a29082b7-d488-4fd5-9763-a689ca6c4793 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Attempting to detach device vdb from instance 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a from the persistent domain config. {{(pid=72766) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 23:26:29 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-a29082b7-d488-4fd5-9763-a689ca6c4793 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 23:26:29 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:26:29 user nova-compute[72766]:   <source dev="/dev/sdc"/>
Aug 14 23:26:29 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:26:29 user nova-compute[72766]:   <serial>a63dfb3a-0a60-4987-bbba-c16192b41d65</serial>
Aug 14 23:26:29 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 23:26:29 user nova-compute[72766]: </disk>
Aug 14 23:26:29 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 23:26:29 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-a29082b7-d488-4fd5-9763-a689ca6c4793 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Successfully detached device vdb from instance 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a from the persistent domain config.
Aug 14 23:26:29 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a29082b7-d488-4fd5-9763-a689ca6c4793 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a from the live domain config. {{(pid=72766) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 23:26:29 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-a29082b7-d488-4fd5-9763-a689ca6c4793 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 23:26:29 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:26:29 user nova-compute[72766]:   <source dev="/dev/sdc"/>
Aug 14 23:26:29 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:26:29 user nova-compute[72766]:   <serial>a63dfb3a-0a60-4987-bbba-c16192b41d65</serial>
Aug 14 23:26:29 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 23:26:29 user nova-compute[72766]: </disk>
Aug 14 23:26:29 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 23:26:29 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Received event <DeviceRemovedEvent: 1692055589.7068312, 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72766) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 23:26:29 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-a29082b7-d488-4fd5-9763-a689ca6c4793 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a {{(pid=72766) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 23:26:29 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-a29082b7-d488-4fd5-9763-a689ca6c4793 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Successfully detached device vdb from instance 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a from the live domain config.
Aug 14 23:26:29 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a29082b7-d488-4fd5-9763-a689ca6c4793 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:26:29 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29082b7-d488-4fd5-9763-a689ca6c4793 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jvFsZtcK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:26:29 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-a29082b7-d488-4fd5-9763-a689ca6c4793 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:26:29 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-a29082b7-d488-4fd5-9763-a689ca6c4793 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:26:29 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-a29082b7-d488-4fd5-9763-a689ca6c4793 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:26:29 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29082b7-d488-4fd5-9763-a689ca6c4793 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:26:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:26:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:26:29 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[627e20a9-29eb-4511-866e-69b86fc5c8d1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:26:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:26:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:26:29 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[57cbb2de-4e36-47e4-8741-fc9e54fda6a8]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:26:29 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29082b7-d488-4fd5-9763-a689ca6c4793 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 (non-flash)
Aug 14 23:26:29 user nova-compute[72766]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc (non-flash)
Aug 14 23:26:29 user nova-compute[72766]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65 (non-flash)
Aug 14 23:26:29 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:26:29 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29082b7-d488-4fd5-9763-a689ca6c4793 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 (non-flash)
Aug 14 23:26:29 user nova-compute[72766]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc (non-flash)
Aug 14 23:26:29 user nova-compute[72766]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65 (non-flash)
Aug 14 23:26:29 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:26:29 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29082b7-d488-4fd5-9763-a689ca6c4793 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff154468310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65'): ({'sdc'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:26:29 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-a29082b7-d488-4fd5-9763-a689ca6c4793 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Removing single pathed devices sdc {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:26:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:26:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:26:29 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62fdb3c-f324-4a0e-87db-02b97a673563]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:26:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:26:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:26:29 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc87d32-6e67-4065-bfec-d7ab602f66dd]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:26:29 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-a29082b7-d488-4fd5-9763-a689ca6c4793 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Flushing IO for device /dev/sdc {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:26:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:26:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:26:29 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f78d4d-7d4a-4f25-9382-a72d584386c7]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:26:29 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-a29082b7-d488-4fd5-9763-a689ca6c4793 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:26:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:26:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:26:29 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[976e7ef3-1d80-45ec-83cb-38b62927761f]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:26:29 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-a29082b7-d488-4fd5-9763-a689ca6c4793 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:26:29 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-a29082b7-d488-4fd5-9763-a689ca6c4793 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] SCSI volumes sdc have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:26:29 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29082b7-d488-4fd5-9763-a689ca6c4793 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:26:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:26:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:26:29 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddacbc59-2959-499b-825e-1a0e4bfd09e9]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:26:29 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29082b7-d488-4fd5-9763-a689ca6c4793 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:26:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65 -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:26:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:26:29 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ff0ca6-ce40-43f1-9d12-651513e2f006]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:26:29 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29082b7-d488-4fd5-9763-a689ca6c4793 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65, portal: 172.16.0.220,3260]
Aug 14 23:26:29 user nova-compute[72766]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65, portal: 172.16.0.220,3260] successful.
Aug 14 23:26:29 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:26:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65 -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:26:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a63dfb3a-0a60-4987-bbba-c16192b41d65 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:26:30 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1e3588-cafe-4acd-afab-436581667c55]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:26:30 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29082b7-d488-4fd5-9763-a689ca6c4793 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:26:30 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-a29082b7-d488-4fd5-9763-a689ca6c4793 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:26:30 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29082b7-d488-4fd5-9763-a689ca6c4793 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] <== disconnect_volume: return (290ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:26:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a29082b7-d488-4fd5-9763-a689ca6c4793 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:26:30 user nova-compute[72766]: DEBUG nova.objects.instance [None req-a29082b7-d488-4fd5-9763-a689ca6c4793 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lazy-loading 'flavor' on Instance uuid 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:26:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a29082b7-d488-4fd5-9763-a689ca6c4793 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.704s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:26:32 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692055577.186601, b86c4ecf-c169-464e-ad4d-5a6ead88adf5 => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:26:32 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] VM Stopped (Lifecycle Event)
Aug 14 23:26:32 user nova-compute[72766]: DEBUG nova.compute.manager [None req-4b45fb8c-f3f1-4248-bc29-9b295b6dd5bc None None] [instance: b86c4ecf-c169-464e-ad4d-5a6ead88adf5] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:26:32 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:26:37 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:26:37 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:26:39 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:26:39 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:26:39 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:26:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-fcb57162-d1da-4ea0-aca0-80da305537d1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:26:39 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-fcb57162-d1da-4ea0-aca0-80da305537d1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:26:39 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:26:40 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Updating instance_info_cache with network_info: [{"id": "518eb684-a3b3-4886-a828-e818de5be54f", "address": "fa:16:3e:81:95:89", "network": {"id": "c7828c64-4d71-4c57-8df8-bb4524d9b9cb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-160068070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbd47fb3d5eb408aa751d1d49f198906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518eb684-a3", "ovs_interfaceid": "518eb684-a3b3-4886-a828-e818de5be54f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:26:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-fcb57162-d1da-4ea0-aca0-80da305537d1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:26:40 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:26:40 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:26:40 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:26:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:26:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:26:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:26:40 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:26:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb57162-d1da-4ea0-aca0-80da305537d1/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:26:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb57162-d1da-4ea0-aca0-80da305537d1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:26:40 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb57162-d1da-4ea0-aca0-80da305537d1/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:26:41 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb57162-d1da-4ea0-aca0-80da305537d1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:26:41 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:26:41 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:26:41 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:26:41 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:26:41 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:26:41 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:26:41 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:26:41 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:26:41 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:26:41 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:26:42 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:26:42 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:26:42 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:26:42 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=8327MB free_disk=25.26192855834961GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:26:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:26:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:26:42 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance cbcf7851-e6f7-4f46-97cc-d773286ccddf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:26:42 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 22fcbe70-f8b6-4a57-ac95-296bac414544 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:26:42 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance fcb57162-d1da-4ea0-aca0-80da305537d1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:26:42 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:26:42 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:26:42 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:26:42 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Refreshing inventories for resource provider 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 23:26:42 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Updating ProviderTree inventory for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 23:26:42 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Updating inventory in ProviderTree for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 23:26:42 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Refreshing aggregate associations for resource provider 45c8ff08-bf31-4ab6-8452-2e293102f899, aggregates: None {{(pid=72766) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 23:26:42 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Refreshing trait associations for resource provider 45c8ff08-bf31-4ab6-8452-2e293102f899, traits: COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=72766) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 23:26:42 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:26:42 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:26:42 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:26:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.409s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:26:45 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:26:45 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:26:47 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:26:47 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:26:48 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:26:50 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:26:50 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:26:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:26:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:26:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:26:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:26:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:26:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:26:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:27:01 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:27:02 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:27:03 user nova-compute[72766]: DEBUG nova.compute.manager [req-91e0ff15-740a-4d0b-afd1-67c27e395048 req-2028279f-f62e-48de-a061-a7df7018650f service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Received event network-changed-518eb684-a3b3-4886-a828-e818de5be54f {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:27:03 user nova-compute[72766]: DEBUG nova.compute.manager [req-91e0ff15-740a-4d0b-afd1-67c27e395048 req-2028279f-f62e-48de-a061-a7df7018650f service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Refreshing instance network info cache due to event network-changed-518eb684-a3b3-4886-a828-e818de5be54f. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:27:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-91e0ff15-740a-4d0b-afd1-67c27e395048 req-2028279f-f62e-48de-a061-a7df7018650f service nova] Acquiring lock "refresh_cache-fcb57162-d1da-4ea0-aca0-80da305537d1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:27:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-91e0ff15-740a-4d0b-afd1-67c27e395048 req-2028279f-f62e-48de-a061-a7df7018650f service nova] Acquired lock "refresh_cache-fcb57162-d1da-4ea0-aca0-80da305537d1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:27:03 user nova-compute[72766]: DEBUG nova.network.neutron [req-91e0ff15-740a-4d0b-afd1-67c27e395048 req-2028279f-f62e-48de-a061-a7df7018650f service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Refreshing network info cache for port 518eb684-a3b3-4886-a828-e818de5be54f {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:27:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:27:04 user nova-compute[72766]: DEBUG nova.network.neutron [req-91e0ff15-740a-4d0b-afd1-67c27e395048 req-2028279f-f62e-48de-a061-a7df7018650f service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Updated VIF entry in instance network info cache for port 518eb684-a3b3-4886-a828-e818de5be54f. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:27:04 user nova-compute[72766]: DEBUG nova.network.neutron [req-91e0ff15-740a-4d0b-afd1-67c27e395048 req-2028279f-f62e-48de-a061-a7df7018650f service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Updating instance_info_cache with network_info: [{"id": "518eb684-a3b3-4886-a828-e818de5be54f", "address": "fa:16:3e:81:95:89", "network": {"id": "c7828c64-4d71-4c57-8df8-bb4524d9b9cb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-160068070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbd47fb3d5eb408aa751d1d49f198906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518eb684-a3", "ovs_interfaceid": "518eb684-a3b3-4886-a828-e818de5be54f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:27:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-91e0ff15-740a-4d0b-afd1-67c27e395048 req-2028279f-f62e-48de-a061-a7df7018650f service nova] Releasing lock "refresh_cache-fcb57162-d1da-4ea0-aca0-80da305537d1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:27:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:27:04 user nova-compute[72766]: DEBUG nova.compute.manager [req-f42bc2d4-281b-4af3-874e-ea63bfa4c843 req-add692bc-7a54-4a52-9bb3-a703922cbd4d service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Received event network-changed-518eb684-a3b3-4886-a828-e818de5be54f {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:27:04 user nova-compute[72766]: DEBUG nova.compute.manager [req-f42bc2d4-281b-4af3-874e-ea63bfa4c843 req-add692bc-7a54-4a52-9bb3-a703922cbd4d service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Refreshing instance network info cache due to event network-changed-518eb684-a3b3-4886-a828-e818de5be54f. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:27:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f42bc2d4-281b-4af3-874e-ea63bfa4c843 req-add692bc-7a54-4a52-9bb3-a703922cbd4d service nova] Acquiring lock "refresh_cache-fcb57162-d1da-4ea0-aca0-80da305537d1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:27:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f42bc2d4-281b-4af3-874e-ea63bfa4c843 req-add692bc-7a54-4a52-9bb3-a703922cbd4d service nova] Acquired lock "refresh_cache-fcb57162-d1da-4ea0-aca0-80da305537d1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:27:04 user nova-compute[72766]: DEBUG nova.network.neutron [req-f42bc2d4-281b-4af3-874e-ea63bfa4c843 req-add692bc-7a54-4a52-9bb3-a703922cbd4d service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Refreshing network info cache for port 518eb684-a3b3-4886-a828-e818de5be54f {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:27:04 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:27:04 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72766) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 23:27:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-2e225caf-e5d2-47ed-aad5-04981a71a46a tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Acquiring lock "fcb57162-d1da-4ea0-aca0-80da305537d1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:27:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-2e225caf-e5d2-47ed-aad5-04981a71a46a tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "fcb57162-d1da-4ea0-aca0-80da305537d1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:27:04 user nova-compute[72766]: INFO nova.compute.manager [None req-2e225caf-e5d2-47ed-aad5-04981a71a46a tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Detaching volume 7ce97945-fbe1-4773-b504-1b6da655becc
Aug 14 23:27:04 user nova-compute[72766]: INFO nova.virt.block_device [None req-2e225caf-e5d2-47ed-aad5-04981a71a46a tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Attempting to driver detach volume 7ce97945-fbe1-4773-b504-1b6da655becc from mountpoint /dev/vdb
Aug 14 23:27:04 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-2e225caf-e5d2-47ed-aad5-04981a71a46a tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Attempting to detach device vdb from instance fcb57162-d1da-4ea0-aca0-80da305537d1 from the persistent domain config. {{(pid=72766) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 23:27:04 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-2e225caf-e5d2-47ed-aad5-04981a71a46a tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 23:27:04 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:27:04 user nova-compute[72766]:   <source dev="/dev/sdd"/>
Aug 14 23:27:04 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:27:04 user nova-compute[72766]:   <serial>7ce97945-fbe1-4773-b504-1b6da655becc</serial>
Aug 14 23:27:04 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 23:27:04 user nova-compute[72766]: </disk>
Aug 14 23:27:04 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 23:27:04 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-2e225caf-e5d2-47ed-aad5-04981a71a46a tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Successfully detached device vdb from instance fcb57162-d1da-4ea0-aca0-80da305537d1 from the persistent domain config.
Aug 14 23:27:04 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-2e225caf-e5d2-47ed-aad5-04981a71a46a tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fcb57162-d1da-4ea0-aca0-80da305537d1 from the live domain config. {{(pid=72766) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 23:27:04 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-2e225caf-e5d2-47ed-aad5-04981a71a46a tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 23:27:04 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:27:04 user nova-compute[72766]:   <source dev="/dev/sdd"/>
Aug 14 23:27:04 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:27:04 user nova-compute[72766]:   <serial>7ce97945-fbe1-4773-b504-1b6da655becc</serial>
Aug 14 23:27:04 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 23:27:04 user nova-compute[72766]: </disk>
Aug 14 23:27:04 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG nova.network.neutron [req-f42bc2d4-281b-4af3-874e-ea63bfa4c843 req-add692bc-7a54-4a52-9bb3-a703922cbd4d service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Updated VIF entry in instance network info cache for port 518eb684-a3b3-4886-a828-e818de5be54f. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG nova.network.neutron [req-f42bc2d4-281b-4af3-874e-ea63bfa4c843 req-add692bc-7a54-4a52-9bb3-a703922cbd4d service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Updating instance_info_cache with network_info: [{"id": "518eb684-a3b3-4886-a828-e818de5be54f", "address": "fa:16:3e:81:95:89", "network": {"id": "c7828c64-4d71-4c57-8df8-bb4524d9b9cb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-160068070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbd47fb3d5eb408aa751d1d49f198906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518eb684-a3", "ovs_interfaceid": "518eb684-a3b3-4886-a828-e818de5be54f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f42bc2d4-281b-4af3-874e-ea63bfa4c843 req-add692bc-7a54-4a52-9bb3-a703922cbd4d service nova] Releasing lock "refresh_cache-fcb57162-d1da-4ea0-aca0-80da305537d1" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Received event <DeviceRemovedEvent: 1692055625.3005276, fcb57162-d1da-4ea0-aca0-80da305537d1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72766) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-2e225caf-e5d2-47ed-aad5-04981a71a46a tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fcb57162-d1da-4ea0-aca0-80da305537d1 {{(pid=72766) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 23:27:05 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-2e225caf-e5d2-47ed-aad5-04981a71a46a tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Successfully detached device vdb from instance fcb57162-d1da-4ea0-aca0-80da305537d1 from the live domain config.
Aug 14 23:27:05 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e225caf-e5d2-47ed-aad5-04981a71a46a tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e225caf-e5d2-47ed-aad5-04981a71a46a tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fnJMmLAk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:27:05 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-2e225caf-e5d2-47ed-aad5-04981a71a46a tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:27:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-2e225caf-e5d2-47ed-aad5-04981a71a46a tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-2e225caf-e5d2-47ed-aad5-04981a71a46a tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e225caf-e5d2-47ed-aad5-04981a71a46a tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c96894c-97a2-4d8d-b118-44436bb9d51e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6a9ece-2a9b-45fd-a8bc-85e8cc33a50b]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e225caf-e5d2-47ed-aad5-04981a71a46a tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 (non-flash)
Aug 14 23:27:05 user nova-compute[72766]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc (non-flash)
Aug 14 23:27:05 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e225caf-e5d2-47ed-aad5-04981a71a46a tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 (non-flash)
Aug 14 23:27:05 user nova-compute[72766]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc (non-flash)
Aug 14 23:27:05 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e225caf-e5d2-47ed-aad5-04981a71a46a tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff1543de4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc'): ({'sdd'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-2e225caf-e5d2-47ed-aad5-04981a71a46a tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Removing single pathed devices sdd {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d85e71-fb32-4f54-aaee-553f12cd8119]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[beca0941-1040-4d2f-ae7c-7cb72fbdb3b1]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-2e225caf-e5d2-47ed-aad5-04981a71a46a tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Flushing IO for device /dev/sdd {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc747a6-1e31-43ea-8f0a-e151c4a1c08c]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-2e225caf-e5d2-47ed-aad5-04981a71a46a tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7989f5-18c1-4b24-b71b-73b2e986f333]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-2e225caf-e5d2-47ed-aad5-04981a71a46a tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-2e225caf-e5d2-47ed-aad5-04981a71a46a tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] SCSI volumes sdd have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e225caf-e5d2-47ed-aad5-04981a71a46a tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[593bc783-865a-49a2-b382-95aad5a53a77]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e225caf-e5d2-47ed-aad5-04981a71a46a tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c129e66b-4ab4-4686-ac79-2748002cbed5]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e225caf-e5d2-47ed-aad5-04981a71a46a tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc, portal: 172.16.0.220,3260]
Aug 14 23:27:05 user nova-compute[72766]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc, portal: 172.16.0.220,3260] successful.
Aug 14 23:27:05 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ce97945-fbe1-4773-b504-1b6da655becc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[335ac66f-9610-4e56-b850-0cf45d2793e2]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e225caf-e5d2-47ed-aad5-04981a71a46a tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-2e225caf-e5d2-47ed-aad5-04981a71a46a tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e225caf-e5d2-47ed-aad5-04981a71a46a tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] <== disconnect_volume: return (327ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e225caf-e5d2-47ed-aad5-04981a71a46a tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Cleaning up deleted instances {{(pid=72766) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 23:27:05 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] There are 0 instances to clean {{(pid=72766) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 23:27:06 user nova-compute[72766]: DEBUG nova.objects.instance [None req-2e225caf-e5d2-47ed-aad5-04981a71a46a tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lazy-loading 'flavor' on Instance uuid fcb57162-d1da-4ea0-aca0-80da305537d1 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:27:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-2e225caf-e5d2-47ed-aad5-04981a71a46a tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "fcb57162-d1da-4ea0-aca0-80da305537d1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.748s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:27:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:27:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "22fcbe70-f8b6-4a57-ac95-296bac414544" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:27:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "22fcbe70-f8b6-4a57-ac95-296bac414544" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:27:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "22fcbe70-f8b6-4a57-ac95-296bac414544-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:27:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "22fcbe70-f8b6-4a57-ac95-296bac414544-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:27:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "22fcbe70-f8b6-4a57-ac95-296bac414544-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:27:12 user nova-compute[72766]: INFO nova.compute.manager [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Terminating instance
Aug 14 23:27:12 user nova-compute[72766]: DEBUG nova.compute.manager [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:27:12 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:27:12 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:27:12 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:27:12 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:27:12 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:27:12 user nova-compute[72766]: DEBUG nova.compute.manager [req-21b8695e-e06f-491f-ab18-5e7bee7464cf req-aad5115d-13c2-4c3a-96d1-3a6566b37118 service nova] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Received event network-vif-unplugged-f6796bc3-3d20-4f6b-83ef-0d97754ecf19 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:27:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-21b8695e-e06f-491f-ab18-5e7bee7464cf req-aad5115d-13c2-4c3a-96d1-3a6566b37118 service nova] Acquiring lock "22fcbe70-f8b6-4a57-ac95-296bac414544-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:27:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-21b8695e-e06f-491f-ab18-5e7bee7464cf req-aad5115d-13c2-4c3a-96d1-3a6566b37118 service nova] Lock "22fcbe70-f8b6-4a57-ac95-296bac414544-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:27:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-21b8695e-e06f-491f-ab18-5e7bee7464cf req-aad5115d-13c2-4c3a-96d1-3a6566b37118 service nova] Lock "22fcbe70-f8b6-4a57-ac95-296bac414544-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:27:12 user nova-compute[72766]: DEBUG nova.compute.manager [req-21b8695e-e06f-491f-ab18-5e7bee7464cf req-aad5115d-13c2-4c3a-96d1-3a6566b37118 service nova] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] No waiting events found dispatching network-vif-unplugged-f6796bc3-3d20-4f6b-83ef-0d97754ecf19 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:27:12 user nova-compute[72766]: DEBUG nova.compute.manager [req-21b8695e-e06f-491f-ab18-5e7bee7464cf req-aad5115d-13c2-4c3a-96d1-3a6566b37118 service nova] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Received event network-vif-unplugged-f6796bc3-3d20-4f6b-83ef-0d97754ecf19 for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:27:13 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Instance destroyed successfully.
Aug 14 23:27:13 user nova-compute[72766]: DEBUG nova.objects.instance [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lazy-loading 'resources' on Instance uuid 22fcbe70-f8b6-4a57-ac95-296bac414544 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1099009683',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1099009683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1099009683',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPye+2Lkj7XI2Sw5lb8HB2S2ms8nUjn12L0XLLa6cQPHM5Xy1PdUZAf/NOq0XGO/67dPSmAfJNYFAyPRBYWICQxy9theS1S/+A6k5WEL9ray+YmGK23j/6koQDPdB87Xw==',key_name='tempest-keypair-1244970270',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:22:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3c9f53727cc497c94516ff7fa1bbf4f',ramdisk_id='',reservation_id='r-0mzzblil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-213280496',owner_user_name='tempest-TestVolumeBootPattern-213280496-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:22:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='999390ac8e6240199c9a7484e234f3a7',uuid=22fcbe70-f8b6-4a57-ac95-296bac414544,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6796bc3-3d20-4f6b-83ef-0d97754ecf19", "address": "fa:16:3e:df:bc:df", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6796bc3-3d", "ovs_interfaceid": "f6796bc3-3d20-4f6b-83ef-0d97754ecf19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Converting VIF {"id": "f6796bc3-3d20-4f6b-83ef-0d97754ecf19", "address": "fa:16:3e:df:bc:df", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6796bc3-3d", "ovs_interfaceid": "f6796bc3-3d20-4f6b-83ef-0d97754ecf19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:bc:df,bridge_name='br-int',has_traffic_filtering=True,id=f6796bc3-3d20-4f6b-83ef-0d97754ecf19,network=Network(f418a384-bbac-4892-8e0f-c7af2e9464ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6796bc3-3d') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG os_vif [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:bc:df,bridge_name='br-int',has_traffic_filtering=True,id=f6796bc3-3d20-4f6b-83ef-0d97754ecf19,network=Network(f418a384-bbac-4892-8e0f-c7af2e9464ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6796bc3-3d') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf6796bc3-3d, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:27:13 user nova-compute[72766]: INFO os_vif [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:bc:df,bridge_name='br-int',has_traffic_filtering=True,id=f6796bc3-3d20-4f6b-83ef-0d97754ecf19,network=Network(f418a384-bbac-4892-8e0f-c7af2e9464ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6796bc3-3d')
Aug 14 23:27:13 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vAMENZSR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:27:13 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:27:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ca1a1c-0475-4a76-9094-4ae80e9825f5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b5688f-c38c-43bf-abe7-7321cb72e3e3]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 (non-flash)
Aug 14 23:27:13 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 (non-flash)
Aug 14 23:27:13 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff15434bd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9'): ({'sdb'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Removing single pathed devices sdb {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fb482f-9acc-4e29-bd2b-95cb066a9431]: (4, ('path checker states:\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[969cf1c6-2a08-4f2e-b16d-c321dba8f276]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Flushing IO for device /dev/sdb {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc09556d-874a-48a7-a372-00dc44a72465]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b2930c-4fe6-4c08-8faa-292b25693a65]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] SCSI volumes sdb have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_99cf0598', '/dev/disk/by-id/scsi-1SCST_BIO99cf0598-fc0a72c348b35490', '/dev/disk/by-id/scsi-26663306137326333') {{(pid=83651) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5f59c6-bbb3-4b0e-96d7-9e653b629286]: (4, None) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b574c53-6a24-4e9f-a9ca-1710eb18e3f4]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b36789-239b-4540-a045-b25b5078df00]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9, portal: 172.16.0.220,3260]
Aug 14 23:27:13 user nova-compute[72766]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9, portal: 172.16.0.220,3260] successful.
Aug 14 23:27:13 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d5442fe-5df3-46b0-9419-1403d2ddffe9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2c2415-3198-4374-873e-20903db21dac]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] <== disconnect_volume: return (270ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:27:13 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Deleting instance files /opt/stack/data/nova/instances/22fcbe70-f8b6-4a57-ac95-296bac414544_del
Aug 14 23:27:13 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Deletion of /opt/stack/data/nova/instances/22fcbe70-f8b6-4a57-ac95-296bac414544_del complete
Aug 14 23:27:13 user nova-compute[72766]: INFO nova.compute.manager [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 14 23:27:13 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:27:13 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:27:14 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:27:14 user nova-compute[72766]: DEBUG nova.compute.manager [req-8c84e62e-8e15-4fbd-8161-4091a92384ff req-ac3e80c2-fbec-4e6d-9189-98a7855ff71a service nova] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Received event network-vif-deleted-f6796bc3-3d20-4f6b-83ef-0d97754ecf19 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:27:14 user nova-compute[72766]: INFO nova.compute.manager [req-8c84e62e-8e15-4fbd-8161-4091a92384ff req-ac3e80c2-fbec-4e6d-9189-98a7855ff71a service nova] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Neutron deleted interface f6796bc3-3d20-4f6b-83ef-0d97754ecf19; detaching it from the instance and deleting it from the info cache
Aug 14 23:27:14 user nova-compute[72766]: DEBUG nova.network.neutron [req-8c84e62e-8e15-4fbd-8161-4091a92384ff req-ac3e80c2-fbec-4e6d-9189-98a7855ff71a service nova] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:27:14 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Took 0.86 seconds to deallocate network for instance.
Aug 14 23:27:14 user nova-compute[72766]: DEBUG nova.compute.manager [req-8c84e62e-8e15-4fbd-8161-4091a92384ff req-ac3e80c2-fbec-4e6d-9189-98a7855ff71a service nova] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Detach interface failed, port_id=f6796bc3-3d20-4f6b-83ef-0d97754ecf19, reason: Instance 22fcbe70-f8b6-4a57-ac95-296bac414544 could not be found. {{(pid=72766) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 23:27:14 user nova-compute[72766]: DEBUG nova.compute.manager [req-474988ea-1898-4925-b7d3-358e137f0f01 req-47b4b836-c23f-4242-b10d-234d198beec2 service nova] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Received event network-vif-plugged-f6796bc3-3d20-4f6b-83ef-0d97754ecf19 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:27:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-474988ea-1898-4925-b7d3-358e137f0f01 req-47b4b836-c23f-4242-b10d-234d198beec2 service nova] Acquiring lock "22fcbe70-f8b6-4a57-ac95-296bac414544-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:27:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-474988ea-1898-4925-b7d3-358e137f0f01 req-47b4b836-c23f-4242-b10d-234d198beec2 service nova] Lock "22fcbe70-f8b6-4a57-ac95-296bac414544-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:27:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-474988ea-1898-4925-b7d3-358e137f0f01 req-47b4b836-c23f-4242-b10d-234d198beec2 service nova] Lock "22fcbe70-f8b6-4a57-ac95-296bac414544-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:27:14 user nova-compute[72766]: DEBUG nova.compute.manager [req-474988ea-1898-4925-b7d3-358e137f0f01 req-47b4b836-c23f-4242-b10d-234d198beec2 service nova] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] No waiting events found dispatching network-vif-plugged-f6796bc3-3d20-4f6b-83ef-0d97754ecf19 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:27:14 user nova-compute[72766]: WARNING nova.compute.manager [req-474988ea-1898-4925-b7d3-358e137f0f01 req-47b4b836-c23f-4242-b10d-234d198beec2 service nova] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Received unexpected event network-vif-plugged-f6796bc3-3d20-4f6b-83ef-0d97754ecf19 for instance with vm_state active and task_state deleting.
Aug 14 23:27:15 user nova-compute[72766]: INFO nova.compute.manager [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Took 0.73 seconds to detach 1 volumes for instance.
Aug 14 23:27:15 user nova-compute[72766]: DEBUG nova.compute.manager [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Deleting volume: 0d5442fe-5df3-46b0-9419-1403d2ddffe9 {{(pid=72766) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 23:27:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:27:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:27:15 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:27:15 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:27:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.191s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:27:15 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Deleted allocations for instance 22fcbe70-f8b6-4a57-ac95-296bac414544
Aug 14 23:27:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-43b24638-66db-4ca5-b73a-83fab45018c3 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "22fcbe70-f8b6-4a57-ac95-296bac414544" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.173s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:27:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:27:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cd4d287e-9f81-4312-8015-f10d17b045bd tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:27:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cd4d287e-9f81-4312-8015-f10d17b045bd tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:27:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cd4d287e-9f81-4312-8015-f10d17b045bd tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:27:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cd4d287e-9f81-4312-8015-f10d17b045bd tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:27:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cd4d287e-9f81-4312-8015-f10d17b045bd tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:27:19 user nova-compute[72766]: INFO nova.compute.manager [None req-cd4d287e-9f81-4312-8015-f10d17b045bd tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Terminating instance
Aug 14 23:27:19 user nova-compute[72766]: DEBUG nova.compute.manager [None req-cd4d287e-9f81-4312-8015-f10d17b045bd tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:27:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:27:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:27:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:27:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:27:19 user nova-compute[72766]: DEBUG nova.compute.manager [req-a5b6dc76-2084-41fe-a179-c18f3d24bf3e req-b551fd1d-8230-4a8c-af4a-3a47a6f469c3 service nova] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Received event network-vif-unplugged-751d95bb-6ad7-4767-b4f6-21d9767002f4 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:27:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a5b6dc76-2084-41fe-a179-c18f3d24bf3e req-b551fd1d-8230-4a8c-af4a-3a47a6f469c3 service nova] Acquiring lock "49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:27:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a5b6dc76-2084-41fe-a179-c18f3d24bf3e req-b551fd1d-8230-4a8c-af4a-3a47a6f469c3 service nova] Lock "49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:27:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a5b6dc76-2084-41fe-a179-c18f3d24bf3e req-b551fd1d-8230-4a8c-af4a-3a47a6f469c3 service nova] Lock "49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:27:19 user nova-compute[72766]: DEBUG nova.compute.manager [req-a5b6dc76-2084-41fe-a179-c18f3d24bf3e req-b551fd1d-8230-4a8c-af4a-3a47a6f469c3 service nova] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] No waiting events found dispatching network-vif-unplugged-751d95bb-6ad7-4767-b4f6-21d9767002f4 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:27:19 user nova-compute[72766]: DEBUG nova.compute.manager [req-a5b6dc76-2084-41fe-a179-c18f3d24bf3e req-b551fd1d-8230-4a8c-af4a-3a47a6f469c3 service nova] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Received event network-vif-unplugged-751d95bb-6ad7-4767-b4f6-21d9767002f4 for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:27:20 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:27:20 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:27:20 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Instance destroyed successfully.
Aug 14 23:27:20 user nova-compute[72766]: DEBUG nova.objects.instance [None req-cd4d287e-9f81-4312-8015-f10d17b045bd tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lazy-loading 'resources' on Instance uuid 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:27:20 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-cd4d287e-9f81-4312-8015-f10d17b045bd tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:24:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-48162781',display_name='tempest-AttachVolumeNegativeTest-server-48162781',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-48162781',id=39,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo09XeJ1pAggSESyIJoxiSZQ8juetrPHWR/cVeQ0wVdhKYrGPF4XiepVoSIbYa/ryzhHlNQH6XsTml3GUAeseDtSVcfWl4aDRZOb17E7U3oazL6G9BakjUPk8QKYRQoig==',key_name='tempest-keypair-679375113',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:24:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3785d8cff6cd41a4aff8becf528e3a4c',ramdisk_id='',reservation_id='r-eeyaciv5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1623363641',owner_user_name='tempest-AttachVolumeNegativeTest-1623363641-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:24:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90e68d4dfd6048d99037fce632788b57',uuid=49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "751d95bb-6ad7-4767-b4f6-21d9767002f4", "address": "fa:16:3e:32:4a:65", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap751d95bb-6a", "ovs_interfaceid": "751d95bb-6ad7-4767-b4f6-21d9767002f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:27:20 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-cd4d287e-9f81-4312-8015-f10d17b045bd tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Converting VIF {"id": "751d95bb-6ad7-4767-b4f6-21d9767002f4", "address": "fa:16:3e:32:4a:65", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap751d95bb-6a", "ovs_interfaceid": "751d95bb-6ad7-4767-b4f6-21d9767002f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:27:20 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-cd4d287e-9f81-4312-8015-f10d17b045bd tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:4a:65,bridge_name='br-int',has_traffic_filtering=True,id=751d95bb-6ad7-4767-b4f6-21d9767002f4,network=Network(9491b8be-e6b2-4770-a591-370db9a96785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap751d95bb-6a') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:27:20 user nova-compute[72766]: DEBUG os_vif [None req-cd4d287e-9f81-4312-8015-f10d17b045bd tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:4a:65,bridge_name='br-int',has_traffic_filtering=True,id=751d95bb-6ad7-4767-b4f6-21d9767002f4,network=Network(9491b8be-e6b2-4770-a591-370db9a96785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap751d95bb-6a') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:27:20 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:27:20 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap751d95bb-6a, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:27:20 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:27:20 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:27:20 user nova-compute[72766]: INFO os_vif [None req-cd4d287e-9f81-4312-8015-f10d17b045bd tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:4a:65,bridge_name='br-int',has_traffic_filtering=True,id=751d95bb-6ad7-4767-b4f6-21d9767002f4,network=Network(9491b8be-e6b2-4770-a591-370db9a96785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap751d95bb-6a')
Aug 14 23:27:20 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-cd4d287e-9f81-4312-8015-f10d17b045bd tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Deleting instance files /opt/stack/data/nova/instances/49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a_del
Aug 14 23:27:20 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-cd4d287e-9f81-4312-8015-f10d17b045bd tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Deletion of /opt/stack/data/nova/instances/49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a_del complete
Aug 14 23:27:20 user nova-compute[72766]: INFO nova.compute.manager [None req-cd4d287e-9f81-4312-8015-f10d17b045bd tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 14 23:27:20 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-cd4d287e-9f81-4312-8015-f10d17b045bd tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:27:20 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:27:20 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:27:21 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:27:21 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Took 0.98 seconds to deallocate network for instance.
Aug 14 23:27:21 user nova-compute[72766]: DEBUG nova.compute.manager [req-59112b47-b6dc-43e5-a2c0-794bf9e84633 req-0f32108e-902b-4e78-89a9-484dfaccf1eb service nova] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Received event network-vif-deleted-751d95bb-6ad7-4767-b4f6-21d9767002f4 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:27:21 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cd4d287e-9f81-4312-8015-f10d17b045bd tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:27:21 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cd4d287e-9f81-4312-8015-f10d17b045bd tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:27:21 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-cd4d287e-9f81-4312-8015-f10d17b045bd tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:27:21 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-cd4d287e-9f81-4312-8015-f10d17b045bd tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:27:21 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cd4d287e-9f81-4312-8015-f10d17b045bd tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.150s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:27:21 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-cd4d287e-9f81-4312-8015-f10d17b045bd tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Deleted allocations for instance 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a
Aug 14 23:27:21 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cd4d287e-9f81-4312-8015-f10d17b045bd tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.227s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:27:22 user nova-compute[72766]: DEBUG nova.compute.manager [req-52067084-0fb9-4fa0-aeac-fd37723742f8 req-62bbfcf0-f2b0-4401-91a4-49cc289b25bb service nova] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Received event network-vif-plugged-751d95bb-6ad7-4767-b4f6-21d9767002f4 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:27:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-52067084-0fb9-4fa0-aeac-fd37723742f8 req-62bbfcf0-f2b0-4401-91a4-49cc289b25bb service nova] Acquiring lock "49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:27:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-52067084-0fb9-4fa0-aeac-fd37723742f8 req-62bbfcf0-f2b0-4401-91a4-49cc289b25bb service nova] Lock "49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:27:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-52067084-0fb9-4fa0-aeac-fd37723742f8 req-62bbfcf0-f2b0-4401-91a4-49cc289b25bb service nova] Lock "49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:27:22 user nova-compute[72766]: DEBUG nova.compute.manager [req-52067084-0fb9-4fa0-aeac-fd37723742f8 req-62bbfcf0-f2b0-4401-91a4-49cc289b25bb service nova] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] No waiting events found dispatching network-vif-plugged-751d95bb-6ad7-4767-b4f6-21d9767002f4 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:27:22 user nova-compute[72766]: WARNING nova.compute.manager [req-52067084-0fb9-4fa0-aeac-fd37723742f8 req-62bbfcf0-f2b0-4401-91a4-49cc289b25bb service nova] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Received unexpected event network-vif-plugged-751d95bb-6ad7-4767-b4f6-21d9767002f4 for instance with vm_state deleted and task_state None.
Aug 14 23:27:25 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:27:28 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692055633.0360777, 22fcbe70-f8b6-4a57-ac95-296bac414544 => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:27:28 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] VM Stopped (Lifecycle Event)
Aug 14 23:27:28 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c04359d0-30f9-4f3c-9f92-ac4c34339a51 None None] [instance: 22fcbe70-f8b6-4a57-ac95-296bac414544] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:27:30 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:27:35 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692055640.2827842, 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:27:35 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] VM Stopped (Lifecycle Event)
Aug 14 23:27:35 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c599be5e-d85c-4313-bc8c-d9fb981e09a3 None None] [instance: 49c9e0c6-cf1a-4287-8360-ba9e97bf0b8a] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:27:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:27:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:27:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:27:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:27:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:27:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:27:37 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:27:40 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:27:40 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:27:40 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:27:40 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Rebuilding the list of instances to heal {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 23:27:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-cbcf7851-e6f7-4f46-97cc-d773286ccddf" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:27:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-cbcf7851-e6f7-4f46-97cc-d773286ccddf" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:27:40 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:27:40 user nova-compute[72766]: DEBUG nova.objects.instance [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lazy-loading 'info_cache' on Instance uuid cbcf7851-e6f7-4f46-97cc-d773286ccddf {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:27:41 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Updating instance_info_cache with network_info: [{"id": "8f65f8f0-60fe-4fdb-af66-424a85b12caf", "address": "fa:16:3e:70:30:66", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f65f8f0-60", "ovs_interfaceid": "8f65f8f0-60fe-4fdb-af66-424a85b12caf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:27:41 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-cbcf7851-e6f7-4f46-97cc-d773286ccddf" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:27:41 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:27:41 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:27:41 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:27:41 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:27:41 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:27:41 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:27:41 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb57162-d1da-4ea0-aca0-80da305537d1/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:27:41 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb57162-d1da-4ea0-aca0-80da305537d1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:27:41 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb57162-d1da-4ea0-aca0-80da305537d1/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:27:41 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb57162-d1da-4ea0-aca0-80da305537d1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:27:41 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:27:42 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:27:42 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:27:42 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:27:42 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:27:42 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:27:42 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=8545MB free_disk=25.28830337524414GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:27:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:27:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:27:42 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance cbcf7851-e6f7-4f46-97cc-d773286ccddf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:27:42 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance fcb57162-d1da-4ea0-aca0-80da305537d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:27:42 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:27:42 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:27:42 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:27:42 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:27:42 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:27:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.212s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:27:44 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:27:44 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:27:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:27:46 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:27:48 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:27:49 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:27:49 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:27:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:27:50 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:27:50 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:27:55 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:28:00 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:28:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a14ccf31-4f5e-4f34-b438-eb0d30c61276 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Acquiring lock "fcb57162-d1da-4ea0-aca0-80da305537d1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:28:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a14ccf31-4f5e-4f34-b438-eb0d30c61276 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "fcb57162-d1da-4ea0-aca0-80da305537d1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:28:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a14ccf31-4f5e-4f34-b438-eb0d30c61276 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Acquiring lock "fcb57162-d1da-4ea0-aca0-80da305537d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:28:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a14ccf31-4f5e-4f34-b438-eb0d30c61276 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "fcb57162-d1da-4ea0-aca0-80da305537d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:28:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a14ccf31-4f5e-4f34-b438-eb0d30c61276 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "fcb57162-d1da-4ea0-aca0-80da305537d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:28:00 user nova-compute[72766]: INFO nova.compute.manager [None req-a14ccf31-4f5e-4f34-b438-eb0d30c61276 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Terminating instance
Aug 14 23:28:00 user nova-compute[72766]: DEBUG nova.compute.manager [None req-a14ccf31-4f5e-4f34-b438-eb0d30c61276 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:28:00 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:00 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:00 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:00 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:00 user nova-compute[72766]: DEBUG nova.compute.manager [req-d6fa38ea-e944-4438-8a5f-bf0074718827 req-eded6dd1-08e9-47d1-b9a4-4ee35a59f158 service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Received event network-vif-unplugged-518eb684-a3b3-4886-a828-e818de5be54f {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:28:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d6fa38ea-e944-4438-8a5f-bf0074718827 req-eded6dd1-08e9-47d1-b9a4-4ee35a59f158 service nova] Acquiring lock "fcb57162-d1da-4ea0-aca0-80da305537d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:28:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d6fa38ea-e944-4438-8a5f-bf0074718827 req-eded6dd1-08e9-47d1-b9a4-4ee35a59f158 service nova] Lock "fcb57162-d1da-4ea0-aca0-80da305537d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:28:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d6fa38ea-e944-4438-8a5f-bf0074718827 req-eded6dd1-08e9-47d1-b9a4-4ee35a59f158 service nova] Lock "fcb57162-d1da-4ea0-aca0-80da305537d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:28:00 user nova-compute[72766]: DEBUG nova.compute.manager [req-d6fa38ea-e944-4438-8a5f-bf0074718827 req-eded6dd1-08e9-47d1-b9a4-4ee35a59f158 service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] No waiting events found dispatching network-vif-unplugged-518eb684-a3b3-4886-a828-e818de5be54f {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:28:00 user nova-compute[72766]: DEBUG nova.compute.manager [req-d6fa38ea-e944-4438-8a5f-bf0074718827 req-eded6dd1-08e9-47d1-b9a4-4ee35a59f158 service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Received event network-vif-unplugged-518eb684-a3b3-4886-a828-e818de5be54f for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:28:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:01 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Instance destroyed successfully.
Aug 14 23:28:01 user nova-compute[72766]: DEBUG nova.objects.instance [None req-a14ccf31-4f5e-4f34-b438-eb0d30c61276 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lazy-loading 'resources' on Instance uuid fcb57162-d1da-4ea0-aca0-80da305537d1 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:28:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-a14ccf31-4f5e-4f34-b438-eb0d30c61276 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:22:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1086401159',display_name='tempest-TestMinimumBasicScenario-server-1086401159',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1086401159',id=38,image_ref='6abaf5d8-8c86-42c6-84a9-0a91e4bc711b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIT4sWowgwzBSgSQSR4/nQGYejOWmEvcMvkPagaWavJ4GtHuJlXtb9tn4Ifw16P3BWGIzuruDEdE7i2Q5+xQOQqPuO67WUM//mFBoSm7QzgYYOgilspdEBNyYzBUZBj/gg==',key_name='tempest-TestMinimumBasicScenario-1137169698',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:22:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cbd47fb3d5eb408aa751d1d49f198906',ramdisk_id='',reservation_id='r-6keiuhzz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6abaf5d8-8c86-42c6-84a9-0a91e4bc711b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1491062679',owner_user_name='tempest-TestMinimumBasicScenario-1491062679-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:25:19Z,user_data=None,user_id='a2b1f48b1a594010befb4da227f8b473',uuid=fcb57162-d1da-4ea0-aca0-80da305537d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "518eb684-a3b3-4886-a828-e818de5be54f", "address": "fa:16:3e:81:95:89", "network": {"id": "c7828c64-4d71-4c57-8df8-bb4524d9b9cb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-160068070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbd47fb3d5eb408aa751d1d49f198906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518eb684-a3", "ovs_interfaceid": "518eb684-a3b3-4886-a828-e818de5be54f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:28:01 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-a14ccf31-4f5e-4f34-b438-eb0d30c61276 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Converting VIF {"id": "518eb684-a3b3-4886-a828-e818de5be54f", "address": "fa:16:3e:81:95:89", "network": {"id": "c7828c64-4d71-4c57-8df8-bb4524d9b9cb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-160068070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbd47fb3d5eb408aa751d1d49f198906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518eb684-a3", "ovs_interfaceid": "518eb684-a3b3-4886-a828-e818de5be54f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:28:01 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-a14ccf31-4f5e-4f34-b438-eb0d30c61276 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:95:89,bridge_name='br-int',has_traffic_filtering=True,id=518eb684-a3b3-4886-a828-e818de5be54f,network=Network(c7828c64-4d71-4c57-8df8-bb4524d9b9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap518eb684-a3') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:28:01 user nova-compute[72766]: DEBUG os_vif [None req-a14ccf31-4f5e-4f34-b438-eb0d30c61276 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:95:89,bridge_name='br-int',has_traffic_filtering=True,id=518eb684-a3b3-4886-a828-e818de5be54f,network=Network(c7828c64-4d71-4c57-8df8-bb4524d9b9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap518eb684-a3') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:28:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap518eb684-a3, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:28:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:28:01 user nova-compute[72766]: INFO os_vif [None req-a14ccf31-4f5e-4f34-b438-eb0d30c61276 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:95:89,bridge_name='br-int',has_traffic_filtering=True,id=518eb684-a3b3-4886-a828-e818de5be54f,network=Network(c7828c64-4d71-4c57-8df8-bb4524d9b9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap518eb684-a3')
Aug 14 23:28:01 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-a14ccf31-4f5e-4f34-b438-eb0d30c61276 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Deleting instance files /opt/stack/data/nova/instances/fcb57162-d1da-4ea0-aca0-80da305537d1_del
Aug 14 23:28:01 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-a14ccf31-4f5e-4f34-b438-eb0d30c61276 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Deletion of /opt/stack/data/nova/instances/fcb57162-d1da-4ea0-aca0-80da305537d1_del complete
Aug 14 23:28:01 user nova-compute[72766]: INFO nova.compute.manager [None req-a14ccf31-4f5e-4f34-b438-eb0d30c61276 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 14 23:28:01 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-a14ccf31-4f5e-4f34-b438-eb0d30c61276 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:28:01 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:28:01 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:28:02 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:28:02 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Took 0.60 seconds to deallocate network for instance.
Aug 14 23:28:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a14ccf31-4f5e-4f34-b438-eb0d30c61276 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:28:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a14ccf31-4f5e-4f34-b438-eb0d30c61276 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:28:02 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-a14ccf31-4f5e-4f34-b438-eb0d30c61276 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:28:02 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-a14ccf31-4f5e-4f34-b438-eb0d30c61276 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:28:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a14ccf31-4f5e-4f34-b438-eb0d30c61276 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.150s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:28:02 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-a14ccf31-4f5e-4f34-b438-eb0d30c61276 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Deleted allocations for instance fcb57162-d1da-4ea0-aca0-80da305537d1
Aug 14 23:28:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-a14ccf31-4f5e-4f34-b438-eb0d30c61276 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "fcb57162-d1da-4ea0-aca0-80da305537d1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.827s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:28:02 user nova-compute[72766]: DEBUG nova.compute.manager [req-c6af78e0-c8f4-4e40-92f1-86f2d73780b2 req-b8a86e97-09f1-4f28-be77-b638411a5d3a service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Received event network-vif-plugged-518eb684-a3b3-4886-a828-e818de5be54f {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:28:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-c6af78e0-c8f4-4e40-92f1-86f2d73780b2 req-b8a86e97-09f1-4f28-be77-b638411a5d3a service nova] Acquiring lock "fcb57162-d1da-4ea0-aca0-80da305537d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:28:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-c6af78e0-c8f4-4e40-92f1-86f2d73780b2 req-b8a86e97-09f1-4f28-be77-b638411a5d3a service nova] Lock "fcb57162-d1da-4ea0-aca0-80da305537d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:28:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-c6af78e0-c8f4-4e40-92f1-86f2d73780b2 req-b8a86e97-09f1-4f28-be77-b638411a5d3a service nova] Lock "fcb57162-d1da-4ea0-aca0-80da305537d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:28:02 user nova-compute[72766]: DEBUG nova.compute.manager [req-c6af78e0-c8f4-4e40-92f1-86f2d73780b2 req-b8a86e97-09f1-4f28-be77-b638411a5d3a service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] No waiting events found dispatching network-vif-plugged-518eb684-a3b3-4886-a828-e818de5be54f {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:28:02 user nova-compute[72766]: WARNING nova.compute.manager [req-c6af78e0-c8f4-4e40-92f1-86f2d73780b2 req-b8a86e97-09f1-4f28-be77-b638411a5d3a service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Received unexpected event network-vif-plugged-518eb684-a3b3-4886-a828-e818de5be54f for instance with vm_state deleted and task_state None.
Aug 14 23:28:02 user nova-compute[72766]: DEBUG nova.compute.manager [req-c6af78e0-c8f4-4e40-92f1-86f2d73780b2 req-b8a86e97-09f1-4f28-be77-b638411a5d3a service nova] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Received event network-vif-deleted-518eb684-a3b3-4886-a828-e818de5be54f {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:28:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:06 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b70c1374-71d6-4bb8-aa82-9076d0c14aae tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:28:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b70c1374-71d6-4bb8-aa82-9076d0c14aae tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:28:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b70c1374-71d6-4bb8-aa82-9076d0c14aae tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:28:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b70c1374-71d6-4bb8-aa82-9076d0c14aae tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:28:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b70c1374-71d6-4bb8-aa82-9076d0c14aae tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:28:11 user nova-compute[72766]: INFO nova.compute.manager [None req-b70c1374-71d6-4bb8-aa82-9076d0c14aae tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Terminating instance
Aug 14 23:28:11 user nova-compute[72766]: DEBUG nova.compute.manager [None req-b70c1374-71d6-4bb8-aa82-9076d0c14aae tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:28:11 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [-] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] During wait destroy, instance disappeared. {{(pid=72766) _wait_for_destroy /opt/stack/nova/nova/virt/libvirt/driver.py:1517}}
Aug 14 23:28:11 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Instance destroyed successfully.
Aug 14 23:28:11 user nova-compute[72766]: DEBUG nova.objects.instance [None req-b70c1374-71d6-4bb8-aa82-9076d0c14aae tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lazy-loading 'resources' on Instance uuid 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:28:11 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-b70c1374-71d6-4bb8-aa82-9076d0c14aae tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T23:06:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-150191314',display_name='tempest-ServerActionsTestOtherA-server-862754926',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-150191314',id=26,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhBKWAdQDYNegvQl/mV+51njSAEVUmutFEgZbA9nGUhkxXmc3MlsVdSjdWdHEupxDpXGsOvLx4E4h8d+jhKDRG+ZGsHr6pYyGyF87J32gsCcwif1sgiUwbddldcHNR0PA==',key_name='tempest-keypair-293995822',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:06:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=0,progress=0,project_id='7b0d4f038dbd47b1aad9829f19cb4896',ramdisk_id='',reservation_id='r-uuuhfmg4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-242565278',owner_user_name='tempest-ServerActionsTestOtherA-242565278-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:11:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11bf21631dd0447f8f1a3f2b012ec43a',uuid=99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='error') vif={"id": "0df45a26-6026-4baa-bdaa-a761d2d3c2a6", "address": "fa:16:3e:89:96:a5", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0df45a26-60", "ovs_interfaceid": "0df45a26-6026-4baa-bdaa-a761d2d3c2a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:28:11 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-b70c1374-71d6-4bb8-aa82-9076d0c14aae tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Converting VIF {"id": "0df45a26-6026-4baa-bdaa-a761d2d3c2a6", "address": "fa:16:3e:89:96:a5", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0df45a26-60", "ovs_interfaceid": "0df45a26-6026-4baa-bdaa-a761d2d3c2a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:28:11 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-b70c1374-71d6-4bb8-aa82-9076d0c14aae tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:96:a5,bridge_name='br-int',has_traffic_filtering=True,id=0df45a26-6026-4baa-bdaa-a761d2d3c2a6,network=Network(e0bbc182-f700-4a82-84ae-7cbcb2e517c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0df45a26-60') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:28:11 user nova-compute[72766]: DEBUG os_vif [None req-b70c1374-71d6-4bb8-aa82-9076d0c14aae tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:96:a5,bridge_name='br-int',has_traffic_filtering=True,id=0df45a26-6026-4baa-bdaa-a761d2d3c2a6,network=Network(e0bbc182-f700-4a82-84ae-7cbcb2e517c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0df45a26-60') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:28:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0df45a26-60, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:28:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:28:11 user nova-compute[72766]: INFO os_vif [None req-b70c1374-71d6-4bb8-aa82-9076d0c14aae tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:96:a5,bridge_name='br-int',has_traffic_filtering=True,id=0df45a26-6026-4baa-bdaa-a761d2d3c2a6,network=Network(e0bbc182-f700-4a82-84ae-7cbcb2e517c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0df45a26-60')
Aug 14 23:28:11 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b70c1374-71d6-4bb8-aa82-9076d0c14aae tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:28:11 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70c1374-71d6-4bb8-aa82-9076d0c14aae tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UefzbqZF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:28:11 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-b70c1374-71d6-4bb8-aa82-9076d0c14aae tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:28:11 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-b70c1374-71d6-4bb8-aa82-9076d0c14aae tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:28:11 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-b70c1374-71d6-4bb8-aa82-9076d0c14aae tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:28:11 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70c1374-71d6-4bb8-aa82-9076d0c14aae tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef186ec2-e9ab-43ab-8d61-2baf65b7eeb1', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:28:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:28:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 21 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:28:11 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f46001b-004e-4e49-a960-70c9d5c30fd7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:28:11 user nova-compute[72766]: WARNING os_brick.initiator.connectors.iscsi [None req-b70c1374-71d6-4bb8-aa82-9076d0c14aae tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Couldn't find iSCSI nodes because iscsiadm err: iscsiadm: No records found
Aug 14 23:28:11 user nova-compute[72766]: 
Aug 14 23:28:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:28:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:28:11 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8909e8df-8c23-4155-81e2-9895c17811ec]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:28:11 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70c1374-71d6-4bb8-aa82-9076d0c14aae tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 23:28:11 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:28:11 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70c1374-71d6-4bb8-aa82-9076d0c14aae tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 23:28:11 user nova-compute[72766]:  {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:28:11 user nova-compute[72766]: WARNING os_brick.initiator.connectors.iscsi [None req-b70c1374-71d6-4bb8-aa82-9076d0c14aae tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 23:28:11 user nova-compute[72766]: 
Aug 14 23:28:11 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70c1374-71d6-4bb8-aa82-9076d0c14aae tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff154252320>, {}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:28:11 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70c1374-71d6-4bb8-aa82-9076d0c14aae tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Disconnecting from: [] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:28:11 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-b70c1374-71d6-4bb8-aa82-9076d0c14aae tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.048s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:28:11 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70c1374-71d6-4bb8-aa82-9076d0c14aae tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] <== disconnect_volume: return (50ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:28:11 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b70c1374-71d6-4bb8-aa82-9076d0c14aae tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:28:11 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-b70c1374-71d6-4bb8-aa82-9076d0c14aae tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Deletion of /opt/stack/data/nova/instances/99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef_del complete
Aug 14 23:28:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 89-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:28:11 user nova-compute[72766]: INFO nova.compute.manager [None req-b70c1374-71d6-4bb8-aa82-9076d0c14aae tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Took 0.16 seconds to destroy the instance on the hypervisor.
Aug 14 23:28:11 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-b70c1374-71d6-4bb8-aa82-9076d0c14aae tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:28:11 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:28:11 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:28:13 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:28:13 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Took 1.70 seconds to deallocate network for instance.
Aug 14 23:28:13 user nova-compute[72766]: DEBUG nova.compute.manager [req-aafbddf5-97d9-487a-a6c7-f76e2e76a31c req-29c79a26-bec5-44da-be1d-ad56fe8b5d2c service nova] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Received event network-vif-deleted-0df45a26-6026-4baa-bdaa-a761d2d3c2a6 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:28:13 user nova-compute[72766]: INFO nova.compute.manager [None req-b70c1374-71d6-4bb8-aa82-9076d0c14aae tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef] Took 0.14 seconds to detach 1 volumes for instance.
Aug 14 23:28:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b70c1374-71d6-4bb8-aa82-9076d0c14aae tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:28:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b70c1374-71d6-4bb8-aa82-9076d0c14aae tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:28:13 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-b70c1374-71d6-4bb8-aa82-9076d0c14aae tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:28:13 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-b70c1374-71d6-4bb8-aa82-9076d0c14aae tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:28:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b70c1374-71d6-4bb8-aa82-9076d0c14aae tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.131s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:28:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b70c1374-71d6-4bb8-aa82-9076d0c14aae tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "99ac0f4a-d0ed-4ed6-b315-1d0831bd62ef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.330s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:28:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "a31f7f11-fdd1-4e48-a275-78d6ad02224b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:28:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "a31f7f11-fdd1-4e48-a275-78d6ad02224b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:28:14 user nova-compute[72766]: DEBUG nova.compute.manager [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 23:28:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:28:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:28:14 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 23:28:14 user nova-compute[72766]: INFO nova.compute.claims [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Claim successful on node user
Aug 14 23:28:14 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:28:14 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:28:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.342s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:28:14 user nova-compute[72766]: DEBUG nova.compute.manager [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 23:28:14 user nova-compute[72766]: DEBUG nova.compute.manager [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 23:28:14 user nova-compute[72766]: DEBUG nova.network.neutron [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 23:28:14 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 23:28:14 user nova-compute[72766]: DEBUG nova.compute.manager [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 23:28:14 user nova-compute[72766]: DEBUG nova.policy [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '90e68d4dfd6048d99037fce632788b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785d8cff6cd41a4aff8becf528e3a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 23:28:14 user nova-compute[72766]: DEBUG nova.compute.manager [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 23:28:14 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 23:28:14 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Creating image(s)
Aug 14 23:28:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "/opt/stack/data/nova/instances/a31f7f11-fdd1-4e48-a275-78d6ad02224b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:28:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "/opt/stack/data/nova/instances/a31f7f11-fdd1-4e48-a275-78d6ad02224b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:28:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "/opt/stack/data/nova/instances/a31f7f11-fdd1-4e48-a275-78d6ad02224b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:28:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:28:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.191s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:28:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:28:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:28:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:28:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.196s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:28:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/a31f7f11-fdd1-4e48-a275-78d6ad02224b/disk 1073741824 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:28:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/a31f7f11-fdd1-4e48-a275-78d6ad02224b/disk 1073741824" returned: 0 in 0.058s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:28:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:28:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:28:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "a87649f2-475b-410f-b7cd-4cb7db232023" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:28:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "a87649f2-475b-410f-b7cd-4cb7db232023" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:28:15 user nova-compute[72766]: DEBUG nova.compute.manager [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 23:28:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.197s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:28:15 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a31f7f11-fdd1-4e48-a275-78d6ad02224b/disk. size=1073741824 {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 23:28:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a31f7f11-fdd1-4e48-a275-78d6ad02224b/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:28:15 user nova-compute[72766]: DEBUG nova.network.neutron [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Successfully created port: 3f64a69a-f0a6-4815-ac3b-55de6f80c83c {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 23:28:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:28:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:28:15 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 23:28:15 user nova-compute[72766]: INFO nova.compute.claims [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Claim successful on node user
Aug 14 23:28:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a31f7f11-fdd1-4e48-a275-78d6ad02224b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:28:15 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Cannot resize image /opt/stack/data/nova/instances/a31f7f11-fdd1-4e48-a275-78d6ad02224b/disk to a smaller size. {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 23:28:15 user nova-compute[72766]: DEBUG nova.objects.instance [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lazy-loading 'migration_context' on Instance uuid a31f7f11-fdd1-4e48-a275-78d6ad02224b {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:28:15 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 23:28:15 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Ensure instance console log exists: /opt/stack/data/nova/instances/a31f7f11-fdd1-4e48-a275-78d6ad02224b/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 23:28:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:28:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:28:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:28:15 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:28:15 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:28:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.271s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:28:15 user nova-compute[72766]: DEBUG nova.compute.manager [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 23:28:15 user nova-compute[72766]: DEBUG nova.compute.manager [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 23:28:15 user nova-compute[72766]: DEBUG nova.network.neutron [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 23:28:15 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 23:28:15 user nova-compute[72766]: DEBUG nova.compute.manager [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 23:28:15 user nova-compute[72766]: INFO nova.virt.block_device [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Booting with volume 52e4fc71-e83e-49b1-b48b-aad06097b1e1 at /dev/vda
Aug 14 23:28:15 user nova-compute[72766]: DEBUG nova.policy [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '999390ac8e6240199c9a7484e234f3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c9f53727cc497c94516ff7fa1bbf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 23:28:15 user nova-compute[72766]: DEBUG os_brick.utils [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:28:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:28:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:28:15 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecaeec0-dc3c-479d-ba33-6d51302ecbba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:28:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f43743-3a3c-45de-a05f-eef81e7055bd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8fac982-54d1-4186-8544-c12435b18b22]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[147036b9-b8e1-4c09-9a50-e1e986047f53]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:28:16 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 23:28:16 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[15628d34-136e-4510-8ddf-3a32449b1637]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG os_brick.utils [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Updating existing volume attachment record: 0c103773-6c31-4225-8df8-cdedce0cf565 {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG nova.network.neutron [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Successfully updated port: 3f64a69a-f0a6-4815-ac3b-55de6f80c83c {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692055681.3261275, fcb57162-d1da-4ea0-aca0-80da305537d1 => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:28:16 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] VM Stopped (Lifecycle Event)
Aug 14 23:28:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "refresh_cache-a31f7f11-fdd1-4e48-a275-78d6ad02224b" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquired lock "refresh_cache-a31f7f11-fdd1-4e48-a275-78d6ad02224b" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG nova.network.neutron [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG nova.compute.manager [req-0ae249e1-509e-4bf6-ae02-0f7b435152d9 req-11daa588-e6e3-4084-b1c5-338dabd4738f service nova] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Received event network-changed-3f64a69a-f0a6-4815-ac3b-55de6f80c83c {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG nova.compute.manager [req-0ae249e1-509e-4bf6-ae02-0f7b435152d9 req-11daa588-e6e3-4084-b1c5-338dabd4738f service nova] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Refreshing instance network info cache due to event network-changed-3f64a69a-f0a6-4815-ac3b-55de6f80c83c. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0ae249e1-509e-4bf6-ae02-0f7b435152d9 req-11daa588-e6e3-4084-b1c5-338dabd4738f service nova] Acquiring lock "refresh_cache-a31f7f11-fdd1-4e48-a275-78d6ad02224b" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG nova.compute.manager [None req-637fa97d-ab9e-495f-82b1-83ce4c365648 None None] [instance: fcb57162-d1da-4ea0-aca0-80da305537d1] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG nova.network.neutron [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG nova.network.neutron [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Successfully created port: eaa457f1-6ef8-4621-ab04-e313204b24fa {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG nova.network.neutron [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Updating instance_info_cache with network_info: [{"id": "3f64a69a-f0a6-4815-ac3b-55de6f80c83c", "address": "fa:16:3e:ea:38:e7", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f64a69a-f0", "ovs_interfaceid": "3f64a69a-f0a6-4815-ac3b-55de6f80c83c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Releasing lock "refresh_cache-a31f7f11-fdd1-4e48-a275-78d6ad02224b" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG nova.compute.manager [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Instance network_info: |[{"id": "3f64a69a-f0a6-4815-ac3b-55de6f80c83c", "address": "fa:16:3e:ea:38:e7", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f64a69a-f0", "ovs_interfaceid": "3f64a69a-f0a6-4815-ac3b-55de6f80c83c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0ae249e1-509e-4bf6-ae02-0f7b435152d9 req-11daa588-e6e3-4084-b1c5-338dabd4738f service nova] Acquired lock "refresh_cache-a31f7f11-fdd1-4e48-a275-78d6ad02224b" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG nova.network.neutron [req-0ae249e1-509e-4bf6-ae02-0f7b435152d9 req-11daa588-e6e3-4084-b1c5-338dabd4738f service nova] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Refreshing network info cache for port 3f64a69a-f0a6-4815-ac3b-55de6f80c83c {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Start _get_guest_xml network_info=[{"id": "3f64a69a-f0a6-4815-ac3b-55de6f80c83c", "address": "fa:16:3e:ea:38:e7", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f64a69a-f0", "ovs_interfaceid": "3f64a69a-f0a6-4815-ac3b-55de6f80c83c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd2900d30-2c4c-4d57-9135-d45564c0c596'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:28:16 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:28:16 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:28:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:28:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-5764886',display_name='tempest-AttachVolumeNegativeTest-server-5764886',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-5764886',id=41,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTYdbPNovDhK/nmLZG3LuoS40DRaX1UMgKDAdTNM1uBdt/Lq9erAon/+IIUHXr5255Jln1EYgDlmFwMcIWLc76O6/+6NO9ikZSxXGTpKJIL4nJiAk8iLz0F6kAgRJYKtg==',key_name='tempest-keypair-1027438596',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3785d8cff6cd41a4aff8becf528e3a4c',ramdisk_id='',reservation_id='r-zbfnohxj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1623363641',owner_user_name='tempest-AttachVolumeNegativeTest-1623363641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:28:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90e68d4dfd6048d99037fce632788b57',uuid=a31f7f11-fdd1-4e48-a275-78d6ad02224b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f64a69a-f0a6-4815-ac3b-55de6f80c83c", "address": "fa:16:3e:ea:38:e7", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f64a69a-f0", "ovs_interfaceid": "3f64a69a-f0a6-4815-ac3b-55de6f80c83c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Converting VIF {"id": "3f64a69a-f0a6-4815-ac3b-55de6f80c83c", "address": "fa:16:3e:ea:38:e7", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f64a69a-f0", "ovs_interfaceid": "3f64a69a-f0a6-4815-ac3b-55de6f80c83c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:38:e7,bridge_name='br-int',has_traffic_filtering=True,id=3f64a69a-f0a6-4815-ac3b-55de6f80c83c,network=Network(9491b8be-e6b2-4770-a591-370db9a96785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f64a69a-f0') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG nova.objects.instance [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lazy-loading 'pci_devices' on Instance uuid a31f7f11-fdd1-4e48-a275-78d6ad02224b {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:28:16 user nova-compute[72766]:   <uuid>a31f7f11-fdd1-4e48-a275-78d6ad02224b</uuid>
Aug 14 23:28:16 user nova-compute[72766]:   <name>instance-00000029</name>
Aug 14 23:28:16 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:28:16 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:28:16 user nova-compute[72766]:   <metadata>
Aug 14 23:28:16 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:28:16 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:28:16 user nova-compute[72766]:       <nova:name>tempest-AttachVolumeNegativeTest-server-5764886</nova:name>
Aug 14 23:28:16 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:28:16</nova:creationTime>
Aug 14 23:28:16 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:28:16 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:28:16 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:28:16 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:28:16 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:28:16 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:28:16 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:28:16 user nova-compute[72766]:       <nova:owner>
Aug 14 23:28:16 user nova-compute[72766]:         <nova:user uuid="90e68d4dfd6048d99037fce632788b57">tempest-AttachVolumeNegativeTest-1623363641-project-member</nova:user>
Aug 14 23:28:16 user nova-compute[72766]:         <nova:project uuid="3785d8cff6cd41a4aff8becf528e3a4c">tempest-AttachVolumeNegativeTest-1623363641</nova:project>
Aug 14 23:28:16 user nova-compute[72766]:       </nova:owner>
Aug 14 23:28:16 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 23:28:16 user nova-compute[72766]:       <nova:ports>
Aug 14 23:28:16 user nova-compute[72766]:         <nova:port uuid="3f64a69a-f0a6-4815-ac3b-55de6f80c83c">
Aug 14 23:28:16 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 23:28:16 user nova-compute[72766]:         </nova:port>
Aug 14 23:28:16 user nova-compute[72766]:       </nova:ports>
Aug 14 23:28:16 user nova-compute[72766]:     </nova:instance>
Aug 14 23:28:16 user nova-compute[72766]:   </metadata>
Aug 14 23:28:16 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:28:16 user nova-compute[72766]:     <system>
Aug 14 23:28:16 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:28:16 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:28:16 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:28:16 user nova-compute[72766]:       <entry name="serial">a31f7f11-fdd1-4e48-a275-78d6ad02224b</entry>
Aug 14 23:28:16 user nova-compute[72766]:       <entry name="uuid">a31f7f11-fdd1-4e48-a275-78d6ad02224b</entry>
Aug 14 23:28:16 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:28:16 user nova-compute[72766]:     </system>
Aug 14 23:28:16 user nova-compute[72766]:   </sysinfo>
Aug 14 23:28:16 user nova-compute[72766]:   <os>
Aug 14 23:28:16 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:28:16 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:28:16 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:28:16 user nova-compute[72766]:   </os>
Aug 14 23:28:16 user nova-compute[72766]:   <features>
Aug 14 23:28:16 user nova-compute[72766]:     <acpi/>
Aug 14 23:28:16 user nova-compute[72766]:     <apic/>
Aug 14 23:28:16 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:28:16 user nova-compute[72766]:   </features>
Aug 14 23:28:16 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:28:16 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:28:16 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:28:16 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:28:16 user nova-compute[72766]:   </clock>
Aug 14 23:28:16 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:28:16 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:28:16 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:28:16 user nova-compute[72766]:   </cpu>
Aug 14 23:28:16 user nova-compute[72766]:   <devices>
Aug 14 23:28:16 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 23:28:16 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 23:28:16 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/a31f7f11-fdd1-4e48-a275-78d6ad02224b/disk"/>
Aug 14 23:28:16 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:28:16 user nova-compute[72766]:     </disk>
Aug 14 23:28:16 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:28:16 user nova-compute[72766]:       <mac address="fa:16:3e:ea:38:e7"/>
Aug 14 23:28:16 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:28:16 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:28:16 user nova-compute[72766]:       <target dev="tap3f64a69a-f0"/>
Aug 14 23:28:16 user nova-compute[72766]:     </interface>
Aug 14 23:28:16 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:28:16 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/a31f7f11-fdd1-4e48-a275-78d6ad02224b/console.log" append="off"/>
Aug 14 23:28:16 user nova-compute[72766]:     </serial>
Aug 14 23:28:16 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:28:16 user nova-compute[72766]:     <video>
Aug 14 23:28:16 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:28:16 user nova-compute[72766]:     </video>
Aug 14 23:28:16 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:28:16 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:28:16 user nova-compute[72766]:     </rng>
Aug 14 23:28:16 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:28:16 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:28:16 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:28:16 user nova-compute[72766]:     </memballoon>
Aug 14 23:28:16 user nova-compute[72766]:   </devices>
Aug 14 23:28:16 user nova-compute[72766]: </domain>
Aug 14 23:28:16 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:28:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-5764886',display_name='tempest-AttachVolumeNegativeTest-server-5764886',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-5764886',id=41,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTYdbPNovDhK/nmLZG3LuoS40DRaX1UMgKDAdTNM1uBdt/Lq9erAon/+IIUHXr5255Jln1EYgDlmFwMcIWLc76O6/+6NO9ikZSxXGTpKJIL4nJiAk8iLz0F6kAgRJYKtg==',key_name='tempest-keypair-1027438596',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3785d8cff6cd41a4aff8becf528e3a4c',ramdisk_id='',reservation_id='r-zbfnohxj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1623363641',owner_user_name='tempest-AttachVolumeNegativeTest-1623363641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:28:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90e68d4dfd6048d99037fce632788b57',uuid=a31f7f11-fdd1-4e48-a275-78d6ad02224b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f64a69a-f0a6-4815-ac3b-55de6f80c83c", "address": "fa:16:3e:ea:38:e7", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f64a69a-f0", "ovs_interfaceid": "3f64a69a-f0a6-4815-ac3b-55de6f80c83c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Converting VIF {"id": "3f64a69a-f0a6-4815-ac3b-55de6f80c83c", "address": "fa:16:3e:ea:38:e7", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f64a69a-f0", "ovs_interfaceid": "3f64a69a-f0a6-4815-ac3b-55de6f80c83c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:38:e7,bridge_name='br-int',has_traffic_filtering=True,id=3f64a69a-f0a6-4815-ac3b-55de6f80c83c,network=Network(9491b8be-e6b2-4770-a591-370db9a96785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f64a69a-f0') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG os_vif [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:38:e7,bridge_name='br-int',has_traffic_filtering=True,id=3f64a69a-f0a6-4815-ac3b-55de6f80c83c,network=Network(9491b8be-e6b2-4770-a591-370db9a96785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f64a69a-f0') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f64a69a-f0, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3f64a69a-f0, col_values=(('external_ids', {'iface-id': '3f64a69a-f0a6-4815-ac3b-55de6f80c83c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:38:e7', 'vm-uuid': 'a31f7f11-fdd1-4e48-a275-78d6ad02224b'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:16 user nova-compute[72766]: INFO os_vif [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:38:e7,bridge_name='br-int',has_traffic_filtering=True,id=3f64a69a-f0a6-4815-ac3b-55de6f80c83c,network=Network(9491b8be-e6b2-4770-a591-370db9a96785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f64a69a-f0')
Aug 14 23:28:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:28:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] No VIF found with MAC fa:16:3e:ea:38:e7, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:28:17 user nova-compute[72766]: DEBUG nova.network.neutron [req-0ae249e1-509e-4bf6-ae02-0f7b435152d9 req-11daa588-e6e3-4084-b1c5-338dabd4738f service nova] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Updated VIF entry in instance network info cache for port 3f64a69a-f0a6-4815-ac3b-55de6f80c83c. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:28:17 user nova-compute[72766]: DEBUG nova.network.neutron [req-0ae249e1-509e-4bf6-ae02-0f7b435152d9 req-11daa588-e6e3-4084-b1c5-338dabd4738f service nova] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Updating instance_info_cache with network_info: [{"id": "3f64a69a-f0a6-4815-ac3b-55de6f80c83c", "address": "fa:16:3e:ea:38:e7", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f64a69a-f0", "ovs_interfaceid": "3f64a69a-f0a6-4815-ac3b-55de6f80c83c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:28:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0ae249e1-509e-4bf6-ae02-0f7b435152d9 req-11daa588-e6e3-4084-b1c5-338dabd4738f service nova] Releasing lock "refresh_cache-a31f7f11-fdd1-4e48-a275-78d6ad02224b" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:28:17 user nova-compute[72766]: DEBUG nova.network.neutron [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Successfully updated port: eaa457f1-6ef8-4621-ab04-e313204b24fa {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 23:28:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "refresh_cache-a87649f2-475b-410f-b7cd-4cb7db232023" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:28:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquired lock "refresh_cache-a87649f2-475b-410f-b7cd-4cb7db232023" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:28:17 user nova-compute[72766]: DEBUG nova.network.neutron [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:28:17 user nova-compute[72766]: DEBUG nova.compute.manager [req-9d2c93ca-262c-4542-88ec-b499256ae203 req-3bac748a-ef6d-42d8-9095-29a064a692d4 service nova] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Received event network-changed-eaa457f1-6ef8-4621-ab04-e313204b24fa {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:28:17 user nova-compute[72766]: DEBUG nova.compute.manager [req-9d2c93ca-262c-4542-88ec-b499256ae203 req-3bac748a-ef6d-42d8-9095-29a064a692d4 service nova] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Refreshing instance network info cache due to event network-changed-eaa457f1-6ef8-4621-ab04-e313204b24fa. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:28:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9d2c93ca-262c-4542-88ec-b499256ae203 req-3bac748a-ef6d-42d8-9095-29a064a692d4 service nova] Acquiring lock "refresh_cache-a87649f2-475b-410f-b7cd-4cb7db232023" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:28:17 user nova-compute[72766]: DEBUG nova.network.neutron [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 23:28:18 user nova-compute[72766]: DEBUG nova.network.neutron [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Updating instance_info_cache with network_info: [{"id": "eaa457f1-6ef8-4621-ab04-e313204b24fa", "address": "fa:16:3e:b9:d7:35", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa457f1-6e", "ovs_interfaceid": "eaa457f1-6ef8-4621-ab04-e313204b24fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:28:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Releasing lock "refresh_cache-a87649f2-475b-410f-b7cd-4cb7db232023" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:28:18 user nova-compute[72766]: DEBUG nova.compute.manager [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Instance network_info: |[{"id": "eaa457f1-6ef8-4621-ab04-e313204b24fa", "address": "fa:16:3e:b9:d7:35", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa457f1-6e", "ovs_interfaceid": "eaa457f1-6ef8-4621-ab04-e313204b24fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 23:28:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9d2c93ca-262c-4542-88ec-b499256ae203 req-3bac748a-ef6d-42d8-9095-29a064a692d4 service nova] Acquired lock "refresh_cache-a87649f2-475b-410f-b7cd-4cb7db232023" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:28:18 user nova-compute[72766]: DEBUG nova.network.neutron [req-9d2c93ca-262c-4542-88ec-b499256ae203 req-3bac748a-ef6d-42d8-9095-29a064a692d4 service nova] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Refreshing network info cache for port eaa457f1-6ef8-4621-ab04-e313204b24fa {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:28:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:18 user nova-compute[72766]: DEBUG nova.compute.manager [req-8569215f-2df0-407e-b339-3556188ecf3f req-ffd6e4e7-a06d-4270-ba06-d360b6ae90cc service nova] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Received event network-vif-plugged-3f64a69a-f0a6-4815-ac3b-55de6f80c83c {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:28:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8569215f-2df0-407e-b339-3556188ecf3f req-ffd6e4e7-a06d-4270-ba06-d360b6ae90cc service nova] Acquiring lock "a31f7f11-fdd1-4e48-a275-78d6ad02224b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:28:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8569215f-2df0-407e-b339-3556188ecf3f req-ffd6e4e7-a06d-4270-ba06-d360b6ae90cc service nova] Lock "a31f7f11-fdd1-4e48-a275-78d6ad02224b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:28:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8569215f-2df0-407e-b339-3556188ecf3f req-ffd6e4e7-a06d-4270-ba06-d360b6ae90cc service nova] Lock "a31f7f11-fdd1-4e48-a275-78d6ad02224b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.010s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:28:18 user nova-compute[72766]: DEBUG nova.compute.manager [req-8569215f-2df0-407e-b339-3556188ecf3f req-ffd6e4e7-a06d-4270-ba06-d360b6ae90cc service nova] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] No waiting events found dispatching network-vif-plugged-3f64a69a-f0a6-4815-ac3b-55de6f80c83c {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:28:18 user nova-compute[72766]: WARNING nova.compute.manager [req-8569215f-2df0-407e-b339-3556188ecf3f req-ffd6e4e7-a06d-4270-ba06-d360b6ae90cc service nova] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Received unexpected event network-vif-plugged-3f64a69a-f0a6-4815-ac3b-55de6f80c83c for instance with vm_state building and task_state spawning.
Aug 14 23:28:18 user nova-compute[72766]: DEBUG nova.network.neutron [req-9d2c93ca-262c-4542-88ec-b499256ae203 req-3bac748a-ef6d-42d8-9095-29a064a692d4 service nova] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Updated VIF entry in instance network info cache for port eaa457f1-6ef8-4621-ab04-e313204b24fa. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:28:18 user nova-compute[72766]: DEBUG nova.network.neutron [req-9d2c93ca-262c-4542-88ec-b499256ae203 req-3bac748a-ef6d-42d8-9095-29a064a692d4 service nova] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Updating instance_info_cache with network_info: [{"id": "eaa457f1-6ef8-4621-ab04-e313204b24fa", "address": "fa:16:3e:b9:d7:35", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa457f1-6e", "ovs_interfaceid": "eaa457f1-6ef8-4621-ab04-e313204b24fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:28:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9d2c93ca-262c-4542-88ec-b499256ae203 req-3bac748a-ef6d-42d8-9095-29a064a692d4 service nova] Releasing lock "refresh_cache-a87649f2-475b-410f-b7cd-4cb7db232023" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:28:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:20 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692055700.3476577, a31f7f11-fdd1-4e48-a275-78d6ad02224b => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:28:20 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] VM Resumed (Lifecycle Event)
Aug 14 23:28:20 user nova-compute[72766]: DEBUG nova.compute.manager [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:28:20 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 23:28:20 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Instance spawned successfully.
Aug 14 23:28:20 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 23:28:20 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:28:20 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:28:20 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:28:20 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:28:20 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:28:20 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:28:20 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:28:20 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:28:20 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:28:20 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692055700.3492842, a31f7f11-fdd1-4e48-a275-78d6ad02224b => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:28:20 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] VM Started (Lifecycle Event)
Aug 14 23:28:20 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:28:20 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:28:20 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:28:20 user nova-compute[72766]: DEBUG nova.compute.manager [req-061da147-aa48-4632-836c-77b47ead02bd req-adf4acbb-e500-4fa0-afc8-6d6a4fd2fbf4 service nova] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Received event network-vif-plugged-3f64a69a-f0a6-4815-ac3b-55de6f80c83c {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:28:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-061da147-aa48-4632-836c-77b47ead02bd req-adf4acbb-e500-4fa0-afc8-6d6a4fd2fbf4 service nova] Acquiring lock "a31f7f11-fdd1-4e48-a275-78d6ad02224b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:28:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-061da147-aa48-4632-836c-77b47ead02bd req-adf4acbb-e500-4fa0-afc8-6d6a4fd2fbf4 service nova] Lock "a31f7f11-fdd1-4e48-a275-78d6ad02224b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:28:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-061da147-aa48-4632-836c-77b47ead02bd req-adf4acbb-e500-4fa0-afc8-6d6a4fd2fbf4 service nova] Lock "a31f7f11-fdd1-4e48-a275-78d6ad02224b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:28:20 user nova-compute[72766]: DEBUG nova.compute.manager [req-061da147-aa48-4632-836c-77b47ead02bd req-adf4acbb-e500-4fa0-afc8-6d6a4fd2fbf4 service nova] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] No waiting events found dispatching network-vif-plugged-3f64a69a-f0a6-4815-ac3b-55de6f80c83c {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:28:20 user nova-compute[72766]: WARNING nova.compute.manager [req-061da147-aa48-4632-836c-77b47ead02bd req-adf4acbb-e500-4fa0-afc8-6d6a4fd2fbf4 service nova] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Received unexpected event network-vif-plugged-3f64a69a-f0a6-4815-ac3b-55de6f80c83c for instance with vm_state building and task_state spawning.
Aug 14 23:28:20 user nova-compute[72766]: INFO nova.compute.manager [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Took 5.74 seconds to spawn the instance on the hypervisor.
Aug 14 23:28:20 user nova-compute[72766]: DEBUG nova.compute.manager [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:28:20 user nova-compute[72766]: INFO nova.compute.manager [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Took 6.39 seconds to build instance.
Aug 14 23:28:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1e426953-954b-4541-aba7-80cd85ddcfdb tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "a31f7f11-fdd1-4e48-a275-78d6ad02224b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.494s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:28:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG nova.compute.manager [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 23:28:25 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Creating image(s)
Aug 14 23:28:25 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Did not create local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Ensure instance console log exists: /opt/stack/data/nova/instances/a87649f2-475b-410f-b7cd-4cb7db232023/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Start _get_guest_xml network_info=[{"id": "eaa457f1-6ef8-4621-ab04-e313204b24fa", "address": "fa:16:3e:b9:d7:35", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa457f1-6e", "ovs_interfaceid": "eaa457f1-6ef8-4621-ab04-e313204b24fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '0c103773-6c31-4225-8df8-cdedce0cf565', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'muFVWivH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a87649f2-475b-410f-b7cd-4cb7db232023', 'attached_at': '', 'detached_at': '', 'volume_id': '52e4fc71-e83e-49b1-b48b-aad06097b1e1', 'serial': '52e4fc71-e83e-49b1-b48b-aad06097b1e1'}, 'volume_type': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:28:25 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:28:25 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:28:25 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'muFVWivH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:28:25 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:28:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:28:25 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:28:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:28:25 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 23:28:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[68232b9c-ea85-4170-86a7-718679aac3ae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 23:28:25 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b870daeb-a382-4dc1-a7aa-5a1910f81a85]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1] added
Aug 14 23:28:25 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0459f04-ea7d-4d17-80f8-e77eaa81a24b]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67a2e1f-ac5c-448b-81fa-4c40428493bd]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v muFVWivH {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v muFVWivH" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9ca473-9e88-4f5f-a579-7efe00d3f0e4]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'muFVWivH'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2722df-0d0c-4608-94ea-39c123c5bb7f]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64d7990-98c1-483c-8b0f-49993f46dbd1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 23:28:25 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 23:28:25 user nova-compute[72766]:  {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:28:25 user nova-compute[72766]: WARNING os_brick.initiator.connectors.iscsi [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 23:28:25 user nova-compute[72766]: 
Aug 14 23:28:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea8849e-2f3d-467a-b7d4-9ec9a5246d2c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1, portal: 172.16.0.220,3260]
Aug 14 23:28:25 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1, portal: 172.16.0.220,3260] successful.
Aug 14 23:28:25 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bcd9bb-56f1-4387-8e91-75232fb692dd]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[f535ff01-347a-4b42-ad6b-85a654f3359c]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 (non-flash)
Aug 14 23:28:25 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 (non-flash)
Aug 14 23:28:25 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.241s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c59732-8279-432a-840f-ae8bdce7496b]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:28:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'muFVWivH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 23:28:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:28:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '23337303361626265', 'path': '/dev/sdb'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:28:26 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337303361626265', 'path': '/dev/sdb'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 23:28:26 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:28:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-141007425',display_name='tempest-TestVolumeBootPattern-server-141007425',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-141007425',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPvSbILRfrlJBoXiI6yAoEx23QxBOaut7EAv1f2wh2U36gaT4scPzMrBzJaFGwi3LSF0CotAN19+FTvGG2504Ya9pzKNYbrJtakJiRU4EWISkkDaslgouPorjyQ0mmkoOQ==',key_name='tempest-TestVolumeBootPattern-925108064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3c9f53727cc497c94516ff7fa1bbf4f',ramdisk_id='',reservation_id='r-trr8kt5n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-213280496',owner_user_name='tempest-TestVolumeBootPattern-213280496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:28:16Z,user_data=None,user_id='999390ac8e6240199c9a7484e234f3a7',uuid=a87649f2-475b-410f-b7cd-4cb7db232023,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eaa457f1-6ef8-4621-ab04-e313204b24fa", "address": "fa:16:3e:b9:d7:35", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa457f1-6e", "ovs_interfaceid": "eaa457f1-6ef8-4621-ab04-e313204b24fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:28:26 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Converting VIF {"id": "eaa457f1-6ef8-4621-ab04-e313204b24fa", "address": "fa:16:3e:b9:d7:35", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa457f1-6e", "ovs_interfaceid": "eaa457f1-6ef8-4621-ab04-e313204b24fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:28:26 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:d7:35,bridge_name='br-int',has_traffic_filtering=True,id=eaa457f1-6ef8-4621-ab04-e313204b24fa,network=Network(f418a384-bbac-4892-8e0f-c7af2e9464ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaa457f1-6e') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:28:26 user nova-compute[72766]: DEBUG nova.objects.instance [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lazy-loading 'pci_devices' on Instance uuid a87649f2-475b-410f-b7cd-4cb7db232023 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:28:26 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:28:26 user nova-compute[72766]:   <uuid>a87649f2-475b-410f-b7cd-4cb7db232023</uuid>
Aug 14 23:28:26 user nova-compute[72766]:   <name>instance-0000002a</name>
Aug 14 23:28:26 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:28:26 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:28:26 user nova-compute[72766]:   <metadata>
Aug 14 23:28:26 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:28:26 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:28:26 user nova-compute[72766]:       <nova:name>tempest-TestVolumeBootPattern-server-141007425</nova:name>
Aug 14 23:28:26 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:28:25</nova:creationTime>
Aug 14 23:28:26 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:28:26 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:28:26 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:28:26 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:28:26 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:28:26 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:28:26 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:28:26 user nova-compute[72766]:       <nova:owner>
Aug 14 23:28:26 user nova-compute[72766]:         <nova:user uuid="999390ac8e6240199c9a7484e234f3a7">tempest-TestVolumeBootPattern-213280496-project-member</nova:user>
Aug 14 23:28:26 user nova-compute[72766]:         <nova:project uuid="a3c9f53727cc497c94516ff7fa1bbf4f">tempest-TestVolumeBootPattern-213280496</nova:project>
Aug 14 23:28:26 user nova-compute[72766]:       </nova:owner>
Aug 14 23:28:26 user nova-compute[72766]:       <nova:ports>
Aug 14 23:28:26 user nova-compute[72766]:         <nova:port uuid="eaa457f1-6ef8-4621-ab04-e313204b24fa">
Aug 14 23:28:26 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 14 23:28:26 user nova-compute[72766]:         </nova:port>
Aug 14 23:28:26 user nova-compute[72766]:       </nova:ports>
Aug 14 23:28:26 user nova-compute[72766]:     </nova:instance>
Aug 14 23:28:26 user nova-compute[72766]:   </metadata>
Aug 14 23:28:26 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:28:26 user nova-compute[72766]:     <system>
Aug 14 23:28:26 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:28:26 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:28:26 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:28:26 user nova-compute[72766]:       <entry name="serial">a87649f2-475b-410f-b7cd-4cb7db232023</entry>
Aug 14 23:28:26 user nova-compute[72766]:       <entry name="uuid">a87649f2-475b-410f-b7cd-4cb7db232023</entry>
Aug 14 23:28:26 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:28:26 user nova-compute[72766]:     </system>
Aug 14 23:28:26 user nova-compute[72766]:   </sysinfo>
Aug 14 23:28:26 user nova-compute[72766]:   <os>
Aug 14 23:28:26 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:28:26 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:28:26 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:28:26 user nova-compute[72766]:   </os>
Aug 14 23:28:26 user nova-compute[72766]:   <features>
Aug 14 23:28:26 user nova-compute[72766]:     <acpi/>
Aug 14 23:28:26 user nova-compute[72766]:     <apic/>
Aug 14 23:28:26 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:28:26 user nova-compute[72766]:   </features>
Aug 14 23:28:26 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:28:26 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:28:26 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:28:26 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:28:26 user nova-compute[72766]:   </clock>
Aug 14 23:28:26 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:28:26 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:28:26 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:28:26 user nova-compute[72766]:   </cpu>
Aug 14 23:28:26 user nova-compute[72766]:   <devices>
Aug 14 23:28:26 user nova-compute[72766]:     <disk type="block" device="disk">
Aug 14 23:28:26 user nova-compute[72766]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:28:26 user nova-compute[72766]:       <source dev="/dev/sdb"/>
Aug 14 23:28:26 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:28:26 user nova-compute[72766]:       <serial>52e4fc71-e83e-49b1-b48b-aad06097b1e1</serial>
Aug 14 23:28:26 user nova-compute[72766]:     </disk>
Aug 14 23:28:26 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:28:26 user nova-compute[72766]:       <mac address="fa:16:3e:b9:d7:35"/>
Aug 14 23:28:26 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:28:26 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:28:26 user nova-compute[72766]:       <target dev="tapeaa457f1-6e"/>
Aug 14 23:28:26 user nova-compute[72766]:     </interface>
Aug 14 23:28:26 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:28:26 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/a87649f2-475b-410f-b7cd-4cb7db232023/console.log" append="off"/>
Aug 14 23:28:26 user nova-compute[72766]:     </serial>
Aug 14 23:28:26 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:28:26 user nova-compute[72766]:     <video>
Aug 14 23:28:26 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:28:26 user nova-compute[72766]:     </video>
Aug 14 23:28:26 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:28:26 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:28:26 user nova-compute[72766]:     </rng>
Aug 14 23:28:26 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:28:26 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:28:26 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:28:26 user nova-compute[72766]:     </memballoon>
Aug 14 23:28:26 user nova-compute[72766]:   </devices>
Aug 14 23:28:26 user nova-compute[72766]: </domain>
Aug 14 23:28:26 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:28:26 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:28:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-141007425',display_name='tempest-TestVolumeBootPattern-server-141007425',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-141007425',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPvSbILRfrlJBoXiI6yAoEx23QxBOaut7EAv1f2wh2U36gaT4scPzMrBzJaFGwi3LSF0CotAN19+FTvGG2504Ya9pzKNYbrJtakJiRU4EWISkkDaslgouPorjyQ0mmkoOQ==',key_name='tempest-TestVolumeBootPattern-925108064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3c9f53727cc497c94516ff7fa1bbf4f',ramdisk_id='',reservation_id='r-trr8kt5n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-213280496',owner_user_name='tempest-TestVolumeBootPattern-213280496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:28:16Z,user_data=None,user_id='999390ac8e6240199c9a7484e234f3a7',uuid=a87649f2-475b-410f-b7cd-4cb7db232023,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eaa457f1-6ef8-4621-ab04-e313204b24fa", "address": "fa:16:3e:b9:d7:35", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa457f1-6e", "ovs_interfaceid": "eaa457f1-6ef8-4621-ab04-e313204b24fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:28:26 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Converting VIF {"id": "eaa457f1-6ef8-4621-ab04-e313204b24fa", "address": "fa:16:3e:b9:d7:35", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa457f1-6e", "ovs_interfaceid": "eaa457f1-6ef8-4621-ab04-e313204b24fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:28:26 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:d7:35,bridge_name='br-int',has_traffic_filtering=True,id=eaa457f1-6ef8-4621-ab04-e313204b24fa,network=Network(f418a384-bbac-4892-8e0f-c7af2e9464ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaa457f1-6e') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:28:26 user nova-compute[72766]: DEBUG os_vif [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:d7:35,bridge_name='br-int',has_traffic_filtering=True,id=eaa457f1-6ef8-4621-ab04-e313204b24fa,network=Network(f418a384-bbac-4892-8e0f-c7af2e9464ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaa457f1-6e') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:28:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:28:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:28:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeaa457f1-6e, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:28:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeaa457f1-6e, col_values=(('external_ids', {'iface-id': 'eaa457f1-6ef8-4621-ab04-e313204b24fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:d7:35', 'vm-uuid': 'a87649f2-475b-410f-b7cd-4cb7db232023'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:28:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:28:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:26 user nova-compute[72766]: INFO os_vif [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:d7:35,bridge_name='br-int',has_traffic_filtering=True,id=eaa457f1-6ef8-4621-ab04-e313204b24fa,network=Network(f418a384-bbac-4892-8e0f-c7af2e9464ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaa457f1-6e')
Aug 14 23:28:26 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:28:26 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] No VIF found with MAC fa:16:3e:b9:d7:35, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:28:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:27 user nova-compute[72766]: DEBUG nova.compute.manager [req-cf9efdf1-774d-4016-97db-9fb47162f1bc req-e5f73e16-870b-434a-a41d-940ed2390ee0 service nova] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Received event network-vif-plugged-eaa457f1-6ef8-4621-ab04-e313204b24fa {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:28:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-cf9efdf1-774d-4016-97db-9fb47162f1bc req-e5f73e16-870b-434a-a41d-940ed2390ee0 service nova] Acquiring lock "a87649f2-475b-410f-b7cd-4cb7db232023-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:28:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-cf9efdf1-774d-4016-97db-9fb47162f1bc req-e5f73e16-870b-434a-a41d-940ed2390ee0 service nova] Lock "a87649f2-475b-410f-b7cd-4cb7db232023-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:28:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-cf9efdf1-774d-4016-97db-9fb47162f1bc req-e5f73e16-870b-434a-a41d-940ed2390ee0 service nova] Lock "a87649f2-475b-410f-b7cd-4cb7db232023-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:28:27 user nova-compute[72766]: DEBUG nova.compute.manager [req-cf9efdf1-774d-4016-97db-9fb47162f1bc req-e5f73e16-870b-434a-a41d-940ed2390ee0 service nova] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] No waiting events found dispatching network-vif-plugged-eaa457f1-6ef8-4621-ab04-e313204b24fa {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:28:27 user nova-compute[72766]: WARNING nova.compute.manager [req-cf9efdf1-774d-4016-97db-9fb47162f1bc req-e5f73e16-870b-434a-a41d-940ed2390ee0 service nova] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Received unexpected event network-vif-plugged-eaa457f1-6ef8-4621-ab04-e313204b24fa for instance with vm_state building and task_state spawning.
Aug 14 23:28:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:29 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692055709.7711332, a87649f2-475b-410f-b7cd-4cb7db232023 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:28:29 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] VM Resumed (Lifecycle Event)
Aug 14 23:28:29 user nova-compute[72766]: DEBUG nova.compute.manager [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:28:29 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 23:28:29 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Instance spawned successfully.
Aug 14 23:28:29 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 23:28:29 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:28:29 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:28:29 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:28:29 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:28:29 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:28:29 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:28:29 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:28:29 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:28:29 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:28:29 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692055709.7726576, a87649f2-475b-410f-b7cd-4cb7db232023 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:28:29 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] VM Started (Lifecycle Event)
Aug 14 23:28:29 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:28:29 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:28:29 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:28:29 user nova-compute[72766]: INFO nova.compute.manager [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Took 4.84 seconds to spawn the instance on the hypervisor.
Aug 14 23:28:29 user nova-compute[72766]: DEBUG nova.compute.manager [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:28:29 user nova-compute[72766]: DEBUG nova.compute.manager [req-f3546148-6fe4-4748-bda1-a8c62713a36a req-5f8ba326-ff4e-42f0-bdb1-594990e42254 service nova] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Received event network-vif-plugged-eaa457f1-6ef8-4621-ab04-e313204b24fa {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:28:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f3546148-6fe4-4748-bda1-a8c62713a36a req-5f8ba326-ff4e-42f0-bdb1-594990e42254 service nova] Acquiring lock "a87649f2-475b-410f-b7cd-4cb7db232023-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:28:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f3546148-6fe4-4748-bda1-a8c62713a36a req-5f8ba326-ff4e-42f0-bdb1-594990e42254 service nova] Lock "a87649f2-475b-410f-b7cd-4cb7db232023-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:28:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f3546148-6fe4-4748-bda1-a8c62713a36a req-5f8ba326-ff4e-42f0-bdb1-594990e42254 service nova] Lock "a87649f2-475b-410f-b7cd-4cb7db232023-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:28:29 user nova-compute[72766]: DEBUG nova.compute.manager [req-f3546148-6fe4-4748-bda1-a8c62713a36a req-5f8ba326-ff4e-42f0-bdb1-594990e42254 service nova] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] No waiting events found dispatching network-vif-plugged-eaa457f1-6ef8-4621-ab04-e313204b24fa {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:28:29 user nova-compute[72766]: WARNING nova.compute.manager [req-f3546148-6fe4-4748-bda1-a8c62713a36a req-5f8ba326-ff4e-42f0-bdb1-594990e42254 service nova] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Received unexpected event network-vif-plugged-eaa457f1-6ef8-4621-ab04-e313204b24fa for instance with vm_state building and task_state spawning.
Aug 14 23:28:29 user nova-compute[72766]: INFO nova.compute.manager [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Took 14.51 seconds to build instance.
Aug 14 23:28:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-cdf22387-912d-4e0e-97db-6484ddf9cc97 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "a87649f2-475b-410f-b7cd-4cb7db232023" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.654s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:28:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:36 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:37 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:28:39 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:41 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:28:41 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:28:41 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Didn't find any instances for network info cache update. {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 23:28:42 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:28:42 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:28:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:28:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:28:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:28:42 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:28:42 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:28:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:28:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:28:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:28:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a31f7f11-fdd1-4e48-a275-78d6ad02224b/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:28:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a31f7f11-fdd1-4e48-a275-78d6ad02224b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:28:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a31f7f11-fdd1-4e48-a275-78d6ad02224b/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:28:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a31f7f11-fdd1-4e48-a275-78d6ad02224b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:28:43 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:28:43 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:28:43 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:28:43 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=8290MB free_disk=25.286029815673828GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:28:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:28:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:28:44 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance cbcf7851-e6f7-4f46-97cc-d773286ccddf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:28:44 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance a31f7f11-fdd1-4e48-a275-78d6ad02224b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:28:44 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance a87649f2-475b-410f-b7cd-4cb7db232023 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:28:44 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:28:44 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:28:44 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:28:44 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:28:44 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:28:44 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.227s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:28:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:47 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:28:47 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:28:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:50 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:28:50 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:28:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:52 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:28:52 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:28:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Acquiring lock "5965063c-8d1b-41d0-8c22-7d5b54925f94" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:28:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "5965063c-8d1b-41d0-8c22-7d5b54925f94" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:28:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 23:28:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:28:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:28:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 23:28:54 user nova-compute[72766]: INFO nova.compute.claims [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Claim successful on node user
Aug 14 23:28:54 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:28:54 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:28:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.231s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:28:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 23:28:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 23:28:54 user nova-compute[72766]: DEBUG nova.network.neutron [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 23:28:54 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 23:28:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 23:28:54 user nova-compute[72766]: DEBUG nova.policy [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a2b1f48b1a594010befb4da227f8b473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd47fb3d5eb408aa751d1d49f198906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 23:28:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 23:28:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 23:28:54 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Creating image(s)
Aug 14 23:28:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Acquiring lock "/opt/stack/data/nova/instances/5965063c-8d1b-41d0-8c22-7d5b54925f94/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:28:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "/opt/stack/data/nova/instances/5965063c-8d1b-41d0-8c22-7d5b54925f94/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:28:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "/opt/stack/data/nova/instances/5965063c-8d1b-41d0-8c22-7d5b54925f94/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:28:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Acquiring lock "15da94781a1b837df10535f333b7f105c95cab67" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:28:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "15da94781a1b837df10535f333b7f105c95cab67" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:28:55 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15da94781a1b837df10535f333b7f105c95cab67.part --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:28:55 user nova-compute[72766]: DEBUG nova.network.neutron [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Successfully created port: 09bcfc13-ace1-4e60-8ed3-2a3b1a09e957 {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 23:28:55 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15da94781a1b837df10535f333b7f105c95cab67.part --force-share --output=json" returned: 0 in 0.212s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:28:55 user nova-compute[72766]: DEBUG nova.virt.images [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] e78205bc-79cc-4112-a712-fbea0fc21162 was qcow2, converting to raw {{(pid=72766) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 23:28:55 user nova-compute[72766]: DEBUG nova.privsep.utils [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72766) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 23:28:55 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/15da94781a1b837df10535f333b7f105c95cab67.part /opt/stack/data/nova/instances/_base/15da94781a1b837df10535f333b7f105c95cab67.converted {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:28:55 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/15da94781a1b837df10535f333b7f105c95cab67.part /opt/stack/data/nova/instances/_base/15da94781a1b837df10535f333b7f105c95cab67.converted" returned: 0 in 0.279s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:28:55 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15da94781a1b837df10535f333b7f105c95cab67.converted --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:28:55 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15da94781a1b837df10535f333b7f105c95cab67.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:28:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "15da94781a1b837df10535f333b7f105c95cab67" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.098s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:28:55 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15da94781a1b837df10535f333b7f105c95cab67 --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15da94781a1b837df10535f333b7f105c95cab67 --force-share --output=json" returned: 0 in 0.180s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Acquiring lock "15da94781a1b837df10535f333b7f105c95cab67" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "15da94781a1b837df10535f333b7f105c95cab67" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15da94781a1b837df10535f333b7f105c95cab67 --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG nova.network.neutron [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Successfully updated port: 09bcfc13-ace1-4e60-8ed3-2a3b1a09e957 {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Acquiring lock "refresh_cache-5965063c-8d1b-41d0-8c22-7d5b54925f94" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Acquired lock "refresh_cache-5965063c-8d1b-41d0-8c22-7d5b54925f94" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG nova.network.neutron [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG nova.compute.manager [req-93cc191e-c8f9-4420-a3c5-1d6f659cce56 req-3ab6bc12-537d-4941-871f-f50dd8180191 service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Received event network-changed-09bcfc13-ace1-4e60-8ed3-2a3b1a09e957 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG nova.compute.manager [req-93cc191e-c8f9-4420-a3c5-1d6f659cce56 req-3ab6bc12-537d-4941-871f-f50dd8180191 service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Refreshing instance network info cache due to event network-changed-09bcfc13-ace1-4e60-8ed3-2a3b1a09e957. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-93cc191e-c8f9-4420-a3c5-1d6f659cce56 req-3ab6bc12-537d-4941-871f-f50dd8180191 service nova] Acquiring lock "refresh_cache-5965063c-8d1b-41d0-8c22-7d5b54925f94" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG nova.network.neutron [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15da94781a1b837df10535f333b7f105c95cab67 --force-share --output=json" returned: 0 in 0.180s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15da94781a1b837df10535f333b7f105c95cab67,backing_fmt=raw /opt/stack/data/nova/instances/5965063c-8d1b-41d0-8c22-7d5b54925f94/disk 1073741824 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15da94781a1b837df10535f333b7f105c95cab67,backing_fmt=raw /opt/stack/data/nova/instances/5965063c-8d1b-41d0-8c22-7d5b54925f94/disk 1073741824" returned: 0 in 0.174s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "15da94781a1b837df10535f333b7f105c95cab67" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.358s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15da94781a1b837df10535f333b7f105c95cab67 --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15da94781a1b837df10535f333b7f105c95cab67 --force-share --output=json" returned: 0 in 0.180s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5965063c-8d1b-41d0-8c22-7d5b54925f94/disk. size=1073741824 {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5965063c-8d1b-41d0-8c22-7d5b54925f94/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG nova.network.neutron [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Updating instance_info_cache with network_info: [{"id": "09bcfc13-ace1-4e60-8ed3-2a3b1a09e957", "address": "fa:16:3e:e8:a7:0c", "network": {"id": "c7828c64-4d71-4c57-8df8-bb4524d9b9cb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-160068070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbd47fb3d5eb408aa751d1d49f198906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09bcfc13-ac", "ovs_interfaceid": "09bcfc13-ace1-4e60-8ed3-2a3b1a09e957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Releasing lock "refresh_cache-5965063c-8d1b-41d0-8c22-7d5b54925f94" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG nova.compute.manager [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Instance network_info: |[{"id": "09bcfc13-ace1-4e60-8ed3-2a3b1a09e957", "address": "fa:16:3e:e8:a7:0c", "network": {"id": "c7828c64-4d71-4c57-8df8-bb4524d9b9cb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-160068070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbd47fb3d5eb408aa751d1d49f198906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09bcfc13-ac", "ovs_interfaceid": "09bcfc13-ace1-4e60-8ed3-2a3b1a09e957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-93cc191e-c8f9-4420-a3c5-1d6f659cce56 req-3ab6bc12-537d-4941-871f-f50dd8180191 service nova] Acquired lock "refresh_cache-5965063c-8d1b-41d0-8c22-7d5b54925f94" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG nova.network.neutron [req-93cc191e-c8f9-4420-a3c5-1d6f659cce56 req-3ab6bc12-537d-4941-871f-f50dd8180191 service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Refreshing network info cache for port 09bcfc13-ace1-4e60-8ed3-2a3b1a09e957 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5965063c-8d1b-41d0-8c22-7d5b54925f94/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Cannot resize image /opt/stack/data/nova/instances/5965063c-8d1b-41d0-8c22-7d5b54925f94/disk to a smaller size. {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG nova.objects.instance [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lazy-loading 'migration_context' on Instance uuid 5965063c-8d1b-41d0-8c22-7d5b54925f94 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Ensure instance console log exists: /opt/stack/data/nova/instances/5965063c-8d1b-41d0-8c22-7d5b54925f94/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Start _get_guest_xml network_info=[{"id": "09bcfc13-ace1-4e60-8ed3-2a3b1a09e957", "address": "fa:16:3e:e8:a7:0c", "network": {"id": "c7828c64-4d71-4c57-8df8-bb4524d9b9cb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-160068070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbd47fb3d5eb408aa751d1d49f198906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09bcfc13-ac", "ovs_interfaceid": "09bcfc13-ace1-4e60-8ed3-2a3b1a09e957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T23:28:52Z,direct_url=<?>,disk_format='qcow2',id=e78205bc-79cc-4112-a712-fbea0fc21162,min_disk=0,min_ram=0,name='tempest-scenario-img--1534821683',owner='cbd47fb3d5eb408aa751d1d49f198906',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T23:28:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'e78205bc-79cc-4112-a712-fbea0fc21162'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:28:56 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:28:56 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:28:56 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T23:28:52Z,direct_url=<?>,disk_format='qcow2',id=e78205bc-79cc-4112-a712-fbea0fc21162,min_disk=0,min_ram=0,name='tempest-scenario-img--1534821683',owner='cbd47fb3d5eb408aa751d1d49f198906',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T23:28:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:28:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-550732363',display_name='tempest-TestMinimumBasicScenario-server-550732363',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-550732363',id=43,image_ref='e78205bc-79cc-4112-a712-fbea0fc21162',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBGPLpKpF5z05Eket3b6BVraB4mg9MjCuMlglJn7NYc6zoC1MJOaMkiuFix12gnjZLPz8Tt1GsD+fJsA3akyP/lx4Dxx04+Be5uUfpbx5Iu1WmkbxlTWUu51D/t5upfgg==',key_name='tempest-TestMinimumBasicScenario-1117827024',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cbd47fb3d5eb408aa751d1d49f198906',ramdisk_id='',reservation_id='r-2x8pvbxc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e78205bc-79cc-4112-a712-fbea0fc21162',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1491062679',owner_user_name='tempest-TestMinimumBasicScenario-1491062679-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:28:55Z,user_data=None,user_id='a2b1f48b1a594010befb4da227f8b473',uuid=5965063c-8d1b-41d0-8c22-7d5b54925f94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09bcfc13-ace1-4e60-8ed3-2a3b1a09e957", "address": "fa:16:3e:e8:a7:0c", "network": {"id": "c7828c64-4d71-4c57-8df8-bb4524d9b9cb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-160068070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbd47fb3d5eb408aa751d1d49f198906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09bcfc13-ac", "ovs_interfaceid": "09bcfc13-ace1-4e60-8ed3-2a3b1a09e957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Converting VIF {"id": "09bcfc13-ace1-4e60-8ed3-2a3b1a09e957", "address": "fa:16:3e:e8:a7:0c", "network": {"id": "c7828c64-4d71-4c57-8df8-bb4524d9b9cb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-160068070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbd47fb3d5eb408aa751d1d49f198906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09bcfc13-ac", "ovs_interfaceid": "09bcfc13-ace1-4e60-8ed3-2a3b1a09e957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:a7:0c,bridge_name='br-int',has_traffic_filtering=True,id=09bcfc13-ace1-4e60-8ed3-2a3b1a09e957,network=Network(c7828c64-4d71-4c57-8df8-bb4524d9b9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09bcfc13-ac') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG nova.objects.instance [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lazy-loading 'pci_devices' on Instance uuid 5965063c-8d1b-41d0-8c22-7d5b54925f94 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:28:56 user nova-compute[72766]:   <uuid>5965063c-8d1b-41d0-8c22-7d5b54925f94</uuid>
Aug 14 23:28:56 user nova-compute[72766]:   <name>instance-0000002b</name>
Aug 14 23:28:56 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:28:56 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:28:56 user nova-compute[72766]:   <metadata>
Aug 14 23:28:56 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:28:56 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:28:56 user nova-compute[72766]:       <nova:name>tempest-TestMinimumBasicScenario-server-550732363</nova:name>
Aug 14 23:28:56 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:28:56</nova:creationTime>
Aug 14 23:28:56 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:28:56 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:28:56 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:28:56 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:28:56 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:28:56 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:28:56 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:28:56 user nova-compute[72766]:       <nova:owner>
Aug 14 23:28:56 user nova-compute[72766]:         <nova:user uuid="a2b1f48b1a594010befb4da227f8b473">tempest-TestMinimumBasicScenario-1491062679-project-member</nova:user>
Aug 14 23:28:56 user nova-compute[72766]:         <nova:project uuid="cbd47fb3d5eb408aa751d1d49f198906">tempest-TestMinimumBasicScenario-1491062679</nova:project>
Aug 14 23:28:56 user nova-compute[72766]:       </nova:owner>
Aug 14 23:28:56 user nova-compute[72766]:       <nova:root type="image" uuid="e78205bc-79cc-4112-a712-fbea0fc21162"/>
Aug 14 23:28:56 user nova-compute[72766]:       <nova:ports>
Aug 14 23:28:56 user nova-compute[72766]:         <nova:port uuid="09bcfc13-ace1-4e60-8ed3-2a3b1a09e957">
Aug 14 23:28:56 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 23:28:56 user nova-compute[72766]:         </nova:port>
Aug 14 23:28:56 user nova-compute[72766]:       </nova:ports>
Aug 14 23:28:56 user nova-compute[72766]:     </nova:instance>
Aug 14 23:28:56 user nova-compute[72766]:   </metadata>
Aug 14 23:28:56 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:28:56 user nova-compute[72766]:     <system>
Aug 14 23:28:56 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:28:56 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:28:56 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:28:56 user nova-compute[72766]:       <entry name="serial">5965063c-8d1b-41d0-8c22-7d5b54925f94</entry>
Aug 14 23:28:56 user nova-compute[72766]:       <entry name="uuid">5965063c-8d1b-41d0-8c22-7d5b54925f94</entry>
Aug 14 23:28:56 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:28:56 user nova-compute[72766]:     </system>
Aug 14 23:28:56 user nova-compute[72766]:   </sysinfo>
Aug 14 23:28:56 user nova-compute[72766]:   <os>
Aug 14 23:28:56 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:28:56 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:28:56 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:28:56 user nova-compute[72766]:   </os>
Aug 14 23:28:56 user nova-compute[72766]:   <features>
Aug 14 23:28:56 user nova-compute[72766]:     <acpi/>
Aug 14 23:28:56 user nova-compute[72766]:     <apic/>
Aug 14 23:28:56 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:28:56 user nova-compute[72766]:   </features>
Aug 14 23:28:56 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:28:56 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:28:56 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:28:56 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:28:56 user nova-compute[72766]:   </clock>
Aug 14 23:28:56 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:28:56 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:28:56 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:28:56 user nova-compute[72766]:   </cpu>
Aug 14 23:28:56 user nova-compute[72766]:   <devices>
Aug 14 23:28:56 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 23:28:56 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 23:28:56 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/5965063c-8d1b-41d0-8c22-7d5b54925f94/disk"/>
Aug 14 23:28:56 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:28:56 user nova-compute[72766]:     </disk>
Aug 14 23:28:56 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:28:56 user nova-compute[72766]:       <mac address="fa:16:3e:e8:a7:0c"/>
Aug 14 23:28:56 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:28:56 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:28:56 user nova-compute[72766]:       <target dev="tap09bcfc13-ac"/>
Aug 14 23:28:56 user nova-compute[72766]:     </interface>
Aug 14 23:28:56 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:28:56 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/5965063c-8d1b-41d0-8c22-7d5b54925f94/console.log" append="off"/>
Aug 14 23:28:56 user nova-compute[72766]:     </serial>
Aug 14 23:28:56 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:28:56 user nova-compute[72766]:     <video>
Aug 14 23:28:56 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:28:56 user nova-compute[72766]:     </video>
Aug 14 23:28:56 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:28:56 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:28:56 user nova-compute[72766]:     </rng>
Aug 14 23:28:56 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:28:56 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:28:56 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:28:56 user nova-compute[72766]:     </memballoon>
Aug 14 23:28:56 user nova-compute[72766]:   </devices>
Aug 14 23:28:56 user nova-compute[72766]: </domain>
Aug 14 23:28:56 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:28:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-550732363',display_name='tempest-TestMinimumBasicScenario-server-550732363',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-550732363',id=43,image_ref='e78205bc-79cc-4112-a712-fbea0fc21162',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBGPLpKpF5z05Eket3b6BVraB4mg9MjCuMlglJn7NYc6zoC1MJOaMkiuFix12gnjZLPz8Tt1GsD+fJsA3akyP/lx4Dxx04+Be5uUfpbx5Iu1WmkbxlTWUu51D/t5upfgg==',key_name='tempest-TestMinimumBasicScenario-1117827024',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cbd47fb3d5eb408aa751d1d49f198906',ramdisk_id='',reservation_id='r-2x8pvbxc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e78205bc-79cc-4112-a712-fbea0fc21162',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1491062679',owner_user_name='tempest-TestMinimumBasicScenario-1491062679-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:28:55Z,user_data=None,user_id='a2b1f48b1a594010befb4da227f8b473',uuid=5965063c-8d1b-41d0-8c22-7d5b54925f94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09bcfc13-ace1-4e60-8ed3-2a3b1a09e957", "address": "fa:16:3e:e8:a7:0c", "network": {"id": "c7828c64-4d71-4c57-8df8-bb4524d9b9cb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-160068070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbd47fb3d5eb408aa751d1d49f198906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09bcfc13-ac", "ovs_interfaceid": "09bcfc13-ace1-4e60-8ed3-2a3b1a09e957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Converting VIF {"id": "09bcfc13-ace1-4e60-8ed3-2a3b1a09e957", "address": "fa:16:3e:e8:a7:0c", "network": {"id": "c7828c64-4d71-4c57-8df8-bb4524d9b9cb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-160068070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbd47fb3d5eb408aa751d1d49f198906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09bcfc13-ac", "ovs_interfaceid": "09bcfc13-ace1-4e60-8ed3-2a3b1a09e957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:a7:0c,bridge_name='br-int',has_traffic_filtering=True,id=09bcfc13-ace1-4e60-8ed3-2a3b1a09e957,network=Network(c7828c64-4d71-4c57-8df8-bb4524d9b9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09bcfc13-ac') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG os_vif [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:a7:0c,bridge_name='br-int',has_traffic_filtering=True,id=09bcfc13-ace1-4e60-8ed3-2a3b1a09e957,network=Network(c7828c64-4d71-4c57-8df8-bb4524d9b9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09bcfc13-ac') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09bcfc13-ac, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap09bcfc13-ac, col_values=(('external_ids', {'iface-id': '09bcfc13-ace1-4e60-8ed3-2a3b1a09e957', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:a7:0c', 'vm-uuid': '5965063c-8d1b-41d0-8c22-7d5b54925f94'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:56 user nova-compute[72766]: INFO os_vif [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:a7:0c,bridge_name='br-int',has_traffic_filtering=True,id=09bcfc13-ace1-4e60-8ed3-2a3b1a09e957,network=Network(c7828c64-4d71-4c57-8df8-bb4524d9b9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09bcfc13-ac')
Aug 14 23:28:56 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:28:56 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] No VIF found with MAC fa:16:3e:e8:a7:0c, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:28:57 user nova-compute[72766]: DEBUG nova.network.neutron [req-93cc191e-c8f9-4420-a3c5-1d6f659cce56 req-3ab6bc12-537d-4941-871f-f50dd8180191 service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Updated VIF entry in instance network info cache for port 09bcfc13-ace1-4e60-8ed3-2a3b1a09e957. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:28:57 user nova-compute[72766]: DEBUG nova.network.neutron [req-93cc191e-c8f9-4420-a3c5-1d6f659cce56 req-3ab6bc12-537d-4941-871f-f50dd8180191 service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Updating instance_info_cache with network_info: [{"id": "09bcfc13-ace1-4e60-8ed3-2a3b1a09e957", "address": "fa:16:3e:e8:a7:0c", "network": {"id": "c7828c64-4d71-4c57-8df8-bb4524d9b9cb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-160068070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbd47fb3d5eb408aa751d1d49f198906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09bcfc13-ac", "ovs_interfaceid": "09bcfc13-ace1-4e60-8ed3-2a3b1a09e957", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:28:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-93cc191e-c8f9-4420-a3c5-1d6f659cce56 req-3ab6bc12-537d-4941-871f-f50dd8180191 service nova] Releasing lock "refresh_cache-5965063c-8d1b-41d0-8c22-7d5b54925f94" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:28:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:58 user nova-compute[72766]: DEBUG nova.compute.manager [req-8d17a5a0-e655-4864-a9ed-06429c7b797d req-d6c4805e-fe4b-4d66-8335-0e988b7928a7 service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Received event network-vif-plugged-09bcfc13-ace1-4e60-8ed3-2a3b1a09e957 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:28:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8d17a5a0-e655-4864-a9ed-06429c7b797d req-d6c4805e-fe4b-4d66-8335-0e988b7928a7 service nova] Acquiring lock "5965063c-8d1b-41d0-8c22-7d5b54925f94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:28:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8d17a5a0-e655-4864-a9ed-06429c7b797d req-d6c4805e-fe4b-4d66-8335-0e988b7928a7 service nova] Lock "5965063c-8d1b-41d0-8c22-7d5b54925f94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:28:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8d17a5a0-e655-4864-a9ed-06429c7b797d req-d6c4805e-fe4b-4d66-8335-0e988b7928a7 service nova] Lock "5965063c-8d1b-41d0-8c22-7d5b54925f94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:28:58 user nova-compute[72766]: DEBUG nova.compute.manager [req-8d17a5a0-e655-4864-a9ed-06429c7b797d req-d6c4805e-fe4b-4d66-8335-0e988b7928a7 service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] No waiting events found dispatching network-vif-plugged-09bcfc13-ace1-4e60-8ed3-2a3b1a09e957 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:28:58 user nova-compute[72766]: WARNING nova.compute.manager [req-8d17a5a0-e655-4864-a9ed-06429c7b797d req-d6c4805e-fe4b-4d66-8335-0e988b7928a7 service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Received unexpected event network-vif-plugged-09bcfc13-ace1-4e60-8ed3-2a3b1a09e957 for instance with vm_state building and task_state spawning.
Aug 14 23:28:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:28:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:29:00 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692055740.2372675, 5965063c-8d1b-41d0-8c22-7d5b54925f94 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:29:00 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] VM Resumed (Lifecycle Event)
Aug 14 23:29:00 user nova-compute[72766]: DEBUG nova.compute.manager [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:29:00 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 23:29:00 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Instance spawned successfully.
Aug 14 23:29:00 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 23:29:00 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:29:00 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:29:00 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:29:00 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:29:00 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:29:00 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:29:00 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:29:00 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:29:00 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:29:00 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692055740.2426069, 5965063c-8d1b-41d0-8c22-7d5b54925f94 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:29:00 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] VM Started (Lifecycle Event)
Aug 14 23:29:00 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:29:00 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:29:00 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:29:00 user nova-compute[72766]: INFO nova.compute.manager [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Took 5.66 seconds to spawn the instance on the hypervisor.
Aug 14 23:29:00 user nova-compute[72766]: DEBUG nova.compute.manager [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:29:00 user nova-compute[72766]: DEBUG nova.compute.manager [req-d8a4976a-8843-48e1-827e-0f1c1c7db98c req-d5b6239a-ab43-4377-88e9-ffc6d6f3f4fa service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Received event network-vif-plugged-09bcfc13-ace1-4e60-8ed3-2a3b1a09e957 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:29:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d8a4976a-8843-48e1-827e-0f1c1c7db98c req-d5b6239a-ab43-4377-88e9-ffc6d6f3f4fa service nova] Acquiring lock "5965063c-8d1b-41d0-8c22-7d5b54925f94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:29:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d8a4976a-8843-48e1-827e-0f1c1c7db98c req-d5b6239a-ab43-4377-88e9-ffc6d6f3f4fa service nova] Lock "5965063c-8d1b-41d0-8c22-7d5b54925f94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:29:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d8a4976a-8843-48e1-827e-0f1c1c7db98c req-d5b6239a-ab43-4377-88e9-ffc6d6f3f4fa service nova] Lock "5965063c-8d1b-41d0-8c22-7d5b54925f94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:29:00 user nova-compute[72766]: DEBUG nova.compute.manager [req-d8a4976a-8843-48e1-827e-0f1c1c7db98c req-d5b6239a-ab43-4377-88e9-ffc6d6f3f4fa service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] No waiting events found dispatching network-vif-plugged-09bcfc13-ace1-4e60-8ed3-2a3b1a09e957 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:29:00 user nova-compute[72766]: WARNING nova.compute.manager [req-d8a4976a-8843-48e1-827e-0f1c1c7db98c req-d5b6239a-ab43-4377-88e9-ffc6d6f3f4fa service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Received unexpected event network-vif-plugged-09bcfc13-ace1-4e60-8ed3-2a3b1a09e957 for instance with vm_state building and task_state spawning.
Aug 14 23:29:00 user nova-compute[72766]: INFO nova.compute.manager [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Took 6.19 seconds to build instance.
Aug 14 23:29:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ba9e1362-3dbd-4065-8467-947bb8803eed tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "5965063c-8d1b-41d0-8c22-7d5b54925f94" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.311s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:29:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:29:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:29:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:29:06 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:29:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:29:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:29:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:29:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:29:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:29:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:29:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:29:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:29:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:29:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:29:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:29:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:29:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:29:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:29:36 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:29:37 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:29:41 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:29:41 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:29:41 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Rebuilding the list of instances to heal {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 23:29:41 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-cbcf7851-e6f7-4f46-97cc-d773286ccddf" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:29:41 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-cbcf7851-e6f7-4f46-97cc-d773286ccddf" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:29:41 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:29:41 user nova-compute[72766]: DEBUG nova.objects.instance [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lazy-loading 'info_cache' on Instance uuid cbcf7851-e6f7-4f46-97cc-d773286ccddf {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:29:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:29:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:29:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:29:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:29:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:29:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:29:42 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Updating instance_info_cache with network_info: [{"id": "8f65f8f0-60fe-4fdb-af66-424a85b12caf", "address": "fa:16:3e:70:30:66", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f65f8f0-60", "ovs_interfaceid": "8f65f8f0-60fe-4fdb-af66-424a85b12caf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:29:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-cbcf7851-e6f7-4f46-97cc-d773286ccddf" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:29:42 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:29:44 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:29:44 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:29:44 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:29:44 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:29:44 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:29:44 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:29:44 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:29:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:29:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:29:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:29:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a31f7f11-fdd1-4e48-a275-78d6ad02224b/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:29:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a31f7f11-fdd1-4e48-a275-78d6ad02224b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:29:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a31f7f11-fdd1-4e48-a275-78d6ad02224b/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:29:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a31f7f11-fdd1-4e48-a275-78d6ad02224b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:29:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5965063c-8d1b-41d0-8c22-7d5b54925f94/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:29:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5965063c-8d1b-41d0-8c22-7d5b54925f94/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:29:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5965063c-8d1b-41d0-8c22-7d5b54925f94/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:29:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5965063c-8d1b-41d0-8c22-7d5b54925f94/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:29:45 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:29:46 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:29:46 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:29:46 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=8320MB free_disk=25.23257064819336GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:29:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:29:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:29:46 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance cbcf7851-e6f7-4f46-97cc-d773286ccddf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:29:46 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance a31f7f11-fdd1-4e48-a275-78d6ad02224b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:29:46 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance a87649f2-475b-410f-b7cd-4cb7db232023 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:29:46 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 5965063c-8d1b-41d0-8c22-7d5b54925f94 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:29:46 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:29:46 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:29:46 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:29:46 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:29:46 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:29:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.297s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:29:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:29:48 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:29:48 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:29:49 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:29:50 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:29:51 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:29:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:29:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:29:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:29:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:29:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:29:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:29:54 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:29:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:29:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:30:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:30:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:30:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:30:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:30:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:30:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:30:05 user nova-compute[72766]: DEBUG nova.compute.manager [req-2611b707-4b86-499e-84ed-5545917a59c2 req-6bb83b6d-0f3f-41d5-8f02-c6b255f6574a service nova] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Received event network-changed-3f64a69a-f0a6-4815-ac3b-55de6f80c83c {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:30:05 user nova-compute[72766]: DEBUG nova.compute.manager [req-2611b707-4b86-499e-84ed-5545917a59c2 req-6bb83b6d-0f3f-41d5-8f02-c6b255f6574a service nova] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Refreshing instance network info cache due to event network-changed-3f64a69a-f0a6-4815-ac3b-55de6f80c83c. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:30:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2611b707-4b86-499e-84ed-5545917a59c2 req-6bb83b6d-0f3f-41d5-8f02-c6b255f6574a service nova] Acquiring lock "refresh_cache-a31f7f11-fdd1-4e48-a275-78d6ad02224b" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:30:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2611b707-4b86-499e-84ed-5545917a59c2 req-6bb83b6d-0f3f-41d5-8f02-c6b255f6574a service nova] Acquired lock "refresh_cache-a31f7f11-fdd1-4e48-a275-78d6ad02224b" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:30:05 user nova-compute[72766]: DEBUG nova.network.neutron [req-2611b707-4b86-499e-84ed-5545917a59c2 req-6bb83b6d-0f3f-41d5-8f02-c6b255f6574a service nova] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Refreshing network info cache for port 3f64a69a-f0a6-4815-ac3b-55de6f80c83c {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:30:05 user nova-compute[72766]: DEBUG nova.network.neutron [req-2611b707-4b86-499e-84ed-5545917a59c2 req-6bb83b6d-0f3f-41d5-8f02-c6b255f6574a service nova] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Updated VIF entry in instance network info cache for port 3f64a69a-f0a6-4815-ac3b-55de6f80c83c. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:30:06 user nova-compute[72766]: DEBUG nova.network.neutron [req-2611b707-4b86-499e-84ed-5545917a59c2 req-6bb83b6d-0f3f-41d5-8f02-c6b255f6574a service nova] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Updating instance_info_cache with network_info: [{"id": "3f64a69a-f0a6-4815-ac3b-55de6f80c83c", "address": "fa:16:3e:ea:38:e7", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f64a69a-f0", "ovs_interfaceid": "3f64a69a-f0a6-4815-ac3b-55de6f80c83c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:30:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2611b707-4b86-499e-84ed-5545917a59c2 req-6bb83b6d-0f3f-41d5-8f02-c6b255f6574a service nova] Releasing lock "refresh_cache-a31f7f11-fdd1-4e48-a275-78d6ad02224b" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:30:06 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:30:06 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:30:07 user nova-compute[72766]: DEBUG nova.compute.manager [req-c2a52634-ae35-4aa5-932c-e8469b67fe9d req-8776741f-e667-4e68-8f30-bb481d227be8 service nova] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Received event network-changed-eaa457f1-6ef8-4621-ab04-e313204b24fa {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:30:07 user nova-compute[72766]: DEBUG nova.compute.manager [req-c2a52634-ae35-4aa5-932c-e8469b67fe9d req-8776741f-e667-4e68-8f30-bb481d227be8 service nova] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Refreshing instance network info cache due to event network-changed-eaa457f1-6ef8-4621-ab04-e313204b24fa. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:30:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-c2a52634-ae35-4aa5-932c-e8469b67fe9d req-8776741f-e667-4e68-8f30-bb481d227be8 service nova] Acquiring lock "refresh_cache-a87649f2-475b-410f-b7cd-4cb7db232023" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:30:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-c2a52634-ae35-4aa5-932c-e8469b67fe9d req-8776741f-e667-4e68-8f30-bb481d227be8 service nova] Acquired lock "refresh_cache-a87649f2-475b-410f-b7cd-4cb7db232023" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:30:07 user nova-compute[72766]: DEBUG nova.network.neutron [req-c2a52634-ae35-4aa5-932c-e8469b67fe9d req-8776741f-e667-4e68-8f30-bb481d227be8 service nova] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Refreshing network info cache for port eaa457f1-6ef8-4621-ab04-e313204b24fa {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:30:08 user nova-compute[72766]: DEBUG nova.network.neutron [req-c2a52634-ae35-4aa5-932c-e8469b67fe9d req-8776741f-e667-4e68-8f30-bb481d227be8 service nova] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Updated VIF entry in instance network info cache for port eaa457f1-6ef8-4621-ab04-e313204b24fa. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:30:08 user nova-compute[72766]: DEBUG nova.network.neutron [req-c2a52634-ae35-4aa5-932c-e8469b67fe9d req-8776741f-e667-4e68-8f30-bb481d227be8 service nova] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Updating instance_info_cache with network_info: [{"id": "eaa457f1-6ef8-4621-ab04-e313204b24fa", "address": "fa:16:3e:b9:d7:35", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa457f1-6e", "ovs_interfaceid": "eaa457f1-6ef8-4621-ab04-e313204b24fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:30:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-c2a52634-ae35-4aa5-932c-e8469b67fe9d req-8776741f-e667-4e68-8f30-bb481d227be8 service nova] Releasing lock "refresh_cache-a87649f2-475b-410f-b7cd-4cb7db232023" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:30:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "a87649f2-475b-410f-b7cd-4cb7db232023" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:30:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "a87649f2-475b-410f-b7cd-4cb7db232023" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:30:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "a87649f2-475b-410f-b7cd-4cb7db232023-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:30:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "a87649f2-475b-410f-b7cd-4cb7db232023-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:30:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "a87649f2-475b-410f-b7cd-4cb7db232023-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:30:08 user nova-compute[72766]: INFO nova.compute.manager [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Terminating instance
Aug 14 23:30:08 user nova-compute[72766]: DEBUG nova.compute.manager [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:30:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:30:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:30:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:30:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:30:08 user nova-compute[72766]: DEBUG nova.compute.manager [req-40718162-e58f-4d80-a3fe-20b7cae137cc req-d5a5ce92-381e-4c3f-80d4-de9017b34d02 service nova] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Received event network-vif-unplugged-eaa457f1-6ef8-4621-ab04-e313204b24fa {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:30:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-40718162-e58f-4d80-a3fe-20b7cae137cc req-d5a5ce92-381e-4c3f-80d4-de9017b34d02 service nova] Acquiring lock "a87649f2-475b-410f-b7cd-4cb7db232023-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:30:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-40718162-e58f-4d80-a3fe-20b7cae137cc req-d5a5ce92-381e-4c3f-80d4-de9017b34d02 service nova] Lock "a87649f2-475b-410f-b7cd-4cb7db232023-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:30:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-40718162-e58f-4d80-a3fe-20b7cae137cc req-d5a5ce92-381e-4c3f-80d4-de9017b34d02 service nova] Lock "a87649f2-475b-410f-b7cd-4cb7db232023-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:30:08 user nova-compute[72766]: DEBUG nova.compute.manager [req-40718162-e58f-4d80-a3fe-20b7cae137cc req-d5a5ce92-381e-4c3f-80d4-de9017b34d02 service nova] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] No waiting events found dispatching network-vif-unplugged-eaa457f1-6ef8-4621-ab04-e313204b24fa {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:30:08 user nova-compute[72766]: DEBUG nova.compute.manager [req-40718162-e58f-4d80-a3fe-20b7cae137cc req-d5a5ce92-381e-4c3f-80d4-de9017b34d02 service nova] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Received event network-vif-unplugged-eaa457f1-6ef8-4621-ab04-e313204b24fa for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:30:09 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Instance destroyed successfully.
Aug 14 23:30:09 user nova-compute[72766]: DEBUG nova.objects.instance [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lazy-loading 'resources' on Instance uuid a87649f2-475b-410f-b7cd-4cb7db232023 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:28:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-141007425',display_name='tempest-TestVolumeBootPattern-server-141007425',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-141007425',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPvSbILRfrlJBoXiI6yAoEx23QxBOaut7EAv1f2wh2U36gaT4scPzMrBzJaFGwi3LSF0CotAN19+FTvGG2504Ya9pzKNYbrJtakJiRU4EWISkkDaslgouPorjyQ0mmkoOQ==',key_name='tempest-TestVolumeBootPattern-925108064',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:28:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3c9f53727cc497c94516ff7fa1bbf4f',ramdisk_id='',reservation_id='r-trr8kt5n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-213280496',owner_user_name='tempest-TestVolumeBootPattern-213280496-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:28:30Z,user_data=None,user_id='999390ac8e6240199c9a7484e234f3a7',uuid=a87649f2-475b-410f-b7cd-4cb7db232023,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eaa457f1-6ef8-4621-ab04-e313204b24fa", "address": "fa:16:3e:b9:d7:35", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa457f1-6e", "ovs_interfaceid": "eaa457f1-6ef8-4621-ab04-e313204b24fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Converting VIF {"id": "eaa457f1-6ef8-4621-ab04-e313204b24fa", "address": "fa:16:3e:b9:d7:35", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa457f1-6e", "ovs_interfaceid": "eaa457f1-6ef8-4621-ab04-e313204b24fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:d7:35,bridge_name='br-int',has_traffic_filtering=True,id=eaa457f1-6ef8-4621-ab04-e313204b24fa,network=Network(f418a384-bbac-4892-8e0f-c7af2e9464ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaa457f1-6e') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG os_vif [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:d7:35,bridge_name='br-int',has_traffic_filtering=True,id=eaa457f1-6ef8-4621-ab04-e313204b24fa,network=Network(f418a384-bbac-4892-8e0f-c7af2e9464ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaa457f1-6e') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeaa457f1-6e, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:30:09 user nova-compute[72766]: INFO os_vif [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:d7:35,bridge_name='br-int',has_traffic_filtering=True,id=eaa457f1-6ef8-4621-ab04-e313204b24fa,network=Network(f418a384-bbac-4892-8e0f-c7af2e9464ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaa457f1-6e')
Aug 14 23:30:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'muFVWivH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:30:09 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:30:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4d5e8a-3515-4e32-b4ac-8f49a68174cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c39e9d-1c23-45ec-9a0e-f6c29d8ed17a]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 (non-flash)
Aug 14 23:30:09 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 (non-flash)
Aug 14 23:30:09 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff15422ab00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1'): ({'sdb'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Removing single pathed devices sdb {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b37edc8-c62f-4112-8c0c-654fea94781b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[716c8872-75ff-4f64-ba33-4d2455d0c953]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Flushing IO for device /dev/sdb {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9b96ee-fbbd-477a-b680-589d0b8b1897]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d947653e-6212-4224-8da4-51235db3fa79]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] SCSI volumes sdb have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOb9a34b4-3703abbe8f4900b7', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b9a34b4', '/dev/disk/by-id/scsi-23337303361626265') {{(pid=83651) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fecb69-5592-475e-936b-35430cd2ca20]: (4, None) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c53ffc6-3922-430c-9da6-6d9730bb1a1c]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[586ef9e6-f9ed-4921-88b6-2f1d9e5846ed]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1, portal: 172.16.0.220,3260]
Aug 14 23:30:09 user nova-compute[72766]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1, portal: 172.16.0.220,3260] successful.
Aug 14 23:30:09 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29b424a-eee3-4045-a4bf-39505fe08421]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] <== disconnect_volume: return (323ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:30:09 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Deleting instance files /opt/stack/data/nova/instances/a87649f2-475b-410f-b7cd-4cb7db232023_del
Aug 14 23:30:09 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Deletion of /opt/stack/data/nova/instances/a87649f2-475b-410f-b7cd-4cb7db232023_del complete
Aug 14 23:30:09 user nova-compute[72766]: INFO nova.compute.manager [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Took 1.22 seconds to destroy the instance on the hypervisor.
Aug 14 23:30:09 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:30:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:30:10 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:30:10 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Took 0.77 seconds to deallocate network for instance.
Aug 14 23:30:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "a31f7f11-fdd1-4e48-a275-78d6ad02224b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:30:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "a31f7f11-fdd1-4e48-a275-78d6ad02224b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:30:10 user nova-compute[72766]: DEBUG nova.objects.instance [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lazy-loading 'flavor' on Instance uuid a31f7f11-fdd1-4e48-a275-78d6ad02224b {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:30:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "a31f7f11-fdd1-4e48-a275-78d6ad02224b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:30:10 user nova-compute[72766]: DEBUG nova.compute.manager [req-411c0bbe-28ea-4afc-991d-05e33afa74e0 req-cfe72bac-0577-4ea2-894e-c084ac2e002c service nova] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Received event network-vif-plugged-eaa457f1-6ef8-4621-ab04-e313204b24fa {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:30:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-411c0bbe-28ea-4afc-991d-05e33afa74e0 req-cfe72bac-0577-4ea2-894e-c084ac2e002c service nova] Acquiring lock "a87649f2-475b-410f-b7cd-4cb7db232023-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:30:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-411c0bbe-28ea-4afc-991d-05e33afa74e0 req-cfe72bac-0577-4ea2-894e-c084ac2e002c service nova] Lock "a87649f2-475b-410f-b7cd-4cb7db232023-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:30:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-411c0bbe-28ea-4afc-991d-05e33afa74e0 req-cfe72bac-0577-4ea2-894e-c084ac2e002c service nova] Lock "a87649f2-475b-410f-b7cd-4cb7db232023-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:30:10 user nova-compute[72766]: DEBUG nova.compute.manager [req-411c0bbe-28ea-4afc-991d-05e33afa74e0 req-cfe72bac-0577-4ea2-894e-c084ac2e002c service nova] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] No waiting events found dispatching network-vif-plugged-eaa457f1-6ef8-4621-ab04-e313204b24fa {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:30:10 user nova-compute[72766]: WARNING nova.compute.manager [req-411c0bbe-28ea-4afc-991d-05e33afa74e0 req-cfe72bac-0577-4ea2-894e-c084ac2e002c service nova] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Received unexpected event network-vif-plugged-eaa457f1-6ef8-4621-ab04-e313204b24fa for instance with vm_state active and task_state deleting.
Aug 14 23:30:10 user nova-compute[72766]: DEBUG nova.compute.manager [req-411c0bbe-28ea-4afc-991d-05e33afa74e0 req-cfe72bac-0577-4ea2-894e-c084ac2e002c service nova] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Received event network-vif-deleted-eaa457f1-6ef8-4621-ab04-e313204b24fa {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:30:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "a31f7f11-fdd1-4e48-a275-78d6ad02224b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:30:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "a31f7f11-fdd1-4e48-a275-78d6ad02224b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:30:10 user nova-compute[72766]: INFO nova.compute.manager [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Attaching volume bb05ab9b-8a87-4905-82d3-4ecd265483a4 to /dev/vdb
Aug 14 23:30:10 user nova-compute[72766]: DEBUG os_brick.utils [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:30:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:10 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ea7795-c8b2-4f17-a554-7328e4cd29cf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:10 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67949e9-0ee6-47ea-8fb3-fd4425576cbe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:10 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[499c8531-2e6f-4f0c-88a8-b189151ef2c0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:10 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8b006f-863b-45ef-9063-b298dac9d4f2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:30:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 23:30:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:30:10 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 23:30:10 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[0339da36-e65d-4fa2-bf5f-361bcb6edf12]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 23:30:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 23:30:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 23:30:10 user nova-compute[72766]: DEBUG os_brick.utils [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:30:10 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Updating existing volume attachment record: 77e512af-70e8-4804-96c6-5e95cbe05138 {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 23:30:11 user nova-compute[72766]: INFO nova.compute.manager [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Took 0.76 seconds to detach 1 volumes for instance.
Aug 14 23:30:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:30:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:30:11 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:30:11 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:30:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.188s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:30:11 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Deleted allocations for instance a87649f2-475b-410f-b7cd-4cb7db232023
Aug 14 23:30:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-aef58efa-5014-488d-8f7c-2975127dc064 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "a87649f2-475b-410f-b7cd-4cb7db232023" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.128s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:30:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "211043bf-dcc9-44af-834c-75cd7be859ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:30:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "211043bf-dcc9-44af-834c-75cd7be859ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:30:13 user nova-compute[72766]: DEBUG nova.compute.manager [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 23:30:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:30:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:30:13 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 23:30:13 user nova-compute[72766]: INFO nova.compute.claims [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Claim successful on node user
Aug 14 23:30:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:30:14 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:30:14 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:30:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.288s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:30:14 user nova-compute[72766]: DEBUG nova.compute.manager [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 23:30:14 user nova-compute[72766]: DEBUG nova.compute.manager [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 23:30:14 user nova-compute[72766]: DEBUG nova.network.neutron [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 23:30:14 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 23:30:14 user nova-compute[72766]: DEBUG nova.compute.manager [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 23:30:14 user nova-compute[72766]: INFO nova.virt.block_device [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Booting with volume 9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 at /dev/vda
Aug 14 23:30:14 user nova-compute[72766]: DEBUG nova.policy [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11bf21631dd0447f8f1a3f2b012ec43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b0d4f038dbd47b1aad9829f19cb4896', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 23:30:14 user nova-compute[72766]: DEBUG os_brick.utils [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:30:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:14 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b68fc72-2961-46eb-b9e2-8a1d092f96d2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:14 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[99895d0a-b3ed-4d13-9155-b078c7d0f2f3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:14 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[031738e5-5804-42bd-8c59-d3f5d06ad0e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:14 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc08252-b804-4b65-ad79-31b6f63cac2b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:30:14 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 23:30:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:14 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:30:14 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 23:30:14 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d88c5a8-c871-4a52-8c3f-b7e5b8f39591]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:14 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 23:30:14 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 23:30:14 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 23:30:14 user nova-compute[72766]: DEBUG os_brick.utils [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:30:14 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Updating existing volume attachment record: b10ba1a0-405b-40c6-bee3-562301d8ab18 {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 23:30:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:30:14 user nova-compute[72766]: DEBUG nova.network.neutron [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Successfully created port: 3e62931c-4358-4153-8d5e-c4675640e3fa {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 23:30:15 user nova-compute[72766]: DEBUG nova.network.neutron [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Successfully updated port: 3e62931c-4358-4153-8d5e-c4675640e3fa {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 23:30:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "refresh_cache-211043bf-dcc9-44af-834c-75cd7be859ec" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:30:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquired lock "refresh_cache-211043bf-dcc9-44af-834c-75cd7be859ec" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:30:15 user nova-compute[72766]: DEBUG nova.network.neutron [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:30:15 user nova-compute[72766]: DEBUG nova.compute.manager [req-50b4be22-3fb2-4bac-9532-e2d9dd0da221 req-3f54d582-3ecd-4445-a84a-0801eaeb48e3 service nova] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Received event network-changed-3e62931c-4358-4153-8d5e-c4675640e3fa {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:30:15 user nova-compute[72766]: DEBUG nova.compute.manager [req-50b4be22-3fb2-4bac-9532-e2d9dd0da221 req-3f54d582-3ecd-4445-a84a-0801eaeb48e3 service nova] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Refreshing instance network info cache due to event network-changed-3e62931c-4358-4153-8d5e-c4675640e3fa. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:30:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-50b4be22-3fb2-4bac-9532-e2d9dd0da221 req-3f54d582-3ecd-4445-a84a-0801eaeb48e3 service nova] Acquiring lock "refresh_cache-211043bf-dcc9-44af-834c-75cd7be859ec" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:30:15 user nova-compute[72766]: DEBUG nova.network.neutron [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 23:30:16 user nova-compute[72766]: DEBUG nova.network.neutron [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Updating instance_info_cache with network_info: [{"id": "3e62931c-4358-4153-8d5e-c4675640e3fa", "address": "fa:16:3e:2b:91:b3", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e62931c-43", "ovs_interfaceid": "3e62931c-4358-4153-8d5e-c4675640e3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:30:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Releasing lock "refresh_cache-211043bf-dcc9-44af-834c-75cd7be859ec" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:30:16 user nova-compute[72766]: DEBUG nova.compute.manager [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Instance network_info: |[{"id": "3e62931c-4358-4153-8d5e-c4675640e3fa", "address": "fa:16:3e:2b:91:b3", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e62931c-43", "ovs_interfaceid": "3e62931c-4358-4153-8d5e-c4675640e3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 23:30:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-50b4be22-3fb2-4bac-9532-e2d9dd0da221 req-3f54d582-3ecd-4445-a84a-0801eaeb48e3 service nova] Acquired lock "refresh_cache-211043bf-dcc9-44af-834c-75cd7be859ec" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:30:16 user nova-compute[72766]: DEBUG nova.network.neutron [req-50b4be22-3fb2-4bac-9532-e2d9dd0da221 req-3f54d582-3ecd-4445-a84a-0801eaeb48e3 service nova] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Refreshing network info cache for port 3e62931c-4358-4153-8d5e-c4675640e3fa {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:30:16 user nova-compute[72766]: DEBUG nova.network.neutron [req-50b4be22-3fb2-4bac-9532-e2d9dd0da221 req-3f54d582-3ecd-4445-a84a-0801eaeb48e3 service nova] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Updated VIF entry in instance network info cache for port 3e62931c-4358-4153-8d5e-c4675640e3fa. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:30:16 user nova-compute[72766]: DEBUG nova.network.neutron [req-50b4be22-3fb2-4bac-9532-e2d9dd0da221 req-3f54d582-3ecd-4445-a84a-0801eaeb48e3 service nova] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Updating instance_info_cache with network_info: [{"id": "3e62931c-4358-4153-8d5e-c4675640e3fa", "address": "fa:16:3e:2b:91:b3", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e62931c-43", "ovs_interfaceid": "3e62931c-4358-4153-8d5e-c4675640e3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:30:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-50b4be22-3fb2-4bac-9532-e2d9dd0da221 req-3f54d582-3ecd-4445-a84a-0801eaeb48e3 service nova] Releasing lock "refresh_cache-211043bf-dcc9-44af-834c-75cd7be859ec" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pbXIKCSD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:30:19 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:30:19 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:30:19 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:30:19 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:30:19 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 23:30:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4 -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d0d466-2af9-437c-b8d4-75f5623fe539]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 23:30:19 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4 -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5746ac5-8b6a-4743-8e47-db9ad7f16904]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4] added
Aug 14 23:30:19 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb9a2d5-e0e1-4ee0-b66e-ea6e3235e99d]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4988d90f-128a-417a-a9fa-5f055cb15657]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pbXIKCSD {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pbXIKCSD" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b73df3-2817-4741-80bf-78885518c678]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pbXIKCSD'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae9a205-eab9-4fd7-8d7f-92f2514188a6]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[53676ed1-7cde-49d7-9136-d26e2ca81f89]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 23:30:19 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 23:30:19 user nova-compute[72766]:  {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:30:19 user nova-compute[72766]: WARNING os_brick.initiator.connectors.iscsi [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 23:30:19 user nova-compute[72766]: 
Aug 14 23:30:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4 -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[027cbc44-26bc-43c7-bdf6-f4f344e4b445]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4, portal: 172.16.0.220,3260]
Aug 14 23:30:19 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4, portal: 172.16.0.220,3260] successful.
Aug 14 23:30:19 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a65e19-9b46-4f5b-bc39-e342018c3468]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e04670-b75a-40c0-955e-9fba3313b5cd]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4 (non-flash)
Aug 14 23:30:19 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4 (non-flash)
Aug 14 23:30:19 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.241s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29bb3b0-82c7-4579-8365-f64b05e9bf46]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:30:19 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pbXIKCSD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 23:30:20 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:30:20 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '23338303565386139', 'path': '/dev/sdb'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:30:20 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338303565386139', 'path': '/dev/sdb'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 23:30:20 user nova-compute[72766]: DEBUG nova.objects.instance [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lazy-loading 'flavor' on Instance uuid a31f7f11-fdd1-4e48-a275-78d6ad02224b {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:30:20 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 23:30:20 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:30:20 user nova-compute[72766]:   <source dev="/dev/sdb"/>
Aug 14 23:30:20 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:30:20 user nova-compute[72766]:   <serial>bb05ab9b-8a87-4905-82d3-4ecd265483a4</serial>
Aug 14 23:30:20 user nova-compute[72766]: </disk>
Aug 14 23:30:20 user nova-compute[72766]:  {{(pid=72766) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 23:30:21 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:30:21 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:30:21 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] No VIF found with MAC fa:16:3e:ea:38:e7, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:30:21 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-1c9ff7ba-4228-41f8-88dc-1b688ae2e43a tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "a31f7f11-fdd1-4e48-a275-78d6ad02224b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.468s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:30:21 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-211900b0-b815-4101-bbc7-efb59e9c759d tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "a31f7f11-fdd1-4e48-a275-78d6ad02224b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:30:21 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-211900b0-b815-4101-bbc7-efb59e9c759d tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "a31f7f11-fdd1-4e48-a275-78d6ad02224b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:30:21 user nova-compute[72766]: INFO nova.compute.manager [None req-211900b0-b815-4101-bbc7-efb59e9c759d tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Detaching volume bb05ab9b-8a87-4905-82d3-4ecd265483a4
Aug 14 23:30:21 user nova-compute[72766]: INFO nova.virt.block_device [None req-211900b0-b815-4101-bbc7-efb59e9c759d tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Attempting to driver detach volume bb05ab9b-8a87-4905-82d3-4ecd265483a4 from mountpoint /dev/vdb
Aug 14 23:30:21 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-211900b0-b815-4101-bbc7-efb59e9c759d tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Attempting to detach device vdb from instance a31f7f11-fdd1-4e48-a275-78d6ad02224b from the persistent domain config. {{(pid=72766) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 23:30:21 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-211900b0-b815-4101-bbc7-efb59e9c759d tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 23:30:21 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:30:21 user nova-compute[72766]:   <source dev="/dev/sdb"/>
Aug 14 23:30:21 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:30:21 user nova-compute[72766]:   <serial>bb05ab9b-8a87-4905-82d3-4ecd265483a4</serial>
Aug 14 23:30:21 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 23:30:21 user nova-compute[72766]: </disk>
Aug 14 23:30:21 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 23:30:21 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-211900b0-b815-4101-bbc7-efb59e9c759d tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Successfully detached device vdb from instance a31f7f11-fdd1-4e48-a275-78d6ad02224b from the persistent domain config.
Aug 14 23:30:21 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-211900b0-b815-4101-bbc7-efb59e9c759d tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a31f7f11-fdd1-4e48-a275-78d6ad02224b from the live domain config. {{(pid=72766) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 23:30:21 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-211900b0-b815-4101-bbc7-efb59e9c759d tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 23:30:21 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:30:21 user nova-compute[72766]:   <source dev="/dev/sdb"/>
Aug 14 23:30:21 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:30:21 user nova-compute[72766]:   <serial>bb05ab9b-8a87-4905-82d3-4ecd265483a4</serial>
Aug 14 23:30:21 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 23:30:21 user nova-compute[72766]: </disk>
Aug 14 23:30:21 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Received event <DeviceRemovedEvent: 1692055822.331304, a31f7f11-fdd1-4e48-a275-78d6ad02224b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72766) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-211900b0-b815-4101-bbc7-efb59e9c759d tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a31f7f11-fdd1-4e48-a275-78d6ad02224b {{(pid=72766) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 23:30:22 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-211900b0-b815-4101-bbc7-efb59e9c759d tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Successfully detached device vdb from instance a31f7f11-fdd1-4e48-a275-78d6ad02224b from the live domain config.
Aug 14 23:30:22 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-211900b0-b815-4101-bbc7-efb59e9c759d tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-211900b0-b815-4101-bbc7-efb59e9c759d tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pbXIKCSD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:30:22 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-211900b0-b815-4101-bbc7-efb59e9c759d tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:30:22 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-211900b0-b815-4101-bbc7-efb59e9c759d tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-211900b0-b815-4101-bbc7-efb59e9c759d tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-211900b0-b815-4101-bbc7-efb59e9c759d tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7b61e3-4dc9-464b-8a3b-ab8627b90676]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[0988d832-192b-42f5-8bc1-0f6c4740b81f]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-211900b0-b815-4101-bbc7-efb59e9c759d tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4 (non-flash)
Aug 14 23:30:22 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-211900b0-b815-4101-bbc7-efb59e9c759d tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4 (non-flash)
Aug 14 23:30:22 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-211900b0-b815-4101-bbc7-efb59e9c759d tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff15423f2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4'): ({'sdb'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-211900b0-b815-4101-bbc7-efb59e9c759d tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Removing single pathed devices sdb {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[651aa143-0173-411b-8f5a-36e31869bbf1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af48164-4c99-40be-ad4d-269a3cdfe183]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-211900b0-b815-4101-bbc7-efb59e9c759d tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Flushing IO for device /dev/sdb {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc4d532-591f-45d5-871b-9a9957809a53]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-211900b0-b815-4101-bbc7-efb59e9c759d tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[62121d41-2fa7-4565-9c98-f3ce20d5986c]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-211900b0-b815-4101-bbc7-efb59e9c759d tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-211900b0-b815-4101-bbc7-efb59e9c759d tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] SCSI volumes sdb have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-211900b0-b815-4101-bbc7-efb59e9c759d tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d69116-02fd-438e-be2b-61ebe7089631]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-211900b0-b815-4101-bbc7-efb59e9c759d tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4 -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa56d457-ba7c-4b05-a9d0-9d9f300a24e7]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-211900b0-b815-4101-bbc7-efb59e9c759d tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4, portal: 172.16.0.220,3260]
Aug 14 23:30:22 user nova-compute[72766]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4, portal: 172.16.0.220,3260] successful.
Aug 14 23:30:22 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4 -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb05ab9b-8a87-4905-82d3-4ecd265483a4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[605edfcf-36bc-4ccc-bd09-e5fe172b283a]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-211900b0-b815-4101-bbc7-efb59e9c759d tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-211900b0-b815-4101-bbc7-efb59e9c759d tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.241s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-211900b0-b815-4101-bbc7-efb59e9c759d tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] <== disconnect_volume: return (243ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:30:22 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-211900b0-b815-4101-bbc7-efb59e9c759d tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG nova.compute.manager [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 23:30:23 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Creating image(s)
Aug 14 23:30:23 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Did not create local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Ensure instance console log exists: /opt/stack/data/nova/instances/211043bf-dcc9-44af-834c-75cd7be859ec/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Start _get_guest_xml network_info=[{"id": "3e62931c-4358-4153-8d5e-c4675640e3fa", "address": "fa:16:3e:2b:91:b3", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e62931c-43", "ovs_interfaceid": "3e62931c-4358-4153-8d5e-c4675640e3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': 'b10ba1a0-405b-40c6-bee3-562301d8ab18', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FcvtBHop', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '211043bf-dcc9-44af-834c-75cd7be859ec', 'attached_at': '', 'detached_at': '', 'volume_id': '9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737', 'serial': '9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737'}, 'volume_type': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:30:23 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:30:23 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:30:23 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FcvtBHop', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:30:23 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:30:23 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:30:23 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:30:23 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:30:23 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 23:30:23 user nova-compute[72766]: DEBUG nova.objects.instance [None req-211900b0-b815-4101-bbc7-efb59e9c759d tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lazy-loading 'flavor' on Instance uuid a31f7f11-fdd1-4e48-a275-78d6ad02224b {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b420e69-fa6d-49a0-ac6f-81a0fc2b44b9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 23:30:23 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6060d0-553f-4149-90f1-a1c5c1828780]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737] added
Aug 14 23:30:23 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-211900b0-b815-4101-bbc7-efb59e9c759d tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "a31f7f11-fdd1-4e48-a275-78d6ad02224b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.576s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[070e11f6-a32c-433a-b9b7-6103d55e07bf]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b132415-d535-4133-9893-e9eb0c35541a]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FcvtBHop {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FcvtBHop" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f01cac4-4f3e-4b53-a836-ba472462d621]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FcvtBHop'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d5e87b-8a9c-4c98-85bd-b4de7325d159]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a54dcd-1b73-4a7a-a8b0-33ed210ee0cc]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 23:30:23 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 23:30:23 user nova-compute[72766]:  {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:30:23 user nova-compute[72766]: WARNING os_brick.initiator.connectors.iscsi [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 23:30:23 user nova-compute[72766]: 
Aug 14 23:30:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[eefa0459-38c6-4d0a-9706-0abd3b82928c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737, portal: 172.16.0.220,3260]
Aug 14 23:30:23 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737, portal: 172.16.0.220,3260] successful.
Aug 14 23:30:23 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9d8611-bc10-4d6c-aebe-94bc04376b92]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[21eeaceb-5f8d-45c5-ac09-2dd5d5ff87f4]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 (non-flash)
Aug 14 23:30:23 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 (non-flash)
Aug 14 23:30:23 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[649f9c06-d4ea-4db3-840d-61db48a905b3]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:23 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: None {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:30:24 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692055809.089417, a87649f2-475b-410f-b7cd-4cb7db232023 => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:30:24 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] VM Stopped (Lifecycle Event)
Aug 14 23:30:24 user nova-compute[72766]: DEBUG nova.compute.manager [None req-7cf3b399-e631-453d-8ce9-cb2da0c4f56a None None] [instance: a87649f2-475b-410f-b7cd-4cb7db232023] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:30:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:30:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:30:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:30:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:30:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:30:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:30:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:30:24 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:30:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FcvtBHop', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 23:30:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:30:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23238316530333662', 'path': '/dev/sdb'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:30:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238316530333662', 'path': '/dev/sdb'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 23:30:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:30:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1043518379',display_name='tempest-ServerActionsTestOtherA-server-1043518379',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1043518379',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDoXZolQqtFAUPpymn6Ku7JgXGw46vxp59imOajNHAEz0LQOA2HZ029jKc7yJ8uxT7IHJ390d7ScJ6pqdFfhcnBy/F6i10LDXWERfUkUg5mrEOI4hiQbJjkhq6PVnEbSQ==',key_name='tempest-keypair-1635999225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b0d4f038dbd47b1aad9829f19cb4896',ramdisk_id='',reservation_id='r-ultip2q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-242565278',owner_user_name='tempest-ServerActionsTestOtherA-242565278-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:30:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11bf21631dd0447f8f1a3f2b012ec43a',uuid=211043bf-dcc9-44af-834c-75cd7be859ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e62931c-4358-4153-8d5e-c4675640e3fa", "address": "fa:16:3e:2b:91:b3", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e62931c-43", "ovs_interfaceid": "3e62931c-4358-4153-8d5e-c4675640e3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:30:24 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Converting VIF {"id": "3e62931c-4358-4153-8d5e-c4675640e3fa", "address": "fa:16:3e:2b:91:b3", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e62931c-43", "ovs_interfaceid": "3e62931c-4358-4153-8d5e-c4675640e3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:30:24 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:91:b3,bridge_name='br-int',has_traffic_filtering=True,id=3e62931c-4358-4153-8d5e-c4675640e3fa,network=Network(e0bbc182-f700-4a82-84ae-7cbcb2e517c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e62931c-43') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:30:24 user nova-compute[72766]: DEBUG nova.objects.instance [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lazy-loading 'pci_devices' on Instance uuid 211043bf-dcc9-44af-834c-75cd7be859ec {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:30:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:30:24 user nova-compute[72766]:   <uuid>211043bf-dcc9-44af-834c-75cd7be859ec</uuid>
Aug 14 23:30:24 user nova-compute[72766]:   <name>instance-0000002c</name>
Aug 14 23:30:24 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:30:24 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:30:24 user nova-compute[72766]:   <metadata>
Aug 14 23:30:24 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:30:24 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:30:24 user nova-compute[72766]:       <nova:name>tempest-ServerActionsTestOtherA-server-1043518379</nova:name>
Aug 14 23:30:24 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:30:23</nova:creationTime>
Aug 14 23:30:24 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:30:24 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:30:24 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:30:24 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:30:24 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:30:24 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:30:24 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:30:24 user nova-compute[72766]:       <nova:owner>
Aug 14 23:30:24 user nova-compute[72766]:         <nova:user uuid="11bf21631dd0447f8f1a3f2b012ec43a">tempest-ServerActionsTestOtherA-242565278-project-member</nova:user>
Aug 14 23:30:24 user nova-compute[72766]:         <nova:project uuid="7b0d4f038dbd47b1aad9829f19cb4896">tempest-ServerActionsTestOtherA-242565278</nova:project>
Aug 14 23:30:24 user nova-compute[72766]:       </nova:owner>
Aug 14 23:30:24 user nova-compute[72766]:       <nova:ports>
Aug 14 23:30:24 user nova-compute[72766]:         <nova:port uuid="3e62931c-4358-4153-8d5e-c4675640e3fa">
Aug 14 23:30:24 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 23:30:24 user nova-compute[72766]:         </nova:port>
Aug 14 23:30:24 user nova-compute[72766]:       </nova:ports>
Aug 14 23:30:24 user nova-compute[72766]:     </nova:instance>
Aug 14 23:30:24 user nova-compute[72766]:   </metadata>
Aug 14 23:30:24 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:30:24 user nova-compute[72766]:     <system>
Aug 14 23:30:24 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:30:24 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:30:24 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:30:24 user nova-compute[72766]:       <entry name="serial">211043bf-dcc9-44af-834c-75cd7be859ec</entry>
Aug 14 23:30:24 user nova-compute[72766]:       <entry name="uuid">211043bf-dcc9-44af-834c-75cd7be859ec</entry>
Aug 14 23:30:24 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:30:24 user nova-compute[72766]:     </system>
Aug 14 23:30:24 user nova-compute[72766]:   </sysinfo>
Aug 14 23:30:24 user nova-compute[72766]:   <os>
Aug 14 23:30:24 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:30:24 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:30:24 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:30:24 user nova-compute[72766]:   </os>
Aug 14 23:30:24 user nova-compute[72766]:   <features>
Aug 14 23:30:24 user nova-compute[72766]:     <acpi/>
Aug 14 23:30:24 user nova-compute[72766]:     <apic/>
Aug 14 23:30:24 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:30:24 user nova-compute[72766]:   </features>
Aug 14 23:30:24 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:30:24 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:30:24 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:30:24 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:30:24 user nova-compute[72766]:   </clock>
Aug 14 23:30:24 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:30:24 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:30:24 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:30:24 user nova-compute[72766]:   </cpu>
Aug 14 23:30:24 user nova-compute[72766]:   <devices>
Aug 14 23:30:24 user nova-compute[72766]:     <disk type="block" device="disk">
Aug 14 23:30:24 user nova-compute[72766]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:30:24 user nova-compute[72766]:       <source dev="/dev/sdb"/>
Aug 14 23:30:24 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:30:24 user nova-compute[72766]:       <serial>9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737</serial>
Aug 14 23:30:24 user nova-compute[72766]:     </disk>
Aug 14 23:30:24 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:30:24 user nova-compute[72766]:       <mac address="fa:16:3e:2b:91:b3"/>
Aug 14 23:30:24 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:30:24 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:30:24 user nova-compute[72766]:       <target dev="tap3e62931c-43"/>
Aug 14 23:30:24 user nova-compute[72766]:     </interface>
Aug 14 23:30:24 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:30:24 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/211043bf-dcc9-44af-834c-75cd7be859ec/console.log" append="off"/>
Aug 14 23:30:24 user nova-compute[72766]:     </serial>
Aug 14 23:30:24 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:30:24 user nova-compute[72766]:     <video>
Aug 14 23:30:24 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:30:24 user nova-compute[72766]:     </video>
Aug 14 23:30:24 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:30:24 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:30:24 user nova-compute[72766]:     </rng>
Aug 14 23:30:24 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:30:24 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:30:24 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:30:24 user nova-compute[72766]:     </memballoon>
Aug 14 23:30:24 user nova-compute[72766]:   </devices>
Aug 14 23:30:24 user nova-compute[72766]: </domain>
Aug 14 23:30:24 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:30:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:30:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1043518379',display_name='tempest-ServerActionsTestOtherA-server-1043518379',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1043518379',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDoXZolQqtFAUPpymn6Ku7JgXGw46vxp59imOajNHAEz0LQOA2HZ029jKc7yJ8uxT7IHJ390d7ScJ6pqdFfhcnBy/F6i10LDXWERfUkUg5mrEOI4hiQbJjkhq6PVnEbSQ==',key_name='tempest-keypair-1635999225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b0d4f038dbd47b1aad9829f19cb4896',ramdisk_id='',reservation_id='r-ultip2q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-242565278',owner_user_name='tempest-ServerActionsTestOtherA-242565278-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:30:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11bf21631dd0447f8f1a3f2b012ec43a',uuid=211043bf-dcc9-44af-834c-75cd7be859ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e62931c-4358-4153-8d5e-c4675640e3fa", "address": "fa:16:3e:2b:91:b3", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e62931c-43", "ovs_interfaceid": "3e62931c-4358-4153-8d5e-c4675640e3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:30:24 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Converting VIF {"id": "3e62931c-4358-4153-8d5e-c4675640e3fa", "address": "fa:16:3e:2b:91:b3", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e62931c-43", "ovs_interfaceid": "3e62931c-4358-4153-8d5e-c4675640e3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:30:24 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:91:b3,bridge_name='br-int',has_traffic_filtering=True,id=3e62931c-4358-4153-8d5e-c4675640e3fa,network=Network(e0bbc182-f700-4a82-84ae-7cbcb2e517c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e62931c-43') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:30:24 user nova-compute[72766]: DEBUG os_vif [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:91:b3,bridge_name='br-int',has_traffic_filtering=True,id=3e62931c-4358-4153-8d5e-c4675640e3fa,network=Network(e0bbc182-f700-4a82-84ae-7cbcb2e517c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e62931c-43') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:30:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:30:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:30:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:30:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:30:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e62931c-43, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:30:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3e62931c-43, col_values=(('external_ids', {'iface-id': '3e62931c-4358-4153-8d5e-c4675640e3fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:91:b3', 'vm-uuid': '211043bf-dcc9-44af-834c-75cd7be859ec'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:30:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:30:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:30:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:30:24 user nova-compute[72766]: INFO os_vif [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:91:b3,bridge_name='br-int',has_traffic_filtering=True,id=3e62931c-4358-4153-8d5e-c4675640e3fa,network=Network(e0bbc182-f700-4a82-84ae-7cbcb2e517c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e62931c-43')
Aug 14 23:30:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:30:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] No VIF found with MAC fa:16:3e:2b:91:b3, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:30:25 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:30:25 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:30:25 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:30:26 user nova-compute[72766]: DEBUG nova.compute.manager [req-eb6d180b-2d28-47c9-878e-2275016f7d3e req-e69f8a3f-f5af-4b07-b9b3-66da15250407 service nova] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Received event network-vif-plugged-3e62931c-4358-4153-8d5e-c4675640e3fa {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:30:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-eb6d180b-2d28-47c9-878e-2275016f7d3e req-e69f8a3f-f5af-4b07-b9b3-66da15250407 service nova] Acquiring lock "211043bf-dcc9-44af-834c-75cd7be859ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:30:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-eb6d180b-2d28-47c9-878e-2275016f7d3e req-e69f8a3f-f5af-4b07-b9b3-66da15250407 service nova] Lock "211043bf-dcc9-44af-834c-75cd7be859ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:30:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-eb6d180b-2d28-47c9-878e-2275016f7d3e req-e69f8a3f-f5af-4b07-b9b3-66da15250407 service nova] Lock "211043bf-dcc9-44af-834c-75cd7be859ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:30:26 user nova-compute[72766]: DEBUG nova.compute.manager [req-eb6d180b-2d28-47c9-878e-2275016f7d3e req-e69f8a3f-f5af-4b07-b9b3-66da15250407 service nova] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] No waiting events found dispatching network-vif-plugged-3e62931c-4358-4153-8d5e-c4675640e3fa {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:30:26 user nova-compute[72766]: WARNING nova.compute.manager [req-eb6d180b-2d28-47c9-878e-2275016f7d3e req-e69f8a3f-f5af-4b07-b9b3-66da15250407 service nova] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Received unexpected event network-vif-plugged-3e62931c-4358-4153-8d5e-c4675640e3fa for instance with vm_state building and task_state spawning.
Aug 14 23:30:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:30:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:30:28 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692055828.0799403, 211043bf-dcc9-44af-834c-75cd7be859ec => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:30:28 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] VM Resumed (Lifecycle Event)
Aug 14 23:30:28 user nova-compute[72766]: DEBUG nova.compute.manager [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:30:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 23:30:28 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Instance spawned successfully.
Aug 14 23:30:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 23:30:28 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:30:28 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:30:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:30:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:30:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:30:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:30:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:30:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:30:28 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:30:28 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692055828.0827935, 211043bf-dcc9-44af-834c-75cd7be859ec => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:30:28 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] VM Started (Lifecycle Event)
Aug 14 23:30:28 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:30:28 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:30:28 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:30:28 user nova-compute[72766]: INFO nova.compute.manager [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Took 4.91 seconds to spawn the instance on the hypervisor.
Aug 14 23:30:28 user nova-compute[72766]: DEBUG nova.compute.manager [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:30:28 user nova-compute[72766]: DEBUG nova.compute.manager [req-efae4d86-4012-4a3b-94fa-a775ad6104be req-6f2fc1c2-3a1f-40d7-a6bb-1b112d36da9b service nova] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Received event network-vif-plugged-3e62931c-4358-4153-8d5e-c4675640e3fa {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:30:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-efae4d86-4012-4a3b-94fa-a775ad6104be req-6f2fc1c2-3a1f-40d7-a6bb-1b112d36da9b service nova] Acquiring lock "211043bf-dcc9-44af-834c-75cd7be859ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:30:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-efae4d86-4012-4a3b-94fa-a775ad6104be req-6f2fc1c2-3a1f-40d7-a6bb-1b112d36da9b service nova] Lock "211043bf-dcc9-44af-834c-75cd7be859ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:30:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-efae4d86-4012-4a3b-94fa-a775ad6104be req-6f2fc1c2-3a1f-40d7-a6bb-1b112d36da9b service nova] Lock "211043bf-dcc9-44af-834c-75cd7be859ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:30:28 user nova-compute[72766]: DEBUG nova.compute.manager [req-efae4d86-4012-4a3b-94fa-a775ad6104be req-6f2fc1c2-3a1f-40d7-a6bb-1b112d36da9b service nova] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] No waiting events found dispatching network-vif-plugged-3e62931c-4358-4153-8d5e-c4675640e3fa {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:30:28 user nova-compute[72766]: WARNING nova.compute.manager [req-efae4d86-4012-4a3b-94fa-a775ad6104be req-6f2fc1c2-3a1f-40d7-a6bb-1b112d36da9b service nova] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Received unexpected event network-vif-plugged-3e62931c-4358-4153-8d5e-c4675640e3fa for instance with vm_state building and task_state spawning.
Aug 14 23:30:28 user nova-compute[72766]: INFO nova.compute.manager [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Took 14.40 seconds to build instance.
Aug 14 23:30:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-eebb19de-644e-46d7-b98d-9b3935dbf9dc tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "211043bf-dcc9-44af-834c-75cd7be859ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.498s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:30:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:30:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:30:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:30:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:30:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:30:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:30:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:30:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:30:39 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:30:39 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:30:39 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:30:42 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:30:42 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:30:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-a31f7f11-fdd1-4e48-a275-78d6ad02224b" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:30:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-a31f7f11-fdd1-4e48-a275-78d6ad02224b" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:30:42 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:30:43 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Updating instance_info_cache with network_info: [{"id": "3f64a69a-f0a6-4815-ac3b-55de6f80c83c", "address": "fa:16:3e:ea:38:e7", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f64a69a-f0", "ovs_interfaceid": "3f64a69a-f0a6-4815-ac3b-55de6f80c83c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:30:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-a31f7f11-fdd1-4e48-a275-78d6ad02224b" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:30:43 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:30:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:30:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:30:45 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:30:45 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:30:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:30:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:30:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:30:45 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:30:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a31f7f11-fdd1-4e48-a275-78d6ad02224b/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a31f7f11-fdd1-4e48-a275-78d6ad02224b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a31f7f11-fdd1-4e48-a275-78d6ad02224b/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a31f7f11-fdd1-4e48-a275-78d6ad02224b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5965063c-8d1b-41d0-8c22-7d5b54925f94/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5965063c-8d1b-41d0-8c22-7d5b54925f94/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5965063c-8d1b-41d0-8c22-7d5b54925f94/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5965063c-8d1b-41d0-8c22-7d5b54925f94/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:46 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:30:47 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:30:47 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:30:47 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=8331MB free_disk=25.221927642822266GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:30:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:30:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:30:47 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance cbcf7851-e6f7-4f46-97cc-d773286ccddf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:30:47 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance a31f7f11-fdd1-4e48-a275-78d6ad02224b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:30:47 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 5965063c-8d1b-41d0-8c22-7d5b54925f94 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:30:47 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 211043bf-dcc9-44af-834c-75cd7be859ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:30:47 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:30:47 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:30:47 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:30:47 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:30:47 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:30:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.289s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:30:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Acquiring lock "5965063c-8d1b-41d0-8c22-7d5b54925f94" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:30:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "5965063c-8d1b-41d0-8c22-7d5b54925f94" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:30:48 user nova-compute[72766]: DEBUG nova.objects.instance [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lazy-loading 'flavor' on Instance uuid 5965063c-8d1b-41d0-8c22-7d5b54925f94 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:30:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "5965063c-8d1b-41d0-8c22-7d5b54925f94" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.104s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:30:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Acquiring lock "5965063c-8d1b-41d0-8c22-7d5b54925f94" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:30:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "5965063c-8d1b-41d0-8c22-7d5b54925f94" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:30:48 user nova-compute[72766]: INFO nova.compute.manager [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Attaching volume b8d3e50a-475f-4a29-b017-a8950c2110d0 to /dev/vdb
Aug 14 23:30:48 user nova-compute[72766]: DEBUG os_brick.utils [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:30:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:48 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0afaaf0-5e8d-4d1d-abbf-3d1a99269b65]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:48 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5449e74-6fdd-4a0d-847e-6c06c3d7afe8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:48 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea76728-2b51-4189-a304-3f629f4150b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:48 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[217e7d86-d295-4753-a96f-a81bae9791ed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:30:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 23:30:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:30:48 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 23:30:48 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[5634fb72-0222-41a2-b4f6-833d36e3c13e]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 23:30:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 23:30:48 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 23:30:48 user nova-compute[72766]: DEBUG os_brick.utils [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:30:48 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Updating existing volume attachment record: 60b2e12a-d5fe-48a3-bbfe-97f530cbfaff {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 23:30:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:30:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:30:49 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:30:49 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:30:52 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:30:52 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:30:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:30:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:30:55 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:30:55 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OniRhYmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:30:57 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:30:57 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:30:57 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:30:57 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:30:57 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 23:30:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0 -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d9d130-d335-499a-91e8-03fd3d4c1664]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 23:30:57 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc562ce-036e-4240-9757-a088498ad1da]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0] added
Aug 14 23:30:57 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[658ceaec-7ced-4b37-baf7-a56f7053b477]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a69c905-708e-42b0-8095-6a3df2f47fe2]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OniRhYmy {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OniRhYmy" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4475768f-5c44-437c-89af-172eacc94e3b]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OniRhYmy'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[510104cc-d285-4a6b-8698-683ee7626011]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c1ba91-778c-4cff-bc01-45d06830e404]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 (non-flash)
Aug 14 23:30:57 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 (non-flash)
Aug 14 23:30:57 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0 -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e566c2f-b6ba-4b0d-9fa3-d7b9af565953]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0, portal: 172.16.0.220,3260]
Aug 14 23:30:57 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0, portal: 172.16.0.220,3260] successful.
Aug 14 23:30:57 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff375c8-93d5-4eb1-85ff-45b638a92983]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b999e8a0-2636-49aa-b921-cb8753d7c63d]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 (non-flash)
Aug 14 23:30:57 user nova-compute[72766]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0 (non-flash)
Aug 14 23:30:57 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 (non-flash)
Aug 14 23:30:57 user nova-compute[72766]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0 (non-flash)
Aug 14 23:30:57 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7fe8b8-91be-42a0-ba7e-f31d11d511b1]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:30:57 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: None {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:30:58 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:30:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OniRhYmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 23:30:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:30:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23664356239336561', 'path': '/dev/sdc'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:30:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664356239336561', 'path': '/dev/sdc'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 23:30:58 user nova-compute[72766]: DEBUG nova.objects.instance [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lazy-loading 'flavor' on Instance uuid 5965063c-8d1b-41d0-8c22-7d5b54925f94 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:30:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 23:30:58 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:30:58 user nova-compute[72766]:   <source dev="/dev/sdc"/>
Aug 14 23:30:58 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:30:58 user nova-compute[72766]:   <serial>b8d3e50a-475f-4a29-b017-a8950c2110d0</serial>
Aug 14 23:30:58 user nova-compute[72766]: </disk>
Aug 14 23:30:58 user nova-compute[72766]:  {{(pid=72766) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 23:30:59 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:30:59 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:30:59 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] No VIF found with MAC fa:16:3e:e8:a7:0c, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:30:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-09e90326-7bbb-4842-9589-788b741538a8 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "5965063c-8d1b-41d0-8c22-7d5b54925f94" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.677s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:30:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:30:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "c5fe05bb-7204-47df-b033-a7462a21166c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:31:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "c5fe05bb-7204-47df-b033-a7462a21166c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:31:00 user nova-compute[72766]: DEBUG nova.compute.manager [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 23:31:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:31:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:31:00 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 23:31:00 user nova-compute[72766]: INFO nova.compute.claims [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Claim successful on node user
Aug 14 23:31:00 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:31:00 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:31:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.284s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:31:00 user nova-compute[72766]: DEBUG nova.compute.manager [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 23:31:00 user nova-compute[72766]: DEBUG nova.compute.manager [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 23:31:00 user nova-compute[72766]: DEBUG nova.network.neutron [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 23:31:00 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 23:31:00 user nova-compute[72766]: DEBUG nova.compute.manager [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 23:31:00 user nova-compute[72766]: INFO nova.virt.block_device [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Booting with volume 52e4fc71-e83e-49b1-b48b-aad06097b1e1 at /dev/vda
Aug 14 23:31:00 user nova-compute[72766]: DEBUG nova.policy [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '999390ac8e6240199c9a7484e234f3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c9f53727cc497c94516ff7fa1bbf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 23:31:00 user nova-compute[72766]: DEBUG os_brick.utils [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:31:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:31:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:31:00 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea79249-ed6c-4913-a4fa-173429c0fa7d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:31:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:31:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:31:00 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[eacd6ae1-02a1-4a4f-b41e-b42b3391bf82]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:31:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:31:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:31:00 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d103f22-a6cc-471c-b0bd-5a3fbedf92f1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:31:00 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c92dcd2-6768-4604-ac23-afea119a2681]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:31:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:31:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:31:00 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 23:31:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:31:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:31:00 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 23:31:00 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b2c7f1-d4b3-484d-a21d-517f7ef2f28e]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:31:00 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 23:31:00 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 23:31:00 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 23:31:00 user nova-compute[72766]: DEBUG os_brick.utils [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:31:00 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Updating existing volume attachment record: 0eb0844b-6671-4ded-99f6-7ef5b64ab751 {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 23:31:01 user nova-compute[72766]: DEBUG nova.network.neutron [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Successfully created port: 6346774b-2177-4e22-a7b2-faa064005d64 {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 23:31:01 user nova-compute[72766]: DEBUG nova.compute.manager [req-fe9cd053-3865-4aae-aea7-6ca3b3f2e291 req-bc0c8a93-c66c-4f5a-a14f-5f55e214298b service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Received event network-changed-09bcfc13-ace1-4e60-8ed3-2a3b1a09e957 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:31:01 user nova-compute[72766]: DEBUG nova.compute.manager [req-fe9cd053-3865-4aae-aea7-6ca3b3f2e291 req-bc0c8a93-c66c-4f5a-a14f-5f55e214298b service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Refreshing instance network info cache due to event network-changed-09bcfc13-ace1-4e60-8ed3-2a3b1a09e957. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:31:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-fe9cd053-3865-4aae-aea7-6ca3b3f2e291 req-bc0c8a93-c66c-4f5a-a14f-5f55e214298b service nova] Acquiring lock "refresh_cache-5965063c-8d1b-41d0-8c22-7d5b54925f94" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:31:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-fe9cd053-3865-4aae-aea7-6ca3b3f2e291 req-bc0c8a93-c66c-4f5a-a14f-5f55e214298b service nova] Acquired lock "refresh_cache-5965063c-8d1b-41d0-8c22-7d5b54925f94" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:31:01 user nova-compute[72766]: DEBUG nova.network.neutron [req-fe9cd053-3865-4aae-aea7-6ca3b3f2e291 req-bc0c8a93-c66c-4f5a-a14f-5f55e214298b service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Refreshing network info cache for port 09bcfc13-ace1-4e60-8ed3-2a3b1a09e957 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:31:02 user nova-compute[72766]: DEBUG nova.network.neutron [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Successfully updated port: 6346774b-2177-4e22-a7b2-faa064005d64 {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 23:31:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "refresh_cache-c5fe05bb-7204-47df-b033-a7462a21166c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:31:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquired lock "refresh_cache-c5fe05bb-7204-47df-b033-a7462a21166c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:31:02 user nova-compute[72766]: DEBUG nova.network.neutron [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:31:02 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:02 user nova-compute[72766]: DEBUG nova.compute.manager [req-22d8401f-0aa6-4226-b34b-5ac6f4d3facc req-05aaa83e-aa75-4372-a4de-daa571682a63 service nova] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Received event network-changed-6346774b-2177-4e22-a7b2-faa064005d64 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:31:02 user nova-compute[72766]: DEBUG nova.compute.manager [req-22d8401f-0aa6-4226-b34b-5ac6f4d3facc req-05aaa83e-aa75-4372-a4de-daa571682a63 service nova] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Refreshing instance network info cache due to event network-changed-6346774b-2177-4e22-a7b2-faa064005d64. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:31:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-22d8401f-0aa6-4226-b34b-5ac6f4d3facc req-05aaa83e-aa75-4372-a4de-daa571682a63 service nova] Acquiring lock "refresh_cache-c5fe05bb-7204-47df-b033-a7462a21166c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:31:02 user nova-compute[72766]: DEBUG nova.network.neutron [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 23:31:02 user nova-compute[72766]: DEBUG nova.network.neutron [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Updating instance_info_cache with network_info: [{"id": "6346774b-2177-4e22-a7b2-faa064005d64", "address": "fa:16:3e:28:1f:4d", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6346774b-21", "ovs_interfaceid": "6346774b-2177-4e22-a7b2-faa064005d64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:31:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Releasing lock "refresh_cache-c5fe05bb-7204-47df-b033-a7462a21166c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:31:02 user nova-compute[72766]: DEBUG nova.compute.manager [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Instance network_info: |[{"id": "6346774b-2177-4e22-a7b2-faa064005d64", "address": "fa:16:3e:28:1f:4d", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6346774b-21", "ovs_interfaceid": "6346774b-2177-4e22-a7b2-faa064005d64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 23:31:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-22d8401f-0aa6-4226-b34b-5ac6f4d3facc req-05aaa83e-aa75-4372-a4de-daa571682a63 service nova] Acquired lock "refresh_cache-c5fe05bb-7204-47df-b033-a7462a21166c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:31:02 user nova-compute[72766]: DEBUG nova.network.neutron [req-22d8401f-0aa6-4226-b34b-5ac6f4d3facc req-05aaa83e-aa75-4372-a4de-daa571682a63 service nova] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Refreshing network info cache for port 6346774b-2177-4e22-a7b2-faa064005d64 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:31:02 user nova-compute[72766]: DEBUG nova.network.neutron [req-fe9cd053-3865-4aae-aea7-6ca3b3f2e291 req-bc0c8a93-c66c-4f5a-a14f-5f55e214298b service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Updated VIF entry in instance network info cache for port 09bcfc13-ace1-4e60-8ed3-2a3b1a09e957. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:31:02 user nova-compute[72766]: DEBUG nova.network.neutron [req-fe9cd053-3865-4aae-aea7-6ca3b3f2e291 req-bc0c8a93-c66c-4f5a-a14f-5f55e214298b service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Updating instance_info_cache with network_info: [{"id": "09bcfc13-ace1-4e60-8ed3-2a3b1a09e957", "address": "fa:16:3e:e8:a7:0c", "network": {"id": "c7828c64-4d71-4c57-8df8-bb4524d9b9cb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-160068070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbd47fb3d5eb408aa751d1d49f198906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09bcfc13-ac", "ovs_interfaceid": "09bcfc13-ace1-4e60-8ed3-2a3b1a09e957", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:31:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-fe9cd053-3865-4aae-aea7-6ca3b3f2e291 req-bc0c8a93-c66c-4f5a-a14f-5f55e214298b service nova] Releasing lock "refresh_cache-5965063c-8d1b-41d0-8c22-7d5b54925f94" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:31:03 user nova-compute[72766]: DEBUG nova.network.neutron [req-22d8401f-0aa6-4226-b34b-5ac6f4d3facc req-05aaa83e-aa75-4372-a4de-daa571682a63 service nova] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Updated VIF entry in instance network info cache for port 6346774b-2177-4e22-a7b2-faa064005d64. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:31:03 user nova-compute[72766]: DEBUG nova.network.neutron [req-22d8401f-0aa6-4226-b34b-5ac6f4d3facc req-05aaa83e-aa75-4372-a4de-daa571682a63 service nova] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Updating instance_info_cache with network_info: [{"id": "6346774b-2177-4e22-a7b2-faa064005d64", "address": "fa:16:3e:28:1f:4d", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6346774b-21", "ovs_interfaceid": "6346774b-2177-4e22-a7b2-faa064005d64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:31:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-22d8401f-0aa6-4226-b34b-5ac6f4d3facc req-05aaa83e-aa75-4372-a4de-daa571682a63 service nova] Releasing lock "refresh_cache-c5fe05bb-7204-47df-b033-a7462a21166c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:31:04 user nova-compute[72766]: DEBUG nova.compute.manager [req-f83482b2-4cce-481e-8597-203f10d42683 req-21032f3b-5b84-4fca-8050-57ee66cddf0a service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Received event network-changed-09bcfc13-ace1-4e60-8ed3-2a3b1a09e957 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:31:04 user nova-compute[72766]: DEBUG nova.compute.manager [req-f83482b2-4cce-481e-8597-203f10d42683 req-21032f3b-5b84-4fca-8050-57ee66cddf0a service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Refreshing instance network info cache due to event network-changed-09bcfc13-ace1-4e60-8ed3-2a3b1a09e957. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:31:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f83482b2-4cce-481e-8597-203f10d42683 req-21032f3b-5b84-4fca-8050-57ee66cddf0a service nova] Acquiring lock "refresh_cache-5965063c-8d1b-41d0-8c22-7d5b54925f94" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:31:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f83482b2-4cce-481e-8597-203f10d42683 req-21032f3b-5b84-4fca-8050-57ee66cddf0a service nova] Acquired lock "refresh_cache-5965063c-8d1b-41d0-8c22-7d5b54925f94" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:31:04 user nova-compute[72766]: DEBUG nova.network.neutron [req-f83482b2-4cce-481e-8597-203f10d42683 req-21032f3b-5b84-4fca-8050-57ee66cddf0a service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Refreshing network info cache for port 09bcfc13-ace1-4e60-8ed3-2a3b1a09e957 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:31:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ab2022ce-c28e-414a-8c45-59b961c1f874 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Acquiring lock "5965063c-8d1b-41d0-8c22-7d5b54925f94" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:31:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ab2022ce-c28e-414a-8c45-59b961c1f874 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "5965063c-8d1b-41d0-8c22-7d5b54925f94" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:31:04 user nova-compute[72766]: INFO nova.compute.manager [None req-ab2022ce-c28e-414a-8c45-59b961c1f874 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Rebooting instance
Aug 14 23:31:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ab2022ce-c28e-414a-8c45-59b961c1f874 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Acquiring lock "refresh_cache-5965063c-8d1b-41d0-8c22-7d5b54925f94" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:31:04 user nova-compute[72766]: DEBUG nova.network.neutron [req-f83482b2-4cce-481e-8597-203f10d42683 req-21032f3b-5b84-4fca-8050-57ee66cddf0a service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Updated VIF entry in instance network info cache for port 09bcfc13-ace1-4e60-8ed3-2a3b1a09e957. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:31:04 user nova-compute[72766]: DEBUG nova.network.neutron [req-f83482b2-4cce-481e-8597-203f10d42683 req-21032f3b-5b84-4fca-8050-57ee66cddf0a service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Updating instance_info_cache with network_info: [{"id": "09bcfc13-ace1-4e60-8ed3-2a3b1a09e957", "address": "fa:16:3e:e8:a7:0c", "network": {"id": "c7828c64-4d71-4c57-8df8-bb4524d9b9cb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-160068070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbd47fb3d5eb408aa751d1d49f198906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09bcfc13-ac", "ovs_interfaceid": "09bcfc13-ace1-4e60-8ed3-2a3b1a09e957", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:31:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f83482b2-4cce-481e-8597-203f10d42683 req-21032f3b-5b84-4fca-8050-57ee66cddf0a service nova] Releasing lock "refresh_cache-5965063c-8d1b-41d0-8c22-7d5b54925f94" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:31:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ab2022ce-c28e-414a-8c45-59b961c1f874 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Acquired lock "refresh_cache-5965063c-8d1b-41d0-8c22-7d5b54925f94" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:31:04 user nova-compute[72766]: DEBUG nova.network.neutron [None req-ab2022ce-c28e-414a-8c45-59b961c1f874 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:31:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:04 user nova-compute[72766]: DEBUG nova.network.neutron [None req-ab2022ce-c28e-414a-8c45-59b961c1f874 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Updating instance_info_cache with network_info: [{"id": "09bcfc13-ace1-4e60-8ed3-2a3b1a09e957", "address": "fa:16:3e:e8:a7:0c", "network": {"id": "c7828c64-4d71-4c57-8df8-bb4524d9b9cb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-160068070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbd47fb3d5eb408aa751d1d49f198906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09bcfc13-ac", "ovs_interfaceid": "09bcfc13-ace1-4e60-8ed3-2a3b1a09e957", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:31:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ab2022ce-c28e-414a-8c45-59b961c1f874 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Releasing lock "refresh_cache-5965063c-8d1b-41d0-8c22-7d5b54925f94" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:31:05 user nova-compute[72766]: DEBUG nova.compute.manager [None req-ab2022ce-c28e-414a-8c45-59b961c1f874 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:31:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:07 user nova-compute[72766]: DEBUG nova.compute.manager [req-d9988122-e3e8-48b8-b240-43500532854b req-27d6f600-4954-4e84-a903-c383c7034e68 service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Received event network-vif-unplugged-09bcfc13-ace1-4e60-8ed3-2a3b1a09e957 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:31:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d9988122-e3e8-48b8-b240-43500532854b req-27d6f600-4954-4e84-a903-c383c7034e68 service nova] Acquiring lock "5965063c-8d1b-41d0-8c22-7d5b54925f94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:31:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d9988122-e3e8-48b8-b240-43500532854b req-27d6f600-4954-4e84-a903-c383c7034e68 service nova] Lock "5965063c-8d1b-41d0-8c22-7d5b54925f94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:31:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d9988122-e3e8-48b8-b240-43500532854b req-27d6f600-4954-4e84-a903-c383c7034e68 service nova] Lock "5965063c-8d1b-41d0-8c22-7d5b54925f94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:31:07 user nova-compute[72766]: DEBUG nova.compute.manager [req-d9988122-e3e8-48b8-b240-43500532854b req-27d6f600-4954-4e84-a903-c383c7034e68 service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] No waiting events found dispatching network-vif-unplugged-09bcfc13-ace1-4e60-8ed3-2a3b1a09e957 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:31:07 user nova-compute[72766]: WARNING nova.compute.manager [req-d9988122-e3e8-48b8-b240-43500532854b req-27d6f600-4954-4e84-a903-c383c7034e68 service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Received unexpected event network-vif-unplugged-09bcfc13-ace1-4e60-8ed3-2a3b1a09e957 for instance with vm_state active and task_state reboot_started.
Aug 14 23:31:08 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-ab2022ce-c28e-414a-8c45-59b961c1f874 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Instance shutdown successfully.
Aug 14 23:31:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:09 user nova-compute[72766]: DEBUG nova.compute.manager [req-8b46be5b-11f5-4ca8-be0f-404de3a674cd req-a7df30ff-b774-4162-a4ed-fd72ac2d1e48 service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Received event network-vif-plugged-09bcfc13-ace1-4e60-8ed3-2a3b1a09e957 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:31:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8b46be5b-11f5-4ca8-be0f-404de3a674cd req-a7df30ff-b774-4162-a4ed-fd72ac2d1e48 service nova] Acquiring lock "5965063c-8d1b-41d0-8c22-7d5b54925f94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:31:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8b46be5b-11f5-4ca8-be0f-404de3a674cd req-a7df30ff-b774-4162-a4ed-fd72ac2d1e48 service nova] Lock "5965063c-8d1b-41d0-8c22-7d5b54925f94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:31:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8b46be5b-11f5-4ca8-be0f-404de3a674cd req-a7df30ff-b774-4162-a4ed-fd72ac2d1e48 service nova] Lock "5965063c-8d1b-41d0-8c22-7d5b54925f94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:31:09 user nova-compute[72766]: DEBUG nova.compute.manager [req-8b46be5b-11f5-4ca8-be0f-404de3a674cd req-a7df30ff-b774-4162-a4ed-fd72ac2d1e48 service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] No waiting events found dispatching network-vif-plugged-09bcfc13-ace1-4e60-8ed3-2a3b1a09e957 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:31:09 user nova-compute[72766]: WARNING nova.compute.manager [req-8b46be5b-11f5-4ca8-be0f-404de3a674cd req-a7df30ff-b774-4162-a4ed-fd72ac2d1e48 service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Received unexpected event network-vif-plugged-09bcfc13-ace1-4e60-8ed3-2a3b1a09e957 for instance with vm_state active and task_state reboot_started.
Aug 14 23:31:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:09 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:31:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:31:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:31:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:31:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:31:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:31:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:31:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.imagecache [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Verify base images {{(pid=72766) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 14 23:31:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.imagecache [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=72766) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 14 23:31:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.imagecache [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Image id e78205bc-79cc-4112-a712-fbea0fc21162 yields fingerprint 15da94781a1b837df10535f333b7f105c95cab67 {{(pid=72766) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 14 23:31:09 user nova-compute[72766]: INFO nova.virt.libvirt.imagecache [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] image e78205bc-79cc-4112-a712-fbea0fc21162 at (/opt/stack/data/nova/instances/_base/15da94781a1b837df10535f333b7f105c95cab67): checking
Aug 14 23:31:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.imagecache [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] image e78205bc-79cc-4112-a712-fbea0fc21162 at (/opt/stack/data/nova/instances/_base/15da94781a1b837df10535f333b7f105c95cab67): image is in use {{(pid=72766) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 14 23:31:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.imagecache [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Image id d2900d30-2c4c-4d57-9135-d45564c0c596 yields fingerprint 19fc4d0991c501e6fc30087a0d9c389d8266c5eb {{(pid=72766) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 14 23:31:09 user nova-compute[72766]: INFO nova.virt.libvirt.imagecache [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] image d2900d30-2c4c-4d57-9135-d45564c0c596 at (/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb): checking
Aug 14 23:31:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.imagecache [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] image d2900d30-2c4c-4d57-9135-d45564c0c596 at (/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb): image is in use {{(pid=72766) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 14 23:31:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.imagecache [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] cbcf7851-e6f7-4f46-97cc-d773286ccddf is a valid instance name {{(pid=72766) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 14 23:31:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.imagecache [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] cbcf7851-e6f7-4f46-97cc-d773286ccddf has a disk file {{(pid=72766) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 14 23:31:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:31:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:31:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.imagecache [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance cbcf7851-e6f7-4f46-97cc-d773286ccddf is backed by 19fc4d0991c501e6fc30087a0d9c389d8266c5eb {{(pid=72766) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 14 23:31:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.imagecache [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] 5965063c-8d1b-41d0-8c22-7d5b54925f94 is a valid instance name {{(pid=72766) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 14 23:31:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.imagecache [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] 5965063c-8d1b-41d0-8c22-7d5b54925f94 has a disk file {{(pid=72766) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 14 23:31:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5965063c-8d1b-41d0-8c22-7d5b54925f94/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG nova.compute.manager [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 23:31:10 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Creating image(s)
Aug 14 23:31:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Did not create local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Ensure instance console log exists: /opt/stack/data/nova/instances/c5fe05bb-7204-47df-b033-a7462a21166c/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Start _get_guest_xml network_info=[{"id": "6346774b-2177-4e22-a7b2-faa064005d64", "address": "fa:16:3e:28:1f:4d", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6346774b-21", "ovs_interfaceid": "6346774b-2177-4e22-a7b2-faa064005d64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': '0eb0844b-6671-4ded-99f6-7ef5b64ab751', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'muFVWivH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c5fe05bb-7204-47df-b033-a7462a21166c', 'attached_at': '', 'detached_at': '', 'volume_id': '52e4fc71-e83e-49b1-b48b-aad06097b1e1', 'serial': '52e4fc71-e83e-49b1-b48b-aad06097b1e1'}, 'volume_type': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:31:10 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:31:10 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:31:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'muFVWivH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:31:10 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:31:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:31:10 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:31:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:31:10 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 23:31:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dae282c-0384-4512-aaef-79efac170263]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 23:31:10 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff04767d-ea0e-4e4f-b603-f7667f5ae68f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1] added
Aug 14 23:31:10 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5965063c-8d1b-41d0-8c22-7d5b54925f94/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.imagecache [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 5965063c-8d1b-41d0-8c22-7d5b54925f94 is backed by 15da94781a1b837df10535f333b7f105c95cab67 {{(pid=72766) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.imagecache [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] 211043bf-dcc9-44af-834c-75cd7be859ec is a valid instance name {{(pid=72766) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.imagecache [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] a31f7f11-fdd1-4e48-a275-78d6ad02224b is a valid instance name {{(pid=72766) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.imagecache [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] a31f7f11-fdd1-4e48-a275-78d6ad02224b has a disk file {{(pid=72766) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a31f7f11-fdd1-4e48-a275-78d6ad02224b/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a679de-12c2-4bff-9930-17712571863a]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[148086b4-5715-4009-afb5-db09553c6e30]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v muFVWivH {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v muFVWivH" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b3838e-c0ca-4646-af60-21c2223ce324]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'muFVWivH'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[941800b1-7261-44db-a0ae-0603c53d9ffc]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae95f6b-0111-476a-b986-e215f58c9159]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 (non-flash)
Aug 14 23:31:10 user nova-compute[72766]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0 (non-flash)
Aug 14 23:31:10 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 (non-flash)
Aug 14 23:31:10 user nova-compute[72766]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0 (non-flash)
Aug 14 23:31:10 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a31f7f11-fdd1-4e48-a275-78d6ad02224b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.imagecache [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance a31f7f11-fdd1-4e48-a275-78d6ad02224b is backed by 19fc4d0991c501e6fc30087a0d9c389d8266c5eb {{(pid=72766) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 14 23:31:10 user nova-compute[72766]: WARNING nova.virt.libvirt.imagecache [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Unknown base file: /opt/stack/data/nova/instances/_base/7a1b02c698f0ea3c3e662cb1c8d8fabe602c64a7
Aug 14 23:31:10 user nova-compute[72766]: WARNING nova.virt.libvirt.imagecache [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ed84c228178df78cc27ca3feae12a0d9dacc52d8
Aug 14 23:31:10 user nova-compute[72766]: WARNING nova.virt.libvirt.imagecache [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Unknown base file: /opt/stack/data/nova/instances/_base/347b00b853126ef1357b8f02601e6ca6a1afc796
Aug 14 23:31:10 user nova-compute[72766]: WARNING nova.virt.libvirt.imagecache [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3e5b3c8e9d2b0fe4ba9930f88be028915bfe298f
Aug 14 23:31:10 user nova-compute[72766]: WARNING nova.virt.libvirt.imagecache [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b2a3b78714e4106c70ce176722cdc74f1d77dcc7
Aug 14 23:31:10 user nova-compute[72766]: WARNING nova.virt.libvirt.imagecache [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Unknown base file: /opt/stack/data/nova/instances/_base/af38323517183bbf251eed8e619af2df5e4fd250
Aug 14 23:31:10 user nova-compute[72766]: WARNING nova.virt.libvirt.imagecache [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ee793a981ba5b499918b07506c55fad45d583c03
Aug 14 23:31:10 user nova-compute[72766]: WARNING nova.virt.libvirt.imagecache [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8005891b5d22480a01e40ca47f5293549de4b601
Aug 14 23:31:10 user nova-compute[72766]: INFO nova.virt.libvirt.imagecache [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Active base files: /opt/stack/data/nova/instances/_base/15da94781a1b837df10535f333b7f105c95cab67 /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb
Aug 14 23:31:10 user nova-compute[72766]: INFO nova.virt.libvirt.imagecache [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Removable base files: /opt/stack/data/nova/instances/_base/7a1b02c698f0ea3c3e662cb1c8d8fabe602c64a7 /opt/stack/data/nova/instances/_base/ed84c228178df78cc27ca3feae12a0d9dacc52d8 /opt/stack/data/nova/instances/_base/347b00b853126ef1357b8f02601e6ca6a1afc796 /opt/stack/data/nova/instances/_base/3e5b3c8e9d2b0fe4ba9930f88be028915bfe298f /opt/stack/data/nova/instances/_base/b2a3b78714e4106c70ce176722cdc74f1d77dcc7 /opt/stack/data/nova/instances/_base/af38323517183bbf251eed8e619af2df5e4fd250 /opt/stack/data/nova/instances/_base/ee793a981ba5b499918b07506c55fad45d583c03 /opt/stack/data/nova/instances/_base/8005891b5d22480a01e40ca47f5293549de4b601
Aug 14 23:31:10 user nova-compute[72766]: INFO nova.virt.libvirt.imagecache [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7a1b02c698f0ea3c3e662cb1c8d8fabe602c64a7
Aug 14 23:31:10 user nova-compute[72766]: INFO nova.virt.libvirt.imagecache [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ed84c228178df78cc27ca3feae12a0d9dacc52d8
Aug 14 23:31:10 user nova-compute[72766]: INFO nova.virt.libvirt.imagecache [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/347b00b853126ef1357b8f02601e6ca6a1afc796
Aug 14 23:31:10 user nova-compute[72766]: INFO nova.virt.libvirt.imagecache [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3e5b3c8e9d2b0fe4ba9930f88be028915bfe298f
Aug 14 23:31:10 user nova-compute[72766]: INFO nova.virt.libvirt.imagecache [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b2a3b78714e4106c70ce176722cdc74f1d77dcc7
Aug 14 23:31:10 user nova-compute[72766]: INFO nova.virt.libvirt.imagecache [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/af38323517183bbf251eed8e619af2df5e4fd250
Aug 14 23:31:10 user nova-compute[72766]: INFO nova.virt.libvirt.imagecache [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ee793a981ba5b499918b07506c55fad45d583c03
Aug 14 23:31:10 user nova-compute[72766]: INFO nova.virt.libvirt.imagecache [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8005891b5d22480a01e40ca47f5293549de4b601
Aug 14 23:31:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.imagecache [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Verification complete {{(pid=72766) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.imagecache [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Verify swap images {{(pid=72766) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.imagecache [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Verify ephemeral images {{(pid=72766) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a510c58f-0ac2-4a69-ba3e-52d56cfd46ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1, portal: 172.16.0.220,3260]
Aug 14 23:31:10 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1, portal: 172.16.0.220,3260] successful.
Aug 14 23:31:10 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[3547c706-c999-4981-92b8-8782b296bf48]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04d5949-a4a2-453f-8500-17a047150c67]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 (non-flash)
Aug 14 23:31:10 user nova-compute[72766]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0 (non-flash)
Aug 14 23:31:10 user nova-compute[72766]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 (non-flash)
Aug 14 23:31:10 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 (non-flash)
Aug 14 23:31:10 user nova-compute[72766]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0 (non-flash)
Aug 14 23:31:10 user nova-compute[72766]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 (non-flash)
Aug 14 23:31:10 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] HCTL ('35', '-', '-', 0) found on session 57 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2491957a-7d3d-4d28-8512-0e26d0a8c689]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Searching for a device in session 57 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:31:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'muFVWivH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 23:31:11 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:31:11 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23337303361626265', 'path': '/dev/sdd'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:31:11 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337303361626265', 'path': '/dev/sdd'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 23:31:11 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:30:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1198610515',display_name='tempest-TestVolumeBootPattern-server-1198610515',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1198610515',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPvSbILRfrlJBoXiI6yAoEx23QxBOaut7EAv1f2wh2U36gaT4scPzMrBzJaFGwi3LSF0CotAN19+FTvGG2504Ya9pzKNYbrJtakJiRU4EWISkkDaslgouPorjyQ0mmkoOQ==',key_name='tempest-TestVolumeBootPattern-925108064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3c9f53727cc497c94516ff7fa1bbf4f',ramdisk_id='',reservation_id='r-f21rltkv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-213280496',owner_user_name='tempest-TestVolumeBootPattern-213280496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:31:01Z,user_data=None,user_id='999390ac8e6240199c9a7484e234f3a7',uuid=c5fe05bb-7204-47df-b033-a7462a21166c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6346774b-2177-4e22-a7b2-faa064005d64", "address": "fa:16:3e:28:1f:4d", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6346774b-21", "ovs_interfaceid": "6346774b-2177-4e22-a7b2-faa064005d64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:31:11 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Converting VIF {"id": "6346774b-2177-4e22-a7b2-faa064005d64", "address": "fa:16:3e:28:1f:4d", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6346774b-21", "ovs_interfaceid": "6346774b-2177-4e22-a7b2-faa064005d64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:31:11 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:1f:4d,bridge_name='br-int',has_traffic_filtering=True,id=6346774b-2177-4e22-a7b2-faa064005d64,network=Network(f418a384-bbac-4892-8e0f-c7af2e9464ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6346774b-21') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:31:11 user nova-compute[72766]: DEBUG nova.objects.instance [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lazy-loading 'pci_devices' on Instance uuid c5fe05bb-7204-47df-b033-a7462a21166c {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:31:11 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:31:11 user nova-compute[72766]:   <uuid>c5fe05bb-7204-47df-b033-a7462a21166c</uuid>
Aug 14 23:31:11 user nova-compute[72766]:   <name>instance-0000002d</name>
Aug 14 23:31:11 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:31:11 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:31:11 user nova-compute[72766]:   <metadata>
Aug 14 23:31:11 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:31:11 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:31:11 user nova-compute[72766]:       <nova:name>tempest-TestVolumeBootPattern-server-1198610515</nova:name>
Aug 14 23:31:11 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:31:10</nova:creationTime>
Aug 14 23:31:11 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:31:11 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:31:11 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:31:11 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:31:11 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:31:11 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:31:11 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:31:11 user nova-compute[72766]:       <nova:owner>
Aug 14 23:31:11 user nova-compute[72766]:         <nova:user uuid="999390ac8e6240199c9a7484e234f3a7">tempest-TestVolumeBootPattern-213280496-project-member</nova:user>
Aug 14 23:31:11 user nova-compute[72766]:         <nova:project uuid="a3c9f53727cc497c94516ff7fa1bbf4f">tempest-TestVolumeBootPattern-213280496</nova:project>
Aug 14 23:31:11 user nova-compute[72766]:       </nova:owner>
Aug 14 23:31:11 user nova-compute[72766]:       <nova:ports>
Aug 14 23:31:11 user nova-compute[72766]:         <nova:port uuid="6346774b-2177-4e22-a7b2-faa064005d64">
Aug 14 23:31:11 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 23:31:11 user nova-compute[72766]:         </nova:port>
Aug 14 23:31:11 user nova-compute[72766]:       </nova:ports>
Aug 14 23:31:11 user nova-compute[72766]:     </nova:instance>
Aug 14 23:31:11 user nova-compute[72766]:   </metadata>
Aug 14 23:31:11 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:31:11 user nova-compute[72766]:     <system>
Aug 14 23:31:11 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:31:11 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:31:11 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:31:11 user nova-compute[72766]:       <entry name="serial">c5fe05bb-7204-47df-b033-a7462a21166c</entry>
Aug 14 23:31:11 user nova-compute[72766]:       <entry name="uuid">c5fe05bb-7204-47df-b033-a7462a21166c</entry>
Aug 14 23:31:11 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:31:11 user nova-compute[72766]:     </system>
Aug 14 23:31:11 user nova-compute[72766]:   </sysinfo>
Aug 14 23:31:11 user nova-compute[72766]:   <os>
Aug 14 23:31:11 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:31:11 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:31:11 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:31:11 user nova-compute[72766]:   </os>
Aug 14 23:31:11 user nova-compute[72766]:   <features>
Aug 14 23:31:11 user nova-compute[72766]:     <acpi/>
Aug 14 23:31:11 user nova-compute[72766]:     <apic/>
Aug 14 23:31:11 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:31:11 user nova-compute[72766]:   </features>
Aug 14 23:31:11 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:31:11 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:31:11 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:31:11 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:31:11 user nova-compute[72766]:   </clock>
Aug 14 23:31:11 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:31:11 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:31:11 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:31:11 user nova-compute[72766]:   </cpu>
Aug 14 23:31:11 user nova-compute[72766]:   <devices>
Aug 14 23:31:11 user nova-compute[72766]:     <disk type="block" device="disk">
Aug 14 23:31:11 user nova-compute[72766]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:31:11 user nova-compute[72766]:       <source dev="/dev/sdd"/>
Aug 14 23:31:11 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:31:11 user nova-compute[72766]:       <serial>52e4fc71-e83e-49b1-b48b-aad06097b1e1</serial>
Aug 14 23:31:11 user nova-compute[72766]:     </disk>
Aug 14 23:31:11 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:31:11 user nova-compute[72766]:       <mac address="fa:16:3e:28:1f:4d"/>
Aug 14 23:31:11 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:31:11 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:31:11 user nova-compute[72766]:       <target dev="tap6346774b-21"/>
Aug 14 23:31:11 user nova-compute[72766]:     </interface>
Aug 14 23:31:11 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:31:11 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/c5fe05bb-7204-47df-b033-a7462a21166c/console.log" append="off"/>
Aug 14 23:31:11 user nova-compute[72766]:     </serial>
Aug 14 23:31:11 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:31:11 user nova-compute[72766]:     <video>
Aug 14 23:31:11 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:31:11 user nova-compute[72766]:     </video>
Aug 14 23:31:11 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:31:11 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:31:11 user nova-compute[72766]:     </rng>
Aug 14 23:31:11 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:31:11 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:31:11 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:31:11 user nova-compute[72766]:     </memballoon>
Aug 14 23:31:11 user nova-compute[72766]:   </devices>
Aug 14 23:31:11 user nova-compute[72766]: </domain>
Aug 14 23:31:11 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:31:11 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:30:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1198610515',display_name='tempest-TestVolumeBootPattern-server-1198610515',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1198610515',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPvSbILRfrlJBoXiI6yAoEx23QxBOaut7EAv1f2wh2U36gaT4scPzMrBzJaFGwi3LSF0CotAN19+FTvGG2504Ya9pzKNYbrJtakJiRU4EWISkkDaslgouPorjyQ0mmkoOQ==',key_name='tempest-TestVolumeBootPattern-925108064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3c9f53727cc497c94516ff7fa1bbf4f',ramdisk_id='',reservation_id='r-f21rltkv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-213280496',owner_user_name='tempest-TestVolumeBootPattern-213280496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:31:01Z,user_data=None,user_id='999390ac8e6240199c9a7484e234f3a7',uuid=c5fe05bb-7204-47df-b033-a7462a21166c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6346774b-2177-4e22-a7b2-faa064005d64", "address": "fa:16:3e:28:1f:4d", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6346774b-21", "ovs_interfaceid": "6346774b-2177-4e22-a7b2-faa064005d64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:31:11 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Converting VIF {"id": "6346774b-2177-4e22-a7b2-faa064005d64", "address": "fa:16:3e:28:1f:4d", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6346774b-21", "ovs_interfaceid": "6346774b-2177-4e22-a7b2-faa064005d64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:31:11 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:1f:4d,bridge_name='br-int',has_traffic_filtering=True,id=6346774b-2177-4e22-a7b2-faa064005d64,network=Network(f418a384-bbac-4892-8e0f-c7af2e9464ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6346774b-21') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:31:11 user nova-compute[72766]: DEBUG os_vif [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:1f:4d,bridge_name='br-int',has_traffic_filtering=True,id=6346774b-2177-4e22-a7b2-faa064005d64,network=Network(f418a384-bbac-4892-8e0f-c7af2e9464ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6346774b-21') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:31:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:31:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:31:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6346774b-21, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:31:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6346774b-21, col_values=(('external_ids', {'iface-id': '6346774b-2177-4e22-a7b2-faa064005d64', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:1f:4d', 'vm-uuid': 'c5fe05bb-7204-47df-b033-a7462a21166c'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:31:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:31:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:11 user nova-compute[72766]: INFO os_vif [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:1f:4d,bridge_name='br-int',has_traffic_filtering=True,id=6346774b-2177-4e22-a7b2-faa064005d64,network=Network(f418a384-bbac-4892-8e0f-c7af2e9464ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6346774b-21')
Aug 14 23:31:11 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:31:11 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] No VIF found with MAC fa:16:3e:28:1f:4d, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:31:11 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Removed pending event for 5965063c-8d1b-41d0-8c22-7d5b54925f94 due to event {{(pid=72766) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 23:31:11 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692055871.604217, 5965063c-8d1b-41d0-8c22-7d5b54925f94 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:31:11 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] VM Resumed (Lifecycle Event)
Aug 14 23:31:11 user nova-compute[72766]: DEBUG nova.compute.manager [req-30308675-7cbf-40d3-b39e-659284c21172 req-7995a81e-349b-4758-a215-b19cd0bb2053 service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Received event network-vif-plugged-09bcfc13-ace1-4e60-8ed3-2a3b1a09e957 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:31:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-30308675-7cbf-40d3-b39e-659284c21172 req-7995a81e-349b-4758-a215-b19cd0bb2053 service nova] Acquiring lock "5965063c-8d1b-41d0-8c22-7d5b54925f94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:31:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-30308675-7cbf-40d3-b39e-659284c21172 req-7995a81e-349b-4758-a215-b19cd0bb2053 service nova] Lock "5965063c-8d1b-41d0-8c22-7d5b54925f94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:31:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-30308675-7cbf-40d3-b39e-659284c21172 req-7995a81e-349b-4758-a215-b19cd0bb2053 service nova] Lock "5965063c-8d1b-41d0-8c22-7d5b54925f94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:31:11 user nova-compute[72766]: DEBUG nova.compute.manager [req-30308675-7cbf-40d3-b39e-659284c21172 req-7995a81e-349b-4758-a215-b19cd0bb2053 service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] No waiting events found dispatching network-vif-plugged-09bcfc13-ace1-4e60-8ed3-2a3b1a09e957 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:31:11 user nova-compute[72766]: WARNING nova.compute.manager [req-30308675-7cbf-40d3-b39e-659284c21172 req-7995a81e-349b-4758-a215-b19cd0bb2053 service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Received unexpected event network-vif-plugged-09bcfc13-ace1-4e60-8ed3-2a3b1a09e957 for instance with vm_state active and task_state reboot_started.
Aug 14 23:31:11 user nova-compute[72766]: DEBUG nova.compute.manager [req-30308675-7cbf-40d3-b39e-659284c21172 req-7995a81e-349b-4758-a215-b19cd0bb2053 service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Received event network-vif-plugged-09bcfc13-ace1-4e60-8ed3-2a3b1a09e957 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:31:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-30308675-7cbf-40d3-b39e-659284c21172 req-7995a81e-349b-4758-a215-b19cd0bb2053 service nova] Acquiring lock "5965063c-8d1b-41d0-8c22-7d5b54925f94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:31:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-30308675-7cbf-40d3-b39e-659284c21172 req-7995a81e-349b-4758-a215-b19cd0bb2053 service nova] Lock "5965063c-8d1b-41d0-8c22-7d5b54925f94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:31:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-30308675-7cbf-40d3-b39e-659284c21172 req-7995a81e-349b-4758-a215-b19cd0bb2053 service nova] Lock "5965063c-8d1b-41d0-8c22-7d5b54925f94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:31:11 user nova-compute[72766]: DEBUG nova.compute.manager [req-30308675-7cbf-40d3-b39e-659284c21172 req-7995a81e-349b-4758-a215-b19cd0bb2053 service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] No waiting events found dispatching network-vif-plugged-09bcfc13-ace1-4e60-8ed3-2a3b1a09e957 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:31:11 user nova-compute[72766]: WARNING nova.compute.manager [req-30308675-7cbf-40d3-b39e-659284c21172 req-7995a81e-349b-4758-a215-b19cd0bb2053 service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Received unexpected event network-vif-plugged-09bcfc13-ace1-4e60-8ed3-2a3b1a09e957 for instance with vm_state active and task_state reboot_started.
Aug 14 23:31:11 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:31:11 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Instance running successfully.
Aug 14 23:31:11 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-ab2022ce-c28e-414a-8c45-59b961c1f874 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Instance soft rebooted successfully.
Aug 14 23:31:11 user nova-compute[72766]: DEBUG nova.compute.manager [None req-ab2022ce-c28e-414a-8c45-59b961c1f874 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:31:11 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:31:11 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 14 23:31:11 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692055871.6063652, 5965063c-8d1b-41d0-8c22-7d5b54925f94 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:31:11 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] VM Started (Lifecycle Event)
Aug 14 23:31:11 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:31:11 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:31:11 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 14 23:31:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ab2022ce-c28e-414a-8c45-59b961c1f874 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "5965063c-8d1b-41d0-8c22-7d5b54925f94" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.204s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:31:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d7563cb1-c69e-402a-921d-c318cacb7811 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "a31f7f11-fdd1-4e48-a275-78d6ad02224b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:31:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d7563cb1-c69e-402a-921d-c318cacb7811 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "a31f7f11-fdd1-4e48-a275-78d6ad02224b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:31:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d7563cb1-c69e-402a-921d-c318cacb7811 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "a31f7f11-fdd1-4e48-a275-78d6ad02224b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:31:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d7563cb1-c69e-402a-921d-c318cacb7811 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "a31f7f11-fdd1-4e48-a275-78d6ad02224b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:31:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d7563cb1-c69e-402a-921d-c318cacb7811 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "a31f7f11-fdd1-4e48-a275-78d6ad02224b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:31:12 user nova-compute[72766]: INFO nova.compute.manager [None req-d7563cb1-c69e-402a-921d-c318cacb7811 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Terminating instance
Aug 14 23:31:12 user nova-compute[72766]: DEBUG nova.compute.manager [None req-d7563cb1-c69e-402a-921d-c318cacb7811 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:31:12 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:12 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:12 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:12 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:12 user nova-compute[72766]: DEBUG nova.compute.manager [req-6bd55287-99d6-4908-84ff-1685bd138308 req-933557ee-c39e-4cc3-9754-b5f97020fcbe service nova] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Received event network-vif-unplugged-3f64a69a-f0a6-4815-ac3b-55de6f80c83c {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:31:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-6bd55287-99d6-4908-84ff-1685bd138308 req-933557ee-c39e-4cc3-9754-b5f97020fcbe service nova] Acquiring lock "a31f7f11-fdd1-4e48-a275-78d6ad02224b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:31:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-6bd55287-99d6-4908-84ff-1685bd138308 req-933557ee-c39e-4cc3-9754-b5f97020fcbe service nova] Lock "a31f7f11-fdd1-4e48-a275-78d6ad02224b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:31:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-6bd55287-99d6-4908-84ff-1685bd138308 req-933557ee-c39e-4cc3-9754-b5f97020fcbe service nova] Lock "a31f7f11-fdd1-4e48-a275-78d6ad02224b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:31:12 user nova-compute[72766]: DEBUG nova.compute.manager [req-6bd55287-99d6-4908-84ff-1685bd138308 req-933557ee-c39e-4cc3-9754-b5f97020fcbe service nova] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] No waiting events found dispatching network-vif-unplugged-3f64a69a-f0a6-4815-ac3b-55de6f80c83c {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:31:12 user nova-compute[72766]: DEBUG nova.compute.manager [req-6bd55287-99d6-4908-84ff-1685bd138308 req-933557ee-c39e-4cc3-9754-b5f97020fcbe service nova] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Received event network-vif-unplugged-3f64a69a-f0a6-4815-ac3b-55de6f80c83c for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:31:12 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:12 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:12 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:13 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Instance destroyed successfully.
Aug 14 23:31:13 user nova-compute[72766]: DEBUG nova.objects.instance [None req-d7563cb1-c69e-402a-921d-c318cacb7811 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lazy-loading 'resources' on Instance uuid a31f7f11-fdd1-4e48-a275-78d6ad02224b {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:31:13 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-d7563cb1-c69e-402a-921d-c318cacb7811 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:28:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-5764886',display_name='tempest-AttachVolumeNegativeTest-server-5764886',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-5764886',id=41,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTYdbPNovDhK/nmLZG3LuoS40DRaX1UMgKDAdTNM1uBdt/Lq9erAon/+IIUHXr5255Jln1EYgDlmFwMcIWLc76O6/+6NO9ikZSxXGTpKJIL4nJiAk8iLz0F6kAgRJYKtg==',key_name='tempest-keypair-1027438596',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:28:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3785d8cff6cd41a4aff8becf528e3a4c',ramdisk_id='',reservation_id='r-zbfnohxj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1623363641',owner_user_name='tempest-AttachVolumeNegativeTest-1623363641-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:28:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90e68d4dfd6048d99037fce632788b57',uuid=a31f7f11-fdd1-4e48-a275-78d6ad02224b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f64a69a-f0a6-4815-ac3b-55de6f80c83c", "address": "fa:16:3e:ea:38:e7", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f64a69a-f0", "ovs_interfaceid": "3f64a69a-f0a6-4815-ac3b-55de6f80c83c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:31:13 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-d7563cb1-c69e-402a-921d-c318cacb7811 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Converting VIF {"id": "3f64a69a-f0a6-4815-ac3b-55de6f80c83c", "address": "fa:16:3e:ea:38:e7", "network": {"id": "9491b8be-e6b2-4770-a591-370db9a96785", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2118810936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3785d8cff6cd41a4aff8becf528e3a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f64a69a-f0", "ovs_interfaceid": "3f64a69a-f0a6-4815-ac3b-55de6f80c83c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:31:13 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-d7563cb1-c69e-402a-921d-c318cacb7811 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:38:e7,bridge_name='br-int',has_traffic_filtering=True,id=3f64a69a-f0a6-4815-ac3b-55de6f80c83c,network=Network(9491b8be-e6b2-4770-a591-370db9a96785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f64a69a-f0') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:31:13 user nova-compute[72766]: DEBUG os_vif [None req-d7563cb1-c69e-402a-921d-c318cacb7811 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:38:e7,bridge_name='br-int',has_traffic_filtering=True,id=3f64a69a-f0a6-4815-ac3b-55de6f80c83c,network=Network(9491b8be-e6b2-4770-a591-370db9a96785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f64a69a-f0') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:31:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f64a69a-f0, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:31:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:13 user nova-compute[72766]: INFO os_vif [None req-d7563cb1-c69e-402a-921d-c318cacb7811 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:38:e7,bridge_name='br-int',has_traffic_filtering=True,id=3f64a69a-f0a6-4815-ac3b-55de6f80c83c,network=Network(9491b8be-e6b2-4770-a591-370db9a96785),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f64a69a-f0')
Aug 14 23:31:13 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-d7563cb1-c69e-402a-921d-c318cacb7811 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Deleting instance files /opt/stack/data/nova/instances/a31f7f11-fdd1-4e48-a275-78d6ad02224b_del
Aug 14 23:31:13 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-d7563cb1-c69e-402a-921d-c318cacb7811 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Deletion of /opt/stack/data/nova/instances/a31f7f11-fdd1-4e48-a275-78d6ad02224b_del complete
Aug 14 23:31:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:13 user nova-compute[72766]: INFO nova.compute.manager [None req-d7563cb1-c69e-402a-921d-c318cacb7811 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Took 1.39 seconds to destroy the instance on the hypervisor.
Aug 14 23:31:13 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-d7563cb1-c69e-402a-921d-c318cacb7811 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:31:13 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:31:13 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:31:13 user nova-compute[72766]: DEBUG nova.compute.manager [req-ff41ef66-599d-4a90-b6ce-44dffccae73f req-bd0b38e6-9406-47cb-9b3e-10f806844ceb service nova] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Received event network-vif-plugged-6346774b-2177-4e22-a7b2-faa064005d64 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:31:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ff41ef66-599d-4a90-b6ce-44dffccae73f req-bd0b38e6-9406-47cb-9b3e-10f806844ceb service nova] Acquiring lock "c5fe05bb-7204-47df-b033-a7462a21166c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:31:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ff41ef66-599d-4a90-b6ce-44dffccae73f req-bd0b38e6-9406-47cb-9b3e-10f806844ceb service nova] Lock "c5fe05bb-7204-47df-b033-a7462a21166c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:31:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ff41ef66-599d-4a90-b6ce-44dffccae73f req-bd0b38e6-9406-47cb-9b3e-10f806844ceb service nova] Lock "c5fe05bb-7204-47df-b033-a7462a21166c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:31:13 user nova-compute[72766]: DEBUG nova.compute.manager [req-ff41ef66-599d-4a90-b6ce-44dffccae73f req-bd0b38e6-9406-47cb-9b3e-10f806844ceb service nova] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] No waiting events found dispatching network-vif-plugged-6346774b-2177-4e22-a7b2-faa064005d64 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:31:13 user nova-compute[72766]: WARNING nova.compute.manager [req-ff41ef66-599d-4a90-b6ce-44dffccae73f req-bd0b38e6-9406-47cb-9b3e-10f806844ceb service nova] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Received unexpected event network-vif-plugged-6346774b-2177-4e22-a7b2-faa064005d64 for instance with vm_state building and task_state spawning.
Aug 14 23:31:13 user nova-compute[72766]: DEBUG nova.compute.manager [req-ff41ef66-599d-4a90-b6ce-44dffccae73f req-bd0b38e6-9406-47cb-9b3e-10f806844ceb service nova] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Received event network-vif-plugged-6346774b-2177-4e22-a7b2-faa064005d64 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:31:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ff41ef66-599d-4a90-b6ce-44dffccae73f req-bd0b38e6-9406-47cb-9b3e-10f806844ceb service nova] Acquiring lock "c5fe05bb-7204-47df-b033-a7462a21166c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:31:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ff41ef66-599d-4a90-b6ce-44dffccae73f req-bd0b38e6-9406-47cb-9b3e-10f806844ceb service nova] Lock "c5fe05bb-7204-47df-b033-a7462a21166c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:31:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ff41ef66-599d-4a90-b6ce-44dffccae73f req-bd0b38e6-9406-47cb-9b3e-10f806844ceb service nova] Lock "c5fe05bb-7204-47df-b033-a7462a21166c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:31:13 user nova-compute[72766]: DEBUG nova.compute.manager [req-ff41ef66-599d-4a90-b6ce-44dffccae73f req-bd0b38e6-9406-47cb-9b3e-10f806844ceb service nova] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] No waiting events found dispatching network-vif-plugged-6346774b-2177-4e22-a7b2-faa064005d64 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:31:13 user nova-compute[72766]: WARNING nova.compute.manager [req-ff41ef66-599d-4a90-b6ce-44dffccae73f req-bd0b38e6-9406-47cb-9b3e-10f806844ceb service nova] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Received unexpected event network-vif-plugged-6346774b-2177-4e22-a7b2-faa064005d64 for instance with vm_state building and task_state spawning.
Aug 14 23:31:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:14 user nova-compute[72766]: DEBUG nova.compute.manager [req-67c3c5ae-415a-4a6c-947a-0de66b54c944 req-64554ce0-7774-44ef-b83e-ff62f8058e6d service nova] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Received event network-vif-plugged-3f64a69a-f0a6-4815-ac3b-55de6f80c83c {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:31:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-67c3c5ae-415a-4a6c-947a-0de66b54c944 req-64554ce0-7774-44ef-b83e-ff62f8058e6d service nova] Acquiring lock "a31f7f11-fdd1-4e48-a275-78d6ad02224b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:31:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-67c3c5ae-415a-4a6c-947a-0de66b54c944 req-64554ce0-7774-44ef-b83e-ff62f8058e6d service nova] Lock "a31f7f11-fdd1-4e48-a275-78d6ad02224b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:31:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-67c3c5ae-415a-4a6c-947a-0de66b54c944 req-64554ce0-7774-44ef-b83e-ff62f8058e6d service nova] Lock "a31f7f11-fdd1-4e48-a275-78d6ad02224b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:31:14 user nova-compute[72766]: DEBUG nova.compute.manager [req-67c3c5ae-415a-4a6c-947a-0de66b54c944 req-64554ce0-7774-44ef-b83e-ff62f8058e6d service nova] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] No waiting events found dispatching network-vif-plugged-3f64a69a-f0a6-4815-ac3b-55de6f80c83c {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:31:14 user nova-compute[72766]: WARNING nova.compute.manager [req-67c3c5ae-415a-4a6c-947a-0de66b54c944 req-64554ce0-7774-44ef-b83e-ff62f8058e6d service nova] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Received unexpected event network-vif-plugged-3f64a69a-f0a6-4815-ac3b-55de6f80c83c for instance with vm_state active and task_state deleting.
Aug 14 23:31:14 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:31:14 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Took 1.10 seconds to deallocate network for instance.
Aug 14 23:31:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d7563cb1-c69e-402a-921d-c318cacb7811 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:31:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d7563cb1-c69e-402a-921d-c318cacb7811 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:31:14 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-d7563cb1-c69e-402a-921d-c318cacb7811 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:31:14 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-d7563cb1-c69e-402a-921d-c318cacb7811 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:31:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d7563cb1-c69e-402a-921d-c318cacb7811 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.208s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:31:14 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-d7563cb1-c69e-402a-921d-c318cacb7811 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Deleted allocations for instance a31f7f11-fdd1-4e48-a275-78d6ad02224b
Aug 14 23:31:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d7563cb1-c69e-402a-921d-c318cacb7811 tempest-AttachVolumeNegativeTest-1623363641 tempest-AttachVolumeNegativeTest-1623363641-project-member] Lock "a31f7f11-fdd1-4e48-a275-78d6ad02224b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.890s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:31:15 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692055875.3031437, c5fe05bb-7204-47df-b033-a7462a21166c => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:31:15 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] VM Resumed (Lifecycle Event)
Aug 14 23:31:15 user nova-compute[72766]: DEBUG nova.compute.manager [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:31:15 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 23:31:15 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Instance spawned successfully.
Aug 14 23:31:15 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 23:31:15 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:31:15 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:31:15 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:31:15 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:31:15 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:31:15 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:31:15 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:31:15 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:31:15 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:31:15 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692055875.3103597, c5fe05bb-7204-47df-b033-a7462a21166c => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:31:15 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] VM Started (Lifecycle Event)
Aug 14 23:31:15 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:31:15 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:31:15 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:31:15 user nova-compute[72766]: INFO nova.compute.manager [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Took 5.41 seconds to spawn the instance on the hypervisor.
Aug 14 23:31:15 user nova-compute[72766]: DEBUG nova.compute.manager [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:31:15 user nova-compute[72766]: INFO nova.compute.manager [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Took 15.38 seconds to build instance.
Aug 14 23:31:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-debd734a-20a2-4db3-b7c7-e2f632a25c38 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "c5fe05bb-7204-47df-b033-a7462a21166c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.470s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:31:15 user nova-compute[72766]: DEBUG nova.compute.manager [req-2931e2e2-60f5-4ee0-b6df-e98f844497bc req-ccb64104-bf58-41d3-aac6-6a247cc37c8c service nova] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Received event network-vif-deleted-3f64a69a-f0a6-4815-ac3b-55de6f80c83c {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:31:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:28 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692055873.4543207, a31f7f11-fdd1-4e48-a275-78d6ad02224b => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:31:28 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] VM Stopped (Lifecycle Event)
Aug 14 23:31:28 user nova-compute[72766]: DEBUG nova.compute.manager [None req-301cb39d-324e-4ef7-a130-1eb2aa882638 None None] [instance: a31f7f11-fdd1-4e48-a275-78d6ad02224b] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:31:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:31:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:39 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:40 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:31:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:43 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:31:43 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:31:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-5965063c-8d1b-41d0-8c22-7d5b54925f94" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:31:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-5965063c-8d1b-41d0-8c22-7d5b54925f94" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:31:43 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:31:44 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Updating instance_info_cache with network_info: [{"id": "09bcfc13-ace1-4e60-8ed3-2a3b1a09e957", "address": "fa:16:3e:e8:a7:0c", "network": {"id": "c7828c64-4d71-4c57-8df8-bb4524d9b9cb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-160068070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbd47fb3d5eb408aa751d1d49f198906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09bcfc13-ac", "ovs_interfaceid": "09bcfc13-ace1-4e60-8ed3-2a3b1a09e957", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:31:44 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-5965063c-8d1b-41d0-8c22-7d5b54925f94" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:31:44 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:31:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:45 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:31:45 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:31:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:31:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:31:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:31:45 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:31:45 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:31:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:31:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:31:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:31:46 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:31:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5965063c-8d1b-41d0-8c22-7d5b54925f94/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:31:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5965063c-8d1b-41d0-8c22-7d5b54925f94/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:31:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5965063c-8d1b-41d0-8c22-7d5b54925f94/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:31:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5965063c-8d1b-41d0-8c22-7d5b54925f94/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:31:46 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:31:46 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:31:46 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:31:47 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:31:47 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=8233MB free_disk=25.246532440185547GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:31:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:31:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:31:47 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance cbcf7851-e6f7-4f46-97cc-d773286ccddf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:31:47 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 5965063c-8d1b-41d0-8c22-7d5b54925f94 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:31:47 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 211043bf-dcc9-44af-834c-75cd7be859ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:31:47 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance c5fe05bb-7204-47df-b033-a7462a21166c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:31:47 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:31:47 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:31:47 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Refreshing inventories for resource provider 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 23:31:47 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Updating ProviderTree inventory for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 23:31:47 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Updating inventory in ProviderTree for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 23:31:47 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Refreshing aggregate associations for resource provider 45c8ff08-bf31-4ab6-8452-2e293102f899, aggregates: None {{(pid=72766) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 23:31:47 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Refreshing trait associations for resource provider 45c8ff08-bf31-4ab6-8452-2e293102f899, traits: COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=72766) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 23:31:47 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:31:47 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:31:47 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:31:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.472s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:31:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:50 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:31:50 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:31:50 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:31:52 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:31:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:31:53 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:31:55 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:31:55 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:31:56 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:31:56 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Triggering sync for uuid cbcf7851-e6f7-4f46-97cc-d773286ccddf {{(pid=72766) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 23:31:56 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Triggering sync for uuid 5965063c-8d1b-41d0-8c22-7d5b54925f94 {{(pid=72766) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 23:31:56 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Triggering sync for uuid 211043bf-dcc9-44af-834c-75cd7be859ec {{(pid=72766) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 23:31:56 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Triggering sync for uuid c5fe05bb-7204-47df-b033-a7462a21166c {{(pid=72766) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 23:31:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "cbcf7851-e6f7-4f46-97cc-d773286ccddf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:31:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "cbcf7851-e6f7-4f46-97cc-d773286ccddf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:31:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "5965063c-8d1b-41d0-8c22-7d5b54925f94" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:31:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "5965063c-8d1b-41d0-8c22-7d5b54925f94" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:31:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "211043bf-dcc9-44af-834c-75cd7be859ec" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:31:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "211043bf-dcc9-44af-834c-75cd7be859ec" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:31:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "c5fe05bb-7204-47df-b033-a7462a21166c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:31:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "c5fe05bb-7204-47df-b033-a7462a21166c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:31:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "5965063c-8d1b-41d0-8c22-7d5b54925f94" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:31:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "cbcf7851-e6f7-4f46-97cc-d773286ccddf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:31:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "211043bf-dcc9-44af-834c-75cd7be859ec" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:31:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "c5fe05bb-7204-47df-b033-a7462a21166c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:31:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:32:02 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:32:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:32:05 user nova-compute[72766]: DEBUG nova.compute.manager [req-1ea749b7-634b-47a3-960b-883daf80eb32 req-b741b32d-30be-4c4c-90fb-c80d9adfab75 service nova] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Received event network-changed-8f65f8f0-60fe-4fdb-af66-424a85b12caf {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:32:05 user nova-compute[72766]: DEBUG nova.compute.manager [req-1ea749b7-634b-47a3-960b-883daf80eb32 req-b741b32d-30be-4c4c-90fb-c80d9adfab75 service nova] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Refreshing instance network info cache due to event network-changed-8f65f8f0-60fe-4fdb-af66-424a85b12caf. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:32:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-1ea749b7-634b-47a3-960b-883daf80eb32 req-b741b32d-30be-4c4c-90fb-c80d9adfab75 service nova] Acquiring lock "refresh_cache-cbcf7851-e6f7-4f46-97cc-d773286ccddf" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:32:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-1ea749b7-634b-47a3-960b-883daf80eb32 req-b741b32d-30be-4c4c-90fb-c80d9adfab75 service nova] Acquired lock "refresh_cache-cbcf7851-e6f7-4f46-97cc-d773286ccddf" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:32:05 user nova-compute[72766]: DEBUG nova.network.neutron [req-1ea749b7-634b-47a3-960b-883daf80eb32 req-b741b32d-30be-4c4c-90fb-c80d9adfab75 service nova] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Refreshing network info cache for port 8f65f8f0-60fe-4fdb-af66-424a85b12caf {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:32:06 user nova-compute[72766]: DEBUG nova.network.neutron [req-1ea749b7-634b-47a3-960b-883daf80eb32 req-b741b32d-30be-4c4c-90fb-c80d9adfab75 service nova] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Updated VIF entry in instance network info cache for port 8f65f8f0-60fe-4fdb-af66-424a85b12caf. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:32:06 user nova-compute[72766]: DEBUG nova.network.neutron [req-1ea749b7-634b-47a3-960b-883daf80eb32 req-b741b32d-30be-4c4c-90fb-c80d9adfab75 service nova] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Updating instance_info_cache with network_info: [{"id": "8f65f8f0-60fe-4fdb-af66-424a85b12caf", "address": "fa:16:3e:70:30:66", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f65f8f0-60", "ovs_interfaceid": "8f65f8f0-60fe-4fdb-af66-424a85b12caf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:32:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-1ea749b7-634b-47a3-960b-883daf80eb32 req-b741b32d-30be-4c4c-90fb-c80d9adfab75 service nova] Releasing lock "refresh_cache-cbcf7851-e6f7-4f46-97cc-d773286ccddf" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:32:07 user nova-compute[72766]: DEBUG nova.compute.manager [req-6f31ea0c-7993-4323-8e43-a2156f9fa746 req-64ed1460-64e0-4866-8010-552133ee3b90 service nova] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Received event network-changed-3e62931c-4358-4153-8d5e-c4675640e3fa {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:32:07 user nova-compute[72766]: DEBUG nova.compute.manager [req-6f31ea0c-7993-4323-8e43-a2156f9fa746 req-64ed1460-64e0-4866-8010-552133ee3b90 service nova] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Refreshing instance network info cache due to event network-changed-3e62931c-4358-4153-8d5e-c4675640e3fa. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:32:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-6f31ea0c-7993-4323-8e43-a2156f9fa746 req-64ed1460-64e0-4866-8010-552133ee3b90 service nova] Acquiring lock "refresh_cache-211043bf-dcc9-44af-834c-75cd7be859ec" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:32:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-6f31ea0c-7993-4323-8e43-a2156f9fa746 req-64ed1460-64e0-4866-8010-552133ee3b90 service nova] Acquired lock "refresh_cache-211043bf-dcc9-44af-834c-75cd7be859ec" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:32:07 user nova-compute[72766]: DEBUG nova.network.neutron [req-6f31ea0c-7993-4323-8e43-a2156f9fa746 req-64ed1460-64e0-4866-8010-552133ee3b90 service nova] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Refreshing network info cache for port 3e62931c-4358-4153-8d5e-c4675640e3fa {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:32:07 user nova-compute[72766]: DEBUG nova.network.neutron [req-6f31ea0c-7993-4323-8e43-a2156f9fa746 req-64ed1460-64e0-4866-8010-552133ee3b90 service nova] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Updated VIF entry in instance network info cache for port 3e62931c-4358-4153-8d5e-c4675640e3fa. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:32:07 user nova-compute[72766]: DEBUG nova.network.neutron [req-6f31ea0c-7993-4323-8e43-a2156f9fa746 req-64ed1460-64e0-4866-8010-552133ee3b90 service nova] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Updating instance_info_cache with network_info: [{"id": "3e62931c-4358-4153-8d5e-c4675640e3fa", "address": "fa:16:3e:2b:91:b3", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e62931c-43", "ovs_interfaceid": "3e62931c-4358-4153-8d5e-c4675640e3fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:32:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-6f31ea0c-7993-4323-8e43-a2156f9fa746 req-64ed1460-64e0-4866-8010-552133ee3b90 service nova] Releasing lock "refresh_cache-211043bf-dcc9-44af-834c-75cd7be859ec" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:32:07 user nova-compute[72766]: DEBUG nova.compute.manager [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Stashing vm_state: active {{(pid=72766) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 14 23:32:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:32:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:32:07 user nova-compute[72766]: DEBUG nova.objects.instance [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lazy-loading 'pci_requests' on Instance uuid 211043bf-dcc9-44af-834c-75cd7be859ec {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:32:08 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 23:32:08 user nova-compute[72766]: INFO nova.compute.claims [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Claim successful on node user
Aug 14 23:32:08 user nova-compute[72766]: DEBUG nova.objects.instance [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lazy-loading 'resources' on Instance uuid 211043bf-dcc9-44af-834c-75cd7be859ec {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:32:08 user nova-compute[72766]: DEBUG nova.objects.instance [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lazy-loading 'pci_devices' on Instance uuid 211043bf-dcc9-44af-834c-75cd7be859ec {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:32:08 user nova-compute[72766]: INFO nova.compute.resource_tracker [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Updating resource usage from migration 6547e6b5-107f-4c3f-9d74-6a75e3427a67
Aug 14 23:32:08 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:32:08 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:32:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.316s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:32:08 user nova-compute[72766]: INFO nova.compute.manager [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Migrating
Aug 14 23:32:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "refresh_cache-211043bf-dcc9-44af-834c-75cd7be859ec" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:32:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquired lock "refresh_cache-211043bf-dcc9-44af-834c-75cd7be859ec" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:32:08 user nova-compute[72766]: DEBUG nova.network.neutron [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:32:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:32:08 user nova-compute[72766]: DEBUG nova.network.neutron [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Updating instance_info_cache with network_info: [{"id": "3e62931c-4358-4153-8d5e-c4675640e3fa", "address": "fa:16:3e:2b:91:b3", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e62931c-43", "ovs_interfaceid": "3e62931c-4358-4153-8d5e-c4675640e3fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:32:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Releasing lock "refresh_cache-211043bf-dcc9-44af-834c-75cd7be859ec" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Starting migrate_disk_and_power_off {{(pid=72766) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG nova.compute.manager [req-24e51f71-55e6-44b1-b123-f61e52f474eb req-0cba49d6-4fea-48a7-bae0-edde183d5a0b service nova] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Received event network-vif-unplugged-3e62931c-4358-4153-8d5e-c4675640e3fa {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-24e51f71-55e6-44b1-b123-f61e52f474eb req-0cba49d6-4fea-48a7-bae0-edde183d5a0b service nova] Acquiring lock "211043bf-dcc9-44af-834c-75cd7be859ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-24e51f71-55e6-44b1-b123-f61e52f474eb req-0cba49d6-4fea-48a7-bae0-edde183d5a0b service nova] Lock "211043bf-dcc9-44af-834c-75cd7be859ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-24e51f71-55e6-44b1-b123-f61e52f474eb req-0cba49d6-4fea-48a7-bae0-edde183d5a0b service nova] Lock "211043bf-dcc9-44af-834c-75cd7be859ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG nova.compute.manager [req-24e51f71-55e6-44b1-b123-f61e52f474eb req-0cba49d6-4fea-48a7-bae0-edde183d5a0b service nova] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] No waiting events found dispatching network-vif-unplugged-3e62931c-4358-4153-8d5e-c4675640e3fa {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:32:09 user nova-compute[72766]: WARNING nova.compute.manager [req-24e51f71-55e6-44b1-b123-f61e52f474eb req-0cba49d6-4fea-48a7-bae0-edde183d5a0b service nova] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Received unexpected event network-vif-unplugged-3e62931c-4358-4153-8d5e-c4675640e3fa for instance with vm_state active and task_state resize_migrating.
Aug 14 23:32:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:32:09 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Instance destroyed successfully.
Aug 14 23:32:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:30:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1043518379',display_name='tempest-ServerActionsTestOtherA-server-1043518379',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1043518379',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDoXZolQqtFAUPpymn6Ku7JgXGw46vxp59imOajNHAEz0LQOA2HZ029jKc7yJ8uxT7IHJ390d7ScJ6pqdFfhcnBy/F6i10LDXWERfUkUg5mrEOI4hiQbJjkhq6PVnEbSQ==',key_name='tempest-keypair-1635999225',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:30:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7b0d4f038dbd47b1aad9829f19cb4896',ramdisk_id='',reservation_id='r-ultip2q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-242565278',owner_user_name='tempest-ServerActionsTestOtherA-242565278-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:32:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11bf21631dd0447f8f1a3f2b012ec43a',uuid=211043bf-dcc9-44af-834c-75cd7be859ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e62931c-4358-4153-8d5e-c4675640e3fa", "address": "fa:16:3e:2b:91:b3", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1477248697-network", "vif_mac": "fa:16:3e:2b:91:b3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e62931c-43", "ovs_interfaceid": "3e62931c-4358-4153-8d5e-c4675640e3fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Converting VIF {"id": "3e62931c-4358-4153-8d5e-c4675640e3fa", "address": "fa:16:3e:2b:91:b3", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1477248697-network", "vif_mac": "fa:16:3e:2b:91:b3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e62931c-43", "ovs_interfaceid": "3e62931c-4358-4153-8d5e-c4675640e3fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:91:b3,bridge_name='br-int',has_traffic_filtering=True,id=3e62931c-4358-4153-8d5e-c4675640e3fa,network=Network(e0bbc182-f700-4a82-84ae-7cbcb2e517c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e62931c-43') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG os_vif [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:91:b3,bridge_name='br-int',has_traffic_filtering=True,id=3e62931c-4358-4153-8d5e-c4675640e3fa,network=Network(e0bbc182-f700-4a82-84ae-7cbcb2e517c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e62931c-43') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e62931c-43, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:32:09 user nova-compute[72766]: INFO os_vif [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:91:b3,bridge_name='br-int',has_traffic_filtering=True,id=3e62931c-4358-4153-8d5e-c4675640e3fa,network=Network(e0bbc182-f700-4a82-84ae-7cbcb2e517c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e62931c-43')
Aug 14 23:32:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FcvtBHop', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:32:09 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:32:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a800c3f9-d70e-4cbc-a5ad-a63216ec3530]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26cea28-7106-4bf6-8ff1-4b40016a0b69]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 (non-flash)
Aug 14 23:32:09 user nova-compute[72766]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0 (non-flash)
Aug 14 23:32:09 user nova-compute[72766]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 (non-flash)
Aug 14 23:32:09 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 (non-flash)
Aug 14 23:32:09 user nova-compute[72766]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0 (non-flash)
Aug 14 23:32:09 user nova-compute[72766]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 (non-flash)
Aug 14 23:32:09 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff16c366dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737'): ({'sdb'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Removing single pathed devices sdb {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7409e91-1d1c-4e9e-9a07-8a814531edec]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fde585b-3acb-4904-923c-00728e88f3f0]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Flushing IO for device /dev/sdb {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c50cadf-f185-45ae-b41a-e8e56cc41417]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[7518eafa-0d96-436e-b8e8-059230822a66]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] SCSI volumes sdb have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_53840b11', '/dev/disk/by-id/scsi-23238316530333662', '/dev/disk/by-id/scsi-1SCST_BIO53840b11-281e036b3e5c212f') {{(pid=83651) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 23:32:09 user nova-compute[72766]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_53840b11
Aug 14 23:32:09 user nova-compute[72766]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23238316530333662
Aug 14 23:32:09 user nova-compute[72766]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO53840b11-281e036b3e5c212f
Aug 14 23:32:09 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebff239f-1da5-4725-be3d-bef5602ccf1d]: (4, None) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:32:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:32:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:32:10 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[021da0f3-aa8b-4b88-bbf3-30a4f21c31b5]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:32:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:32:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:32:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:32:10 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93e1adf-8296-4a59-8728-e31d087b55ac]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:32:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737, portal: 172.16.0.220,3260]
Aug 14 23:32:10 user nova-compute[72766]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737, portal: 172.16.0.220,3260] successful.
Aug 14 23:32:10 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:32:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:32:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:32:10 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c658688-fea3-4c7d-8d78-23b3f2aecf31]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:32:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:32:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:32:10 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] <== disconnect_volume: return (320ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:32:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:32:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:32:11 user nova-compute[72766]: DEBUG nova.network.neutron [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Port 3e62931c-4358-4153-8d5e-c4675640e3fa binding to destination host user is already ACTIVE {{(pid=72766) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 14 23:32:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "211043bf-dcc9-44af-834c-75cd7be859ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:32:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "211043bf-dcc9-44af-834c-75cd7be859ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:32:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "211043bf-dcc9-44af-834c-75cd7be859ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:32:11 user nova-compute[72766]: DEBUG nova.compute.manager [req-9b22d994-1281-44b4-8d45-1d73065c28de req-ab8e4319-74e9-4def-bd0e-94cb013d32d3 service nova] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Received event network-vif-plugged-3e62931c-4358-4153-8d5e-c4675640e3fa {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:32:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9b22d994-1281-44b4-8d45-1d73065c28de req-ab8e4319-74e9-4def-bd0e-94cb013d32d3 service nova] Acquiring lock "211043bf-dcc9-44af-834c-75cd7be859ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:32:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9b22d994-1281-44b4-8d45-1d73065c28de req-ab8e4319-74e9-4def-bd0e-94cb013d32d3 service nova] Lock "211043bf-dcc9-44af-834c-75cd7be859ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:32:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9b22d994-1281-44b4-8d45-1d73065c28de req-ab8e4319-74e9-4def-bd0e-94cb013d32d3 service nova] Lock "211043bf-dcc9-44af-834c-75cd7be859ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:32:11 user nova-compute[72766]: DEBUG nova.compute.manager [req-9b22d994-1281-44b4-8d45-1d73065c28de req-ab8e4319-74e9-4def-bd0e-94cb013d32d3 service nova] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] No waiting events found dispatching network-vif-plugged-3e62931c-4358-4153-8d5e-c4675640e3fa {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:32:11 user nova-compute[72766]: WARNING nova.compute.manager [req-9b22d994-1281-44b4-8d45-1d73065c28de req-ab8e4319-74e9-4def-bd0e-94cb013d32d3 service nova] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Received unexpected event network-vif-plugged-3e62931c-4358-4153-8d5e-c4675640e3fa for instance with vm_state active and task_state resize_migrated.
Aug 14 23:32:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "refresh_cache-211043bf-dcc9-44af-834c-75cd7be859ec" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:32:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquired lock "refresh_cache-211043bf-dcc9-44af-834c-75cd7be859ec" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:32:11 user nova-compute[72766]: DEBUG nova.network.neutron [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:32:11 user nova-compute[72766]: DEBUG nova.network.neutron [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Updating instance_info_cache with network_info: [{"id": "3e62931c-4358-4153-8d5e-c4675640e3fa", "address": "fa:16:3e:2b:91:b3", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e62931c-43", "ovs_interfaceid": "3e62931c-4358-4153-8d5e-c4675640e3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:32:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Releasing lock "refresh_cache-211043bf-dcc9-44af-834c-75cd7be859ec" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:32:11 user nova-compute[72766]: DEBUG os_brick.utils [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:32:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:32:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:32:11 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c12b1d8-8393-4e2c-aa7d-a25171444209]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:32:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:32:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:32:11 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed092927-da8d-481b-b25d-1964ee35f733]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:32:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:32:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:32:12 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb87773-ce56-44df-a866-398b5de815f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:32:12 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[28edc294-7770-4b19-b17f-d33fc63e0674]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:32:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:32:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:32:12 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 23:32:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:32:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:32:12 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 23:32:12 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[45db332a-f1b4-4ffb-a689-a8a0b17ad346]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:32:12 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 23:32:12 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 23:32:12 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 23:32:12 user nova-compute[72766]: DEBUG os_brick.utils [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:32:12 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:32:12 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Cleaning up deleted instances {{(pid=72766) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 23:32:12 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] There are 0 instances to clean {{(pid=72766) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 23:32:13 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:32:14 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:32:14 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72766) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 23:32:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:32:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:32:20 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Starting finish_migration {{(pid=72766) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 14 23:32:20 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Instance directory exists: not creating {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 23:32:20 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Creating image(s)
Aug 14 23:32:20 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Did not create local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 23:32:20 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Ensure instance console log exists: /opt/stack/data/nova/instances/211043bf-dcc9-44af-834c-75cd7be859ec/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 23:32:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:32:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:32:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:32:20 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Start _get_guest_xml network_info=[{"id": "3e62931c-4358-4153-8d5e-c4675640e3fa", "address": "fa:16:3e:2b:91:b3", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1477248697-network", "vif_mac": "fa:16:3e:2b:91:b3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e62931c-43", "ovs_interfaceid": "3e62931c-4358-4153-8d5e-c4675640e3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'attachment_id': 'a9dd2c9f-295b-43a9-a87f-02c7f6198bb4', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FcvtBHop', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '211043bf-dcc9-44af-834c-75cd7be859ec', 'attached_at': '2023-08-14T23:32:21.000000', 'detached_at': '', 'volume_id': '9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737', 'serial': '9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737'}, 'volume_type': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:32:20 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:32:20 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:32:20 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:32:20 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:32:20 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:32:20 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:32:20 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:32:20 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:32:20 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:32:20 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:32:20 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:32:20 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:32:20 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:32:20 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:32:20 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:32:20 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:32:20 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:32:20 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:32:20 user nova-compute[72766]: DEBUG nova.objects.instance [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lazy-loading 'vcpu_model' on Instance uuid 211043bf-dcc9-44af-834c-75cd7be859ec {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FcvtBHop', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:32:21 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:32:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:32:21 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:32:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:32:21 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 23:32:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ced4cf-774c-492b-9814-e8fbddde2edd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 23:32:21 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ccf480-e6ac-45c8-a284-841c4d228f9e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737] added
Aug 14 23:32:21 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8b0178-0c53-4957-ae45-d4b63a7822b6]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[196752df-701b-4a65-a6f6-a5251f38b484]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FcvtBHop {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FcvtBHop" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[457bbd96-a2a5-4af1-b7d3-6e65db3ad926]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FcvtBHop'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1c7b11-6a98-416d-a984-ab02fbd8f4cc]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c1e4cc-558a-4990-bc9d-5c5dfaed246d]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0 (non-flash)
Aug 14 23:32:21 user nova-compute[72766]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 (non-flash)
Aug 14 23:32:21 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0 (non-flash)
Aug 14 23:32:21 user nova-compute[72766]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 (non-flash)
Aug 14 23:32:21 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a35fcf-6e86-4c17-a3a0-49ec6ab8f762]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737, portal: 172.16.0.220,3260]
Aug 14 23:32:21 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737, portal: 172.16.0.220,3260] successful.
Aug 14 23:32:21 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c0a96d-932a-40dd-9a41-8fd3ac552aad]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[91329c67-7996-4a23-a532-72f1c667c26f]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0 (non-flash)
Aug 14 23:32:21 user nova-compute[72766]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 (non-flash)
Aug 14 23:32:21 user nova-compute[72766]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 (non-flash)
Aug 14 23:32:21 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0 (non-flash)
Aug 14 23:32:21 user nova-compute[72766]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 (non-flash)
Aug 14 23:32:21 user nova-compute[72766]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 (non-flash)
Aug 14 23:32:21 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccda36e4-e7bd-423b-9454-8e623a6d9757]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:32:21 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:32:22 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:32:22 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FcvtBHop', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 23:32:22 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:32:22 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23238316530333662', 'path': '/dev/sdb'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:32:22 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238316530333662', 'path': '/dev/sdb'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 23:32:22 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:30:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1043518379',display_name='tempest-ServerActionsTestOtherA-server-1043518379',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1043518379',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDoXZolQqtFAUPpymn6Ku7JgXGw46vxp59imOajNHAEz0LQOA2HZ029jKc7yJ8uxT7IHJ390d7ScJ6pqdFfhcnBy/F6i10LDXWERfUkUg5mrEOI4hiQbJjkhq6PVnEbSQ==',key_name='tempest-keypair-1635999225',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:30:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7b0d4f038dbd47b1aad9829f19cb4896',ramdisk_id='',reservation_id='r-ultip2q1',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-242565278',owner_user_name='tempest-ServerActionsTestOtherA-242565278-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:32:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11bf21631dd0447f8f1a3f2b012ec43a',uuid=211043bf-dcc9-44af-834c-75cd7be859ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e62931c-4358-4153-8d5e-c4675640e3fa", "address": "fa:16:3e:2b:91:b3", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1477248697-network", "vif_mac": "fa:16:3e:2b:91:b3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e62931c-43", "ovs_interfaceid": "3e62931c-4358-4153-8d5e-c4675640e3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:32:22 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Converting VIF {"id": "3e62931c-4358-4153-8d5e-c4675640e3fa", "address": "fa:16:3e:2b:91:b3", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1477248697-network", "vif_mac": "fa:16:3e:2b:91:b3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e62931c-43", "ovs_interfaceid": "3e62931c-4358-4153-8d5e-c4675640e3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:32:22 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:91:b3,bridge_name='br-int',has_traffic_filtering=True,id=3e62931c-4358-4153-8d5e-c4675640e3fa,network=Network(e0bbc182-f700-4a82-84ae-7cbcb2e517c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e62931c-43') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:32:22 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:32:22 user nova-compute[72766]:   <uuid>211043bf-dcc9-44af-834c-75cd7be859ec</uuid>
Aug 14 23:32:22 user nova-compute[72766]:   <name>instance-0000002c</name>
Aug 14 23:32:22 user nova-compute[72766]:   <memory>2097152</memory>
Aug 14 23:32:22 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:32:22 user nova-compute[72766]:   <metadata>
Aug 14 23:32:22 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:32:22 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:32:22 user nova-compute[72766]:       <nova:name>tempest-ServerActionsTestOtherA-server-1043518379</nova:name>
Aug 14 23:32:22 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:32:20</nova:creationTime>
Aug 14 23:32:22 user nova-compute[72766]:       <nova:flavor name="m1.small">
Aug 14 23:32:22 user nova-compute[72766]:         <nova:memory>2048</nova:memory>
Aug 14 23:32:22 user nova-compute[72766]:         <nova:disk>20</nova:disk>
Aug 14 23:32:22 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:32:22 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:32:22 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:32:22 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:32:22 user nova-compute[72766]:       <nova:owner>
Aug 14 23:32:22 user nova-compute[72766]:         <nova:user uuid="11bf21631dd0447f8f1a3f2b012ec43a">tempest-ServerActionsTestOtherA-242565278-project-member</nova:user>
Aug 14 23:32:22 user nova-compute[72766]:         <nova:project uuid="7b0d4f038dbd47b1aad9829f19cb4896">tempest-ServerActionsTestOtherA-242565278</nova:project>
Aug 14 23:32:22 user nova-compute[72766]:       </nova:owner>
Aug 14 23:32:22 user nova-compute[72766]:       <nova:ports>
Aug 14 23:32:22 user nova-compute[72766]:         <nova:port uuid="3e62931c-4358-4153-8d5e-c4675640e3fa">
Aug 14 23:32:22 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 23:32:22 user nova-compute[72766]:         </nova:port>
Aug 14 23:32:22 user nova-compute[72766]:       </nova:ports>
Aug 14 23:32:22 user nova-compute[72766]:     </nova:instance>
Aug 14 23:32:22 user nova-compute[72766]:   </metadata>
Aug 14 23:32:22 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:32:22 user nova-compute[72766]:     <system>
Aug 14 23:32:22 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:32:22 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:32:22 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:32:22 user nova-compute[72766]:       <entry name="serial">211043bf-dcc9-44af-834c-75cd7be859ec</entry>
Aug 14 23:32:22 user nova-compute[72766]:       <entry name="uuid">211043bf-dcc9-44af-834c-75cd7be859ec</entry>
Aug 14 23:32:22 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:32:22 user nova-compute[72766]:     </system>
Aug 14 23:32:22 user nova-compute[72766]:   </sysinfo>
Aug 14 23:32:22 user nova-compute[72766]:   <os>
Aug 14 23:32:22 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:32:22 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:32:22 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:32:22 user nova-compute[72766]:   </os>
Aug 14 23:32:22 user nova-compute[72766]:   <features>
Aug 14 23:32:22 user nova-compute[72766]:     <acpi/>
Aug 14 23:32:22 user nova-compute[72766]:     <apic/>
Aug 14 23:32:22 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:32:22 user nova-compute[72766]:   </features>
Aug 14 23:32:22 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:32:22 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:32:22 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:32:22 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:32:22 user nova-compute[72766]:   </clock>
Aug 14 23:32:22 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:32:22 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:32:22 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:32:22 user nova-compute[72766]:   </cpu>
Aug 14 23:32:22 user nova-compute[72766]:   <devices>
Aug 14 23:32:22 user nova-compute[72766]:     <disk type="block" device="disk">
Aug 14 23:32:22 user nova-compute[72766]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:32:22 user nova-compute[72766]:       <source dev="/dev/sdb"/>
Aug 14 23:32:22 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:32:22 user nova-compute[72766]:       <serial>9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737</serial>
Aug 14 23:32:22 user nova-compute[72766]:     </disk>
Aug 14 23:32:22 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:32:22 user nova-compute[72766]:       <mac address="fa:16:3e:2b:91:b3"/>
Aug 14 23:32:22 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:32:22 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:32:22 user nova-compute[72766]:       <target dev="tap3e62931c-43"/>
Aug 14 23:32:22 user nova-compute[72766]:     </interface>
Aug 14 23:32:22 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:32:22 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/211043bf-dcc9-44af-834c-75cd7be859ec/console.log" append="off"/>
Aug 14 23:32:22 user nova-compute[72766]:     </serial>
Aug 14 23:32:22 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:32:22 user nova-compute[72766]:     <video>
Aug 14 23:32:22 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:32:22 user nova-compute[72766]:     </video>
Aug 14 23:32:22 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:32:22 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:32:22 user nova-compute[72766]:     </rng>
Aug 14 23:32:22 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:32:22 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:32:22 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:32:22 user nova-compute[72766]:     </memballoon>
Aug 14 23:32:22 user nova-compute[72766]:   </devices>
Aug 14 23:32:22 user nova-compute[72766]: </domain>
Aug 14 23:32:22 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:32:22 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:30:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1043518379',display_name='tempest-ServerActionsTestOtherA-server-1043518379',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1043518379',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDoXZolQqtFAUPpymn6Ku7JgXGw46vxp59imOajNHAEz0LQOA2HZ029jKc7yJ8uxT7IHJ390d7ScJ6pqdFfhcnBy/F6i10LDXWERfUkUg5mrEOI4hiQbJjkhq6PVnEbSQ==',key_name='tempest-keypair-1635999225',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:30:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7b0d4f038dbd47b1aad9829f19cb4896',ramdisk_id='',reservation_id='r-ultip2q1',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-242565278',owner_user_name='tempest-ServerActionsTestOtherA-242565278-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:32:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11bf21631dd0447f8f1a3f2b012ec43a',uuid=211043bf-dcc9-44af-834c-75cd7be859ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e62931c-4358-4153-8d5e-c4675640e3fa", "address": "fa:16:3e:2b:91:b3", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1477248697-network", "vif_mac": "fa:16:3e:2b:91:b3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e62931c-43", "ovs_interfaceid": "3e62931c-4358-4153-8d5e-c4675640e3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:32:22 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Converting VIF {"id": "3e62931c-4358-4153-8d5e-c4675640e3fa", "address": "fa:16:3e:2b:91:b3", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1477248697-network", "vif_mac": "fa:16:3e:2b:91:b3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e62931c-43", "ovs_interfaceid": "3e62931c-4358-4153-8d5e-c4675640e3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:32:22 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:91:b3,bridge_name='br-int',has_traffic_filtering=True,id=3e62931c-4358-4153-8d5e-c4675640e3fa,network=Network(e0bbc182-f700-4a82-84ae-7cbcb2e517c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e62931c-43') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:32:22 user nova-compute[72766]: DEBUG os_vif [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:91:b3,bridge_name='br-int',has_traffic_filtering=True,id=3e62931c-4358-4153-8d5e-c4675640e3fa,network=Network(e0bbc182-f700-4a82-84ae-7cbcb2e517c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e62931c-43') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:32:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:32:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:32:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:32:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:32:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e62931c-43, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:32:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3e62931c-43, col_values=(('external_ids', {'iface-id': '3e62931c-4358-4153-8d5e-c4675640e3fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:91:b3', 'vm-uuid': '211043bf-dcc9-44af-834c-75cd7be859ec'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:32:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:32:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:32:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:32:22 user nova-compute[72766]: INFO os_vif [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:91:b3,bridge_name='br-int',has_traffic_filtering=True,id=3e62931c-4358-4153-8d5e-c4675640e3fa,network=Network(e0bbc182-f700-4a82-84ae-7cbcb2e517c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e62931c-43')
Aug 14 23:32:22 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:32:22 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] No VIF found with MAC fa:16:3e:2b:91:b3, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:32:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:32:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:32:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:32:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:32:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:32:24 user nova-compute[72766]: DEBUG nova.compute.manager [req-62cd52aa-5faa-47df-9ea4-4ba765f7ed10 req-a5fe7b08-2514-4e65-8fec-dd1105bb5367 service nova] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Received event network-vif-plugged-3e62931c-4358-4153-8d5e-c4675640e3fa {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:32:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-62cd52aa-5faa-47df-9ea4-4ba765f7ed10 req-a5fe7b08-2514-4e65-8fec-dd1105bb5367 service nova] Acquiring lock "211043bf-dcc9-44af-834c-75cd7be859ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:32:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-62cd52aa-5faa-47df-9ea4-4ba765f7ed10 req-a5fe7b08-2514-4e65-8fec-dd1105bb5367 service nova] Lock "211043bf-dcc9-44af-834c-75cd7be859ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:32:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-62cd52aa-5faa-47df-9ea4-4ba765f7ed10 req-a5fe7b08-2514-4e65-8fec-dd1105bb5367 service nova] Lock "211043bf-dcc9-44af-834c-75cd7be859ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:32:24 user nova-compute[72766]: DEBUG nova.compute.manager [req-62cd52aa-5faa-47df-9ea4-4ba765f7ed10 req-a5fe7b08-2514-4e65-8fec-dd1105bb5367 service nova] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] No waiting events found dispatching network-vif-plugged-3e62931c-4358-4153-8d5e-c4675640e3fa {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:32:24 user nova-compute[72766]: WARNING nova.compute.manager [req-62cd52aa-5faa-47df-9ea4-4ba765f7ed10 req-a5fe7b08-2514-4e65-8fec-dd1105bb5367 service nova] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Received unexpected event network-vif-plugged-3e62931c-4358-4153-8d5e-c4675640e3fa for instance with vm_state active and task_state resize_finish.
Aug 14 23:32:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:32:24 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692055929.7589812, 211043bf-dcc9-44af-834c-75cd7be859ec => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:32:24 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] VM Stopped (Lifecycle Event)
Aug 14 23:32:24 user nova-compute[72766]: DEBUG nova.compute.manager [None req-4e95704e-bc56-4d57-8eb3-76b8edfca63a None None] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:32:25 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:32:25 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692055945.8265305, 211043bf-dcc9-44af-834c-75cd7be859ec => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:32:25 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] VM Resumed (Lifecycle Event)
Aug 14 23:32:25 user nova-compute[72766]: DEBUG nova.compute.manager [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:32:25 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Instance running successfully.
Aug 14 23:32:25 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Failed to set time: agent not configured {{(pid=72766) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 14 23:32:25 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-5c323d39-6a6f-40a2-92ff-b78011be4617 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] finish_migration finished successfully. {{(pid=72766) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 14 23:32:25 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:32:25 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:32:25 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 14 23:32:25 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692055945.8299477, 211043bf-dcc9-44af-834c-75cd7be859ec => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:32:25 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] VM Started (Lifecycle Event)
Aug 14 23:32:25 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:32:25 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:32:25 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 14 23:32:26 user nova-compute[72766]: DEBUG nova.compute.manager [req-a4a4b7b9-b620-4473-ad3f-fc8424c0691e req-d38140c9-9cff-43aa-b773-fc5840405fec service nova] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Received event network-vif-plugged-3e62931c-4358-4153-8d5e-c4675640e3fa {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:32:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a4a4b7b9-b620-4473-ad3f-fc8424c0691e req-d38140c9-9cff-43aa-b773-fc5840405fec service nova] Acquiring lock "211043bf-dcc9-44af-834c-75cd7be859ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:32:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a4a4b7b9-b620-4473-ad3f-fc8424c0691e req-d38140c9-9cff-43aa-b773-fc5840405fec service nova] Lock "211043bf-dcc9-44af-834c-75cd7be859ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:32:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a4a4b7b9-b620-4473-ad3f-fc8424c0691e req-d38140c9-9cff-43aa-b773-fc5840405fec service nova] Lock "211043bf-dcc9-44af-834c-75cd7be859ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:32:26 user nova-compute[72766]: DEBUG nova.compute.manager [req-a4a4b7b9-b620-4473-ad3f-fc8424c0691e req-d38140c9-9cff-43aa-b773-fc5840405fec service nova] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] No waiting events found dispatching network-vif-plugged-3e62931c-4358-4153-8d5e-c4675640e3fa {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:32:26 user nova-compute[72766]: WARNING nova.compute.manager [req-a4a4b7b9-b620-4473-ad3f-fc8424c0691e req-d38140c9-9cff-43aa-b773-fc5840405fec service nova] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Received unexpected event network-vif-plugged-3e62931c-4358-4153-8d5e-c4675640e3fa for instance with vm_state resized and task_state None.
Aug 14 23:32:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:32:32 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:32:37 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:32:39 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:32:39 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:32:42 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:32:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:32:45 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:32:45 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:32:45 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:32:45 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Rebuilding the list of instances to heal {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 23:32:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-cbcf7851-e6f7-4f46-97cc-d773286ccddf" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:32:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-cbcf7851-e6f7-4f46-97cc-d773286ccddf" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:32:45 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:32:45 user nova-compute[72766]: DEBUG nova.objects.instance [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lazy-loading 'info_cache' on Instance uuid cbcf7851-e6f7-4f46-97cc-d773286ccddf {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:32:46 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Updating instance_info_cache with network_info: [{"id": "8f65f8f0-60fe-4fdb-af66-424a85b12caf", "address": "fa:16:3e:70:30:66", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f65f8f0-60", "ovs_interfaceid": "8f65f8f0-60fe-4fdb-af66-424a85b12caf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:32:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-cbcf7851-e6f7-4f46-97cc-d773286ccddf" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:32:46 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:32:46 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:32:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:32:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:32:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:32:46 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:32:46 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:32:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:32:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:32:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:32:47 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:32:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5965063c-8d1b-41d0-8c22-7d5b54925f94/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:32:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5965063c-8d1b-41d0-8c22-7d5b54925f94/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:32:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5965063c-8d1b-41d0-8c22-7d5b54925f94/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:32:47 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:32:47 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5965063c-8d1b-41d0-8c22-7d5b54925f94/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:32:47 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:32:47 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:32:47 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:32:48 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:32:48 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=8224MB free_disk=25.243366241455078GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:32:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:32:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:32:48 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Applying migration context for instance 211043bf-dcc9-44af-834c-75cd7be859ec as it has an incoming, in-progress migration 6547e6b5-107f-4c3f-9d74-6a75e3427a67. Migration status is finished {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 14 23:32:48 user nova-compute[72766]: INFO nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Updating resource usage from migration 6547e6b5-107f-4c3f-9d74-6a75e3427a67
Aug 14 23:32:48 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance cbcf7851-e6f7-4f46-97cc-d773286ccddf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:32:48 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 5965063c-8d1b-41d0-8c22-7d5b54925f94 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:32:48 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance c5fe05bb-7204-47df-b033-a7462a21166c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:32:48 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Migration 6547e6b5-107f-4c3f-9d74-6a75e3427a67 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 14 23:32:48 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 211043bf-dcc9-44af-834c-75cd7be859ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:32:48 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:32:48 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:32:48 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:32:48 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:32:48 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:32:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.331s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:32:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:32:50 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:32:50 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:32:52 user nova-compute[72766]: DEBUG nova.compute.manager [req-f14aa1bd-4cb0-4bca-8748-d601495c9087 req-1b075580-1282-4fd4-a53a-97727e5e4bcd service nova] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Received event network-changed-6346774b-2177-4e22-a7b2-faa064005d64 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:32:52 user nova-compute[72766]: DEBUG nova.compute.manager [req-f14aa1bd-4cb0-4bca-8748-d601495c9087 req-1b075580-1282-4fd4-a53a-97727e5e4bcd service nova] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Refreshing instance network info cache due to event network-changed-6346774b-2177-4e22-a7b2-faa064005d64. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:32:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f14aa1bd-4cb0-4bca-8748-d601495c9087 req-1b075580-1282-4fd4-a53a-97727e5e4bcd service nova] Acquiring lock "refresh_cache-c5fe05bb-7204-47df-b033-a7462a21166c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:32:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f14aa1bd-4cb0-4bca-8748-d601495c9087 req-1b075580-1282-4fd4-a53a-97727e5e4bcd service nova] Acquired lock "refresh_cache-c5fe05bb-7204-47df-b033-a7462a21166c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:32:52 user nova-compute[72766]: DEBUG nova.network.neutron [req-f14aa1bd-4cb0-4bca-8748-d601495c9087 req-1b075580-1282-4fd4-a53a-97727e5e4bcd service nova] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Refreshing network info cache for port 6346774b-2177-4e22-a7b2-faa064005d64 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:32:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:32:52 user nova-compute[72766]: DEBUG nova.network.neutron [req-f14aa1bd-4cb0-4bca-8748-d601495c9087 req-1b075580-1282-4fd4-a53a-97727e5e4bcd service nova] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Updated VIF entry in instance network info cache for port 6346774b-2177-4e22-a7b2-faa064005d64. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:32:52 user nova-compute[72766]: DEBUG nova.network.neutron [req-f14aa1bd-4cb0-4bca-8748-d601495c9087 req-1b075580-1282-4fd4-a53a-97727e5e4bcd service nova] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Updating instance_info_cache with network_info: [{"id": "6346774b-2177-4e22-a7b2-faa064005d64", "address": "fa:16:3e:28:1f:4d", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6346774b-21", "ovs_interfaceid": "6346774b-2177-4e22-a7b2-faa064005d64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:32:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f14aa1bd-4cb0-4bca-8748-d601495c9087 req-1b075580-1282-4fd4-a53a-97727e5e4bcd service nova] Releasing lock "refresh_cache-c5fe05bb-7204-47df-b033-a7462a21166c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:32:53 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:32:53 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:32:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:32:56 user nova-compute[72766]: DEBUG nova.compute.manager [req-51294465-d2d1-412b-8255-1ae1300104b8 req-a09ae796-eeec-455c-83fe-21dc0a33f596 service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Received event network-changed-09bcfc13-ace1-4e60-8ed3-2a3b1a09e957 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:32:56 user nova-compute[72766]: DEBUG nova.compute.manager [req-51294465-d2d1-412b-8255-1ae1300104b8 req-a09ae796-eeec-455c-83fe-21dc0a33f596 service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Refreshing instance network info cache due to event network-changed-09bcfc13-ace1-4e60-8ed3-2a3b1a09e957. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:32:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-51294465-d2d1-412b-8255-1ae1300104b8 req-a09ae796-eeec-455c-83fe-21dc0a33f596 service nova] Acquiring lock "refresh_cache-5965063c-8d1b-41d0-8c22-7d5b54925f94" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:32:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-51294465-d2d1-412b-8255-1ae1300104b8 req-a09ae796-eeec-455c-83fe-21dc0a33f596 service nova] Acquired lock "refresh_cache-5965063c-8d1b-41d0-8c22-7d5b54925f94" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:32:56 user nova-compute[72766]: DEBUG nova.network.neutron [req-51294465-d2d1-412b-8255-1ae1300104b8 req-a09ae796-eeec-455c-83fe-21dc0a33f596 service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Refreshing network info cache for port 09bcfc13-ace1-4e60-8ed3-2a3b1a09e957 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:32:56 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:32:56 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:32:56 user nova-compute[72766]: DEBUG nova.network.neutron [req-51294465-d2d1-412b-8255-1ae1300104b8 req-a09ae796-eeec-455c-83fe-21dc0a33f596 service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Updated VIF entry in instance network info cache for port 09bcfc13-ace1-4e60-8ed3-2a3b1a09e957. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:32:56 user nova-compute[72766]: DEBUG nova.network.neutron [req-51294465-d2d1-412b-8255-1ae1300104b8 req-a09ae796-eeec-455c-83fe-21dc0a33f596 service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Updating instance_info_cache with network_info: [{"id": "09bcfc13-ace1-4e60-8ed3-2a3b1a09e957", "address": "fa:16:3e:e8:a7:0c", "network": {"id": "c7828c64-4d71-4c57-8df8-bb4524d9b9cb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-160068070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbd47fb3d5eb408aa751d1d49f198906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09bcfc13-ac", "ovs_interfaceid": "09bcfc13-ace1-4e60-8ed3-2a3b1a09e957", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:32:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-51294465-d2d1-412b-8255-1ae1300104b8 req-a09ae796-eeec-455c-83fe-21dc0a33f596 service nova] Releasing lock "refresh_cache-5965063c-8d1b-41d0-8c22-7d5b54925f94" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:32:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:32:57 user nova-compute[72766]: DEBUG nova.compute.manager [req-d745a86f-8b2a-451a-b950-747d321a5070 req-d9b64299-8f4f-4563-b525-4a8811041a80 service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Received event network-changed-09bcfc13-ace1-4e60-8ed3-2a3b1a09e957 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:32:57 user nova-compute[72766]: DEBUG nova.compute.manager [req-d745a86f-8b2a-451a-b950-747d321a5070 req-d9b64299-8f4f-4563-b525-4a8811041a80 service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Refreshing instance network info cache due to event network-changed-09bcfc13-ace1-4e60-8ed3-2a3b1a09e957. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:32:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d745a86f-8b2a-451a-b950-747d321a5070 req-d9b64299-8f4f-4563-b525-4a8811041a80 service nova] Acquiring lock "refresh_cache-5965063c-8d1b-41d0-8c22-7d5b54925f94" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:32:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d745a86f-8b2a-451a-b950-747d321a5070 req-d9b64299-8f4f-4563-b525-4a8811041a80 service nova] Acquired lock "refresh_cache-5965063c-8d1b-41d0-8c22-7d5b54925f94" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:32:57 user nova-compute[72766]: DEBUG nova.network.neutron [req-d745a86f-8b2a-451a-b950-747d321a5070 req-d9b64299-8f4f-4563-b525-4a8811041a80 service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Refreshing network info cache for port 09bcfc13-ace1-4e60-8ed3-2a3b1a09e957 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:32:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b70ce326-b3cb-4d08-b25f-7d9189739990 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Acquiring lock "5965063c-8d1b-41d0-8c22-7d5b54925f94" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:32:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b70ce326-b3cb-4d08-b25f-7d9189739990 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "5965063c-8d1b-41d0-8c22-7d5b54925f94" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:32:57 user nova-compute[72766]: INFO nova.compute.manager [None req-b70ce326-b3cb-4d08-b25f-7d9189739990 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Detaching volume b8d3e50a-475f-4a29-b017-a8950c2110d0
Aug 14 23:32:58 user nova-compute[72766]: INFO nova.virt.block_device [None req-b70ce326-b3cb-4d08-b25f-7d9189739990 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Attempting to driver detach volume b8d3e50a-475f-4a29-b017-a8950c2110d0 from mountpoint /dev/vdb
Aug 14 23:32:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-b70ce326-b3cb-4d08-b25f-7d9189739990 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Attempting to detach device vdb from instance 5965063c-8d1b-41d0-8c22-7d5b54925f94 from the persistent domain config. {{(pid=72766) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-b70ce326-b3cb-4d08-b25f-7d9189739990 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 23:32:58 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:32:58 user nova-compute[72766]:   <source dev="/dev/sdc"/>
Aug 14 23:32:58 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:32:58 user nova-compute[72766]:   <serial>b8d3e50a-475f-4a29-b017-a8950c2110d0</serial>
Aug 14 23:32:58 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 23:32:58 user nova-compute[72766]: </disk>
Aug 14 23:32:58 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 23:32:58 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-b70ce326-b3cb-4d08-b25f-7d9189739990 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Successfully detached device vdb from instance 5965063c-8d1b-41d0-8c22-7d5b54925f94 from the persistent domain config.
Aug 14 23:32:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-b70ce326-b3cb-4d08-b25f-7d9189739990 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5965063c-8d1b-41d0-8c22-7d5b54925f94 from the live domain config. {{(pid=72766) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-b70ce326-b3cb-4d08-b25f-7d9189739990 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 23:32:58 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:32:58 user nova-compute[72766]:   <source dev="/dev/sdc"/>
Aug 14 23:32:58 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:32:58 user nova-compute[72766]:   <serial>b8d3e50a-475f-4a29-b017-a8950c2110d0</serial>
Aug 14 23:32:58 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 23:32:58 user nova-compute[72766]: </disk>
Aug 14 23:32:58 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG nova.network.neutron [req-d745a86f-8b2a-451a-b950-747d321a5070 req-d9b64299-8f4f-4563-b525-4a8811041a80 service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Updated VIF entry in instance network info cache for port 09bcfc13-ace1-4e60-8ed3-2a3b1a09e957. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG nova.network.neutron [req-d745a86f-8b2a-451a-b950-747d321a5070 req-d9b64299-8f4f-4563-b525-4a8811041a80 service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Updating instance_info_cache with network_info: [{"id": "09bcfc13-ace1-4e60-8ed3-2a3b1a09e957", "address": "fa:16:3e:e8:a7:0c", "network": {"id": "c7828c64-4d71-4c57-8df8-bb4524d9b9cb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-160068070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbd47fb3d5eb408aa751d1d49f198906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09bcfc13-ac", "ovs_interfaceid": "09bcfc13-ace1-4e60-8ed3-2a3b1a09e957", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d745a86f-8b2a-451a-b950-747d321a5070 req-d9b64299-8f4f-4563-b525-4a8811041a80 service nova] Releasing lock "refresh_cache-5965063c-8d1b-41d0-8c22-7d5b54925f94" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Received event <DeviceRemovedEvent: 1692055978.576483, 5965063c-8d1b-41d0-8c22-7d5b54925f94 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72766) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-b70ce326-b3cb-4d08-b25f-7d9189739990 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5965063c-8d1b-41d0-8c22-7d5b54925f94 {{(pid=72766) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 23:32:58 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-b70ce326-b3cb-4d08-b25f-7d9189739990 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Successfully detached device vdb from instance 5965063c-8d1b-41d0-8c22-7d5b54925f94 from the live domain config.
Aug 14 23:32:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b70ce326-b3cb-4d08-b25f-7d9189739990 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70ce326-b3cb-4d08-b25f-7d9189739990 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OniRhYmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:32:58 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-b70ce326-b3cb-4d08-b25f-7d9189739990 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:32:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-b70ce326-b3cb-4d08-b25f-7d9189739990 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-b70ce326-b3cb-4d08-b25f-7d9189739990 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70ce326-b3cb-4d08-b25f-7d9189739990 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5439a32-b941-45d0-a33d-02ae45cd05f2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79ad94f-3cf6-4c7e-b041-d4f2ea700d49]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70ce326-b3cb-4d08-b25f-7d9189739990 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0 (non-flash)
Aug 14 23:32:58 user nova-compute[72766]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 (non-flash)
Aug 14 23:32:58 user nova-compute[72766]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 (non-flash)
Aug 14 23:32:58 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70ce326-b3cb-4d08-b25f-7d9189739990 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0 (non-flash)
Aug 14 23:32:58 user nova-compute[72766]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 (non-flash)
Aug 14 23:32:58 user nova-compute[72766]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 (non-flash)
Aug 14 23:32:58 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70ce326-b3cb-4d08-b25f-7d9189739990 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff154341fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0'): ({'sdc'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b70ce326-b3cb-4d08-b25f-7d9189739990 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Removing single pathed devices sdc {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4d42dc-b0c3-4a5a-9bd8-975beec74325]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ba91a5-69ba-4c73-b0a0-a007c13e4712]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b70ce326-b3cb-4d08-b25f-7d9189739990 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Flushing IO for device /dev/sdc {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f49854-5318-4345-a140-0ed344754ea8]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b70ce326-b3cb-4d08-b25f-7d9189739990 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb370beb-2805-4d96-9c00-20905871301c]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b70ce326-b3cb-4d08-b25f-7d9189739990 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b70ce326-b3cb-4d08-b25f-7d9189739990 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] SCSI volumes sdc have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70ce326-b3cb-4d08-b25f-7d9189739990 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd44306-7c80-4b1c-af08-cdec79974623]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70ce326-b3cb-4d08-b25f-7d9189739990 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0 -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a9d47c-0f8a-42ae-9a44-5904abc9ef94]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70ce326-b3cb-4d08-b25f-7d9189739990 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0, portal: 172.16.0.220,3260]
Aug 14 23:32:58 user nova-compute[72766]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0, portal: 172.16.0.220,3260] successful.
Aug 14 23:32:58 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0 -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8d3e50a-475f-4a29-b017-a8950c2110d0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5a8d68-22bd-43f4-bb0c-6a9fcf1063c9]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70ce326-b3cb-4d08-b25f-7d9189739990 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-b70ce326-b3cb-4d08-b25f-7d9189739990 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70ce326-b3cb-4d08-b25f-7d9189739990 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] <== disconnect_volume: return (282ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:32:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b70ce326-b3cb-4d08-b25f-7d9189739990 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:32:59 user nova-compute[72766]: DEBUG nova.objects.instance [None req-b70ce326-b3cb-4d08-b25f-7d9189739990 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lazy-loading 'flavor' on Instance uuid 5965063c-8d1b-41d0-8c22-7d5b54925f94 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:32:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b70ce326-b3cb-4d08-b25f-7d9189739990 tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "5965063c-8d1b-41d0-8c22-7d5b54925f94" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.694s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:32:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:02 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:02 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "63418518-22e7-400e-9588-97682008a759" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:33:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "63418518-22e7-400e-9588-97682008a759" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:33:05 user nova-compute[72766]: DEBUG nova.compute.manager [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 63418518-22e7-400e-9588-97682008a759] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 23:33:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:33:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:33:05 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 23:33:05 user nova-compute[72766]: INFO nova.compute.claims [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 63418518-22e7-400e-9588-97682008a759] Claim successful on node user
Aug 14 23:33:05 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:33:05 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:33:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.370s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:33:05 user nova-compute[72766]: DEBUG nova.compute.manager [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 63418518-22e7-400e-9588-97682008a759] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 23:33:05 user nova-compute[72766]: DEBUG nova.compute.manager [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 63418518-22e7-400e-9588-97682008a759] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 23:33:05 user nova-compute[72766]: DEBUG nova.network.neutron [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 63418518-22e7-400e-9588-97682008a759] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 23:33:05 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 63418518-22e7-400e-9588-97682008a759] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 23:33:05 user nova-compute[72766]: DEBUG nova.compute.manager [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 63418518-22e7-400e-9588-97682008a759] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 23:33:05 user nova-compute[72766]: DEBUG nova.policy [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '999390ac8e6240199c9a7484e234f3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c9f53727cc497c94516ff7fa1bbf4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 23:33:05 user nova-compute[72766]: INFO nova.virt.block_device [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 63418518-22e7-400e-9588-97682008a759] Booting with volume bff7062a-71b2-4ea9-9960-032659ad0ea2 at /dev/vda
Aug 14 23:33:05 user nova-compute[72766]: DEBUG os_brick.utils [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:33:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:33:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:33:05 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b1b86c-f900-44e6-8926-3a4ba4300e5c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:33:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:33:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:33:05 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[0811daa9-fabf-4fac-b8de-ab1f5e2659e6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:33:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:33:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:33:05 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fb5b2d-2546-45d4-a1b3-91cb2564cad9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:33:05 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f7ff24-5030-4ec5-a35f-04e78f0d6578]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:33:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:33:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:33:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 23:33:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:33:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:33:05 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 23:33:05 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[7083024c-f6fc-411b-bd8e-d741cba5808d]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:33:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 23:33:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 23:33:05 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 23:33:05 user nova-compute[72766]: DEBUG os_brick.utils [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:33:05 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 63418518-22e7-400e-9588-97682008a759] Updating existing volume attachment record: bb4aef33-f713-47c4-9239-f02eeb3b27c5 {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 23:33:06 user nova-compute[72766]: DEBUG nova.network.neutron [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 63418518-22e7-400e-9588-97682008a759] Successfully created port: 0a42bd31-a608-4555-9822-b5529d2912ad {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 23:33:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:07 user nova-compute[72766]: DEBUG nova.network.neutron [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 63418518-22e7-400e-9588-97682008a759] Successfully updated port: 0a42bd31-a608-4555-9822-b5529d2912ad {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 23:33:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "refresh_cache-63418518-22e7-400e-9588-97682008a759" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:33:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquired lock "refresh_cache-63418518-22e7-400e-9588-97682008a759" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:33:07 user nova-compute[72766]: DEBUG nova.network.neutron [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 63418518-22e7-400e-9588-97682008a759] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:33:07 user nova-compute[72766]: DEBUG nova.compute.manager [req-32d7daa9-7589-4154-9da4-6fe47357964c req-16b037a2-b2b5-494a-96a7-471f4a970a2d service nova] [instance: 63418518-22e7-400e-9588-97682008a759] Received event network-changed-0a42bd31-a608-4555-9822-b5529d2912ad {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:33:07 user nova-compute[72766]: DEBUG nova.compute.manager [req-32d7daa9-7589-4154-9da4-6fe47357964c req-16b037a2-b2b5-494a-96a7-471f4a970a2d service nova] [instance: 63418518-22e7-400e-9588-97682008a759] Refreshing instance network info cache due to event network-changed-0a42bd31-a608-4555-9822-b5529d2912ad. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:33:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-32d7daa9-7589-4154-9da4-6fe47357964c req-16b037a2-b2b5-494a-96a7-471f4a970a2d service nova] Acquiring lock "refresh_cache-63418518-22e7-400e-9588-97682008a759" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:33:07 user nova-compute[72766]: DEBUG nova.network.neutron [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 63418518-22e7-400e-9588-97682008a759] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 23:33:08 user nova-compute[72766]: DEBUG nova.network.neutron [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 63418518-22e7-400e-9588-97682008a759] Updating instance_info_cache with network_info: [{"id": "0a42bd31-a608-4555-9822-b5529d2912ad", "address": "fa:16:3e:d8:88:75", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a42bd31-a6", "ovs_interfaceid": "0a42bd31-a608-4555-9822-b5529d2912ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:33:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Releasing lock "refresh_cache-63418518-22e7-400e-9588-97682008a759" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:33:08 user nova-compute[72766]: DEBUG nova.compute.manager [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 63418518-22e7-400e-9588-97682008a759] Instance network_info: |[{"id": "0a42bd31-a608-4555-9822-b5529d2912ad", "address": "fa:16:3e:d8:88:75", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a42bd31-a6", "ovs_interfaceid": "0a42bd31-a608-4555-9822-b5529d2912ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 23:33:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-32d7daa9-7589-4154-9da4-6fe47357964c req-16b037a2-b2b5-494a-96a7-471f4a970a2d service nova] Acquired lock "refresh_cache-63418518-22e7-400e-9588-97682008a759" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:33:08 user nova-compute[72766]: DEBUG nova.network.neutron [req-32d7daa9-7589-4154-9da4-6fe47357964c req-16b037a2-b2b5-494a-96a7-471f4a970a2d service nova] [instance: 63418518-22e7-400e-9588-97682008a759] Refreshing network info cache for port 0a42bd31-a608-4555-9822-b5529d2912ad {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:33:08 user nova-compute[72766]: DEBUG nova.network.neutron [req-32d7daa9-7589-4154-9da4-6fe47357964c req-16b037a2-b2b5-494a-96a7-471f4a970a2d service nova] [instance: 63418518-22e7-400e-9588-97682008a759] Updated VIF entry in instance network info cache for port 0a42bd31-a608-4555-9822-b5529d2912ad. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:33:08 user nova-compute[72766]: DEBUG nova.network.neutron [req-32d7daa9-7589-4154-9da4-6fe47357964c req-16b037a2-b2b5-494a-96a7-471f4a970a2d service nova] [instance: 63418518-22e7-400e-9588-97682008a759] Updating instance_info_cache with network_info: [{"id": "0a42bd31-a608-4555-9822-b5529d2912ad", "address": "fa:16:3e:d8:88:75", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a42bd31-a6", "ovs_interfaceid": "0a42bd31-a608-4555-9822-b5529d2912ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:33:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-32d7daa9-7589-4154-9da4-6fe47357964c req-16b037a2-b2b5-494a-96a7-471f4a970a2d service nova] Releasing lock "refresh_cache-63418518-22e7-400e-9588-97682008a759" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:33:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Acquiring lock "7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:33:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Lock "7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:33:08 user nova-compute[72766]: DEBUG nova.compute.manager [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 23:33:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:33:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:33:08 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 23:33:08 user nova-compute[72766]: INFO nova.compute.claims [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Claim successful on node user
Aug 14 23:33:09 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:33:09 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:33:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.355s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:33:09 user nova-compute[72766]: DEBUG nova.compute.manager [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 23:33:09 user nova-compute[72766]: DEBUG nova.compute.manager [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 23:33:09 user nova-compute[72766]: DEBUG nova.network.neutron [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 23:33:09 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 23:33:09 user nova-compute[72766]: DEBUG nova.compute.manager [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 23:33:09 user nova-compute[72766]: DEBUG nova.compute.manager [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 23:33:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 23:33:09 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Creating image(s)
Aug 14 23:33:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Acquiring lock "/opt/stack/data/nova/instances/7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:33:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Lock "/opt/stack/data/nova/instances/7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:33:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Lock "/opt/stack/data/nova/instances/7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:33:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:33:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:09 user nova-compute[72766]: DEBUG nova.policy [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bdc71e65fbee4548b9a4960af0c0e95d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d4015e97a3244b08fa5ab8ba0980983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 23:33:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.181s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:33:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Acquiring lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:33:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:33:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:33:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.177s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:33:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79/disk 1073741824 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:33:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79/disk 1073741824" returned: 0 in 0.055s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:33:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:33:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:33:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.178s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:33:10 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79/disk. size=1073741824 {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 23:33:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:33:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:33:10 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Cannot resize image /opt/stack/data/nova/instances/7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79/disk to a smaller size. {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 23:33:10 user nova-compute[72766]: DEBUG nova.objects.instance [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Lazy-loading 'migration_context' on Instance uuid 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:33:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 23:33:10 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Ensure instance console log exists: /opt/stack/data/nova/instances/7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 23:33:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:33:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:33:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:33:10 user nova-compute[72766]: DEBUG nova.network.neutron [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Successfully created port: 4ea9efeb-8a89-4ec0-9e64-7e0666be32f0 {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG nova.network.neutron [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Successfully updated port: 4ea9efeb-8a89-4ec0-9e64-7e0666be32f0 {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Acquiring lock "refresh_cache-7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Acquired lock "refresh_cache-7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG nova.network.neutron [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG nova.compute.manager [req-4df9814e-9922-41f6-b793-238fe2ef966c req-e486a34a-1ad0-4f45-8324-3a8aeb9594f2 service nova] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Received event network-changed-4ea9efeb-8a89-4ec0-9e64-7e0666be32f0 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG nova.compute.manager [req-4df9814e-9922-41f6-b793-238fe2ef966c req-e486a34a-1ad0-4f45-8324-3a8aeb9594f2 service nova] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Refreshing instance network info cache due to event network-changed-4ea9efeb-8a89-4ec0-9e64-7e0666be32f0. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-4df9814e-9922-41f6-b793-238fe2ef966c req-e486a34a-1ad0-4f45-8324-3a8aeb9594f2 service nova] Acquiring lock "refresh_cache-7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG nova.network.neutron [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG nova.network.neutron [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Updating instance_info_cache with network_info: [{"id": "4ea9efeb-8a89-4ec0-9e64-7e0666be32f0", "address": "fa:16:3e:ee:b9:52", "network": {"id": "c086991d-4ab2-4f7d-a9b5-056742d31d53", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "de1de6bb5c864b4182031c597206cc71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea9efeb-8a", "ovs_interfaceid": "4ea9efeb-8a89-4ec0-9e64-7e0666be32f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Releasing lock "refresh_cache-7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG nova.compute.manager [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Instance network_info: |[{"id": "4ea9efeb-8a89-4ec0-9e64-7e0666be32f0", "address": "fa:16:3e:ee:b9:52", "network": {"id": "c086991d-4ab2-4f7d-a9b5-056742d31d53", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "de1de6bb5c864b4182031c597206cc71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea9efeb-8a", "ovs_interfaceid": "4ea9efeb-8a89-4ec0-9e64-7e0666be32f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-4df9814e-9922-41f6-b793-238fe2ef966c req-e486a34a-1ad0-4f45-8324-3a8aeb9594f2 service nova] Acquired lock "refresh_cache-7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG nova.network.neutron [req-4df9814e-9922-41f6-b793-238fe2ef966c req-e486a34a-1ad0-4f45-8324-3a8aeb9594f2 service nova] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Refreshing network info cache for port 4ea9efeb-8a89-4ec0-9e64-7e0666be32f0 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Start _get_guest_xml network_info=[{"id": "4ea9efeb-8a89-4ec0-9e64-7e0666be32f0", "address": "fa:16:3e:ee:b9:52", "network": {"id": "c086991d-4ab2-4f7d-a9b5-056742d31d53", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "de1de6bb5c864b4182031c597206cc71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea9efeb-8a", "ovs_interfaceid": "4ea9efeb-8a89-4ec0-9e64-7e0666be32f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd2900d30-2c4c-4d57-9135-d45564c0c596'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:33:11 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:33:11 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:33:11 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:33:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-131801574',display_name='tempest-VolumesNegativeTest-instance-131801574',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-131801574',id=47,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d4015e97a3244b08fa5ab8ba0980983',ramdisk_id='',reservation_id='r-8cdg9909',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-736483761',owner_user_name='tempest-VolumesNegativeTest-736483761-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:33:09Z,user_data=None,user_id='bdc71e65fbee4548b9a4960af0c0e95d',uuid=7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ea9efeb-8a89-4ec0-9e64-7e0666be32f0", "address": "fa:16:3e:ee:b9:52", "network": {"id": "c086991d-4ab2-4f7d-a9b5-056742d31d53", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "de1de6bb5c864b4182031c597206cc71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea9efeb-8a", "ovs_interfaceid": "4ea9efeb-8a89-4ec0-9e64-7e0666be32f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Converting VIF {"id": "4ea9efeb-8a89-4ec0-9e64-7e0666be32f0", "address": "fa:16:3e:ee:b9:52", "network": {"id": "c086991d-4ab2-4f7d-a9b5-056742d31d53", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "de1de6bb5c864b4182031c597206cc71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea9efeb-8a", "ovs_interfaceid": "4ea9efeb-8a89-4ec0-9e64-7e0666be32f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:b9:52,bridge_name='br-int',has_traffic_filtering=True,id=4ea9efeb-8a89-4ec0-9e64-7e0666be32f0,network=Network(c086991d-4ab2-4f7d-a9b5-056742d31d53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ea9efeb-8a') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG nova.objects.instance [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:33:11 user nova-compute[72766]:   <uuid>7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79</uuid>
Aug 14 23:33:11 user nova-compute[72766]:   <name>instance-0000002f</name>
Aug 14 23:33:11 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:33:11 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:33:11 user nova-compute[72766]:   <metadata>
Aug 14 23:33:11 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:33:11 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:33:11 user nova-compute[72766]:       <nova:name>tempest-VolumesNegativeTest-instance-131801574</nova:name>
Aug 14 23:33:11 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:33:11</nova:creationTime>
Aug 14 23:33:11 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:33:11 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:33:11 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:33:11 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:33:11 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:33:11 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:33:11 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:33:11 user nova-compute[72766]:       <nova:owner>
Aug 14 23:33:11 user nova-compute[72766]:         <nova:user uuid="bdc71e65fbee4548b9a4960af0c0e95d">tempest-VolumesNegativeTest-736483761-project-member</nova:user>
Aug 14 23:33:11 user nova-compute[72766]:         <nova:project uuid="9d4015e97a3244b08fa5ab8ba0980983">tempest-VolumesNegativeTest-736483761</nova:project>
Aug 14 23:33:11 user nova-compute[72766]:       </nova:owner>
Aug 14 23:33:11 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 23:33:11 user nova-compute[72766]:       <nova:ports>
Aug 14 23:33:11 user nova-compute[72766]:         <nova:port uuid="4ea9efeb-8a89-4ec0-9e64-7e0666be32f0">
Aug 14 23:33:11 user nova-compute[72766]:           <nova:ip type="fixed" address="192.168.233.120" ipVersion="4"/>
Aug 14 23:33:11 user nova-compute[72766]:         </nova:port>
Aug 14 23:33:11 user nova-compute[72766]:       </nova:ports>
Aug 14 23:33:11 user nova-compute[72766]:     </nova:instance>
Aug 14 23:33:11 user nova-compute[72766]:   </metadata>
Aug 14 23:33:11 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:33:11 user nova-compute[72766]:     <system>
Aug 14 23:33:11 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:33:11 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:33:11 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:33:11 user nova-compute[72766]:       <entry name="serial">7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79</entry>
Aug 14 23:33:11 user nova-compute[72766]:       <entry name="uuid">7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79</entry>
Aug 14 23:33:11 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:33:11 user nova-compute[72766]:     </system>
Aug 14 23:33:11 user nova-compute[72766]:   </sysinfo>
Aug 14 23:33:11 user nova-compute[72766]:   <os>
Aug 14 23:33:11 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:33:11 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:33:11 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:33:11 user nova-compute[72766]:   </os>
Aug 14 23:33:11 user nova-compute[72766]:   <features>
Aug 14 23:33:11 user nova-compute[72766]:     <acpi/>
Aug 14 23:33:11 user nova-compute[72766]:     <apic/>
Aug 14 23:33:11 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:33:11 user nova-compute[72766]:   </features>
Aug 14 23:33:11 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:33:11 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:33:11 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:33:11 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:33:11 user nova-compute[72766]:   </clock>
Aug 14 23:33:11 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:33:11 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:33:11 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:33:11 user nova-compute[72766]:   </cpu>
Aug 14 23:33:11 user nova-compute[72766]:   <devices>
Aug 14 23:33:11 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 23:33:11 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 23:33:11 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79/disk"/>
Aug 14 23:33:11 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:33:11 user nova-compute[72766]:     </disk>
Aug 14 23:33:11 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:33:11 user nova-compute[72766]:       <mac address="fa:16:3e:ee:b9:52"/>
Aug 14 23:33:11 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:33:11 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:33:11 user nova-compute[72766]:       <target dev="tap4ea9efeb-8a"/>
Aug 14 23:33:11 user nova-compute[72766]:     </interface>
Aug 14 23:33:11 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:33:11 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79/console.log" append="off"/>
Aug 14 23:33:11 user nova-compute[72766]:     </serial>
Aug 14 23:33:11 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:33:11 user nova-compute[72766]:     <video>
Aug 14 23:33:11 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:33:11 user nova-compute[72766]:     </video>
Aug 14 23:33:11 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:33:11 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:33:11 user nova-compute[72766]:     </rng>
Aug 14 23:33:11 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:33:11 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:33:11 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:33:11 user nova-compute[72766]:     </memballoon>
Aug 14 23:33:11 user nova-compute[72766]:   </devices>
Aug 14 23:33:11 user nova-compute[72766]: </domain>
Aug 14 23:33:11 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:33:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-131801574',display_name='tempest-VolumesNegativeTest-instance-131801574',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-131801574',id=47,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d4015e97a3244b08fa5ab8ba0980983',ramdisk_id='',reservation_id='r-8cdg9909',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-736483761',owner_user_name='tempest-VolumesNegativeTest-736483761-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:33:09Z,user_data=None,user_id='bdc71e65fbee4548b9a4960af0c0e95d',uuid=7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ea9efeb-8a89-4ec0-9e64-7e0666be32f0", "address": "fa:16:3e:ee:b9:52", "network": {"id": "c086991d-4ab2-4f7d-a9b5-056742d31d53", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "de1de6bb5c864b4182031c597206cc71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea9efeb-8a", "ovs_interfaceid": "4ea9efeb-8a89-4ec0-9e64-7e0666be32f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Converting VIF {"id": "4ea9efeb-8a89-4ec0-9e64-7e0666be32f0", "address": "fa:16:3e:ee:b9:52", "network": {"id": "c086991d-4ab2-4f7d-a9b5-056742d31d53", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "de1de6bb5c864b4182031c597206cc71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea9efeb-8a", "ovs_interfaceid": "4ea9efeb-8a89-4ec0-9e64-7e0666be32f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:b9:52,bridge_name='br-int',has_traffic_filtering=True,id=4ea9efeb-8a89-4ec0-9e64-7e0666be32f0,network=Network(c086991d-4ab2-4f7d-a9b5-056742d31d53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ea9efeb-8a') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG os_vif [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:b9:52,bridge_name='br-int',has_traffic_filtering=True,id=4ea9efeb-8a89-4ec0-9e64-7e0666be32f0,network=Network(c086991d-4ab2-4f7d-a9b5-056742d31d53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ea9efeb-8a') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ea9efeb-8a, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4ea9efeb-8a, col_values=(('external_ids', {'iface-id': '4ea9efeb-8a89-4ec0-9e64-7e0666be32f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:b9:52', 'vm-uuid': '7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:11 user nova-compute[72766]: INFO os_vif [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:b9:52,bridge_name='br-int',has_traffic_filtering=True,id=4ea9efeb-8a89-4ec0-9e64-7e0666be32f0,network=Network(c086991d-4ab2-4f7d-a9b5-056742d31d53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ea9efeb-8a')
Aug 14 23:33:11 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:33:11 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] No VIF found with MAC fa:16:3e:ee:b9:52, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:33:12 user nova-compute[72766]: DEBUG nova.network.neutron [req-4df9814e-9922-41f6-b793-238fe2ef966c req-e486a34a-1ad0-4f45-8324-3a8aeb9594f2 service nova] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Updated VIF entry in instance network info cache for port 4ea9efeb-8a89-4ec0-9e64-7e0666be32f0. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:33:12 user nova-compute[72766]: DEBUG nova.network.neutron [req-4df9814e-9922-41f6-b793-238fe2ef966c req-e486a34a-1ad0-4f45-8324-3a8aeb9594f2 service nova] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Updating instance_info_cache with network_info: [{"id": "4ea9efeb-8a89-4ec0-9e64-7e0666be32f0", "address": "fa:16:3e:ee:b9:52", "network": {"id": "c086991d-4ab2-4f7d-a9b5-056742d31d53", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "de1de6bb5c864b4182031c597206cc71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea9efeb-8a", "ovs_interfaceid": "4ea9efeb-8a89-4ec0-9e64-7e0666be32f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:33:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-4df9814e-9922-41f6-b793-238fe2ef966c req-e486a34a-1ad0-4f45-8324-3a8aeb9594f2 service nova] Releasing lock "refresh_cache-7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:33:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:13 user nova-compute[72766]: DEBUG nova.compute.manager [req-ed85dd9f-5dac-4b32-99de-3b28aae33d61 req-8412d7e4-2edf-4f47-90c5-355c5f0e324d service nova] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Received event network-vif-plugged-4ea9efeb-8a89-4ec0-9e64-7e0666be32f0 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:33:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ed85dd9f-5dac-4b32-99de-3b28aae33d61 req-8412d7e4-2edf-4f47-90c5-355c5f0e324d service nova] Acquiring lock "7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:33:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ed85dd9f-5dac-4b32-99de-3b28aae33d61 req-8412d7e4-2edf-4f47-90c5-355c5f0e324d service nova] Lock "7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:33:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ed85dd9f-5dac-4b32-99de-3b28aae33d61 req-8412d7e4-2edf-4f47-90c5-355c5f0e324d service nova] Lock "7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:33:13 user nova-compute[72766]: DEBUG nova.compute.manager [req-ed85dd9f-5dac-4b32-99de-3b28aae33d61 req-8412d7e4-2edf-4f47-90c5-355c5f0e324d service nova] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] No waiting events found dispatching network-vif-plugged-4ea9efeb-8a89-4ec0-9e64-7e0666be32f0 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:33:13 user nova-compute[72766]: WARNING nova.compute.manager [req-ed85dd9f-5dac-4b32-99de-3b28aae33d61 req-8412d7e4-2edf-4f47-90c5-355c5f0e324d service nova] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Received unexpected event network-vif-plugged-4ea9efeb-8a89-4ec0-9e64-7e0666be32f0 for instance with vm_state building and task_state spawning.
Aug 14 23:33:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG nova.compute.manager [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 63418518-22e7-400e-9588-97682008a759] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 63418518-22e7-400e-9588-97682008a759] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 23:33:15 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 63418518-22e7-400e-9588-97682008a759] Creating image(s)
Aug 14 23:33:15 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 63418518-22e7-400e-9588-97682008a759] Did not create local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 63418518-22e7-400e-9588-97682008a759] Ensure instance console log exists: /opt/stack/data/nova/instances/63418518-22e7-400e-9588-97682008a759/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 63418518-22e7-400e-9588-97682008a759] Start _get_guest_xml network_info=[{"id": "0a42bd31-a608-4555-9822-b5529d2912ad", "address": "fa:16:3e:d8:88:75", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a42bd31-a6", "ovs_interfaceid": "0a42bd31-a608-4555-9822-b5529d2912ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'attachment_id': 'bb4aef33-f713-47c4-9239-f02eeb3b27c5', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jZpLbwoF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '63418518-22e7-400e-9588-97682008a759', 'attached_at': '', 'detached_at': '', 'volume_id': 'bff7062a-71b2-4ea9-9960-032659ad0ea2', 'serial': 'bff7062a-71b2-4ea9-9960-032659ad0ea2'}, 'volume_type': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:33:15 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:33:15 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:33:15 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 63418518-22e7-400e-9588-97682008a759] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jZpLbwoF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:33:15 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:33:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:33:15 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:33:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:33:15 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 23:33:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2 -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[21857038-7b1c-4cf7-8865-d941b71b3856]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 23:33:15 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2 -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.132s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8c4707-6fe0-4f38-b038-fdac15465225]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2] added
Aug 14 23:33:15 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e999af-b6b7-438a-889f-26c4db240eff]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[43bbe666-0369-441b-b95c-df638c6edfd5]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692055995.4001675, 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:33:15 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] VM Resumed (Lifecycle Event)
Aug 14 23:33:15 user nova-compute[72766]: DEBUG nova.compute.manager [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jZpLbwoF {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:33:15 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Instance spawned successfully.
Aug 14 23:33:15 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jZpLbwoF" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9e4cec-a7ee-40c3-a854-a148bcec20b4]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jZpLbwoF'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa1c45b-c91a-4231-a5e6-b35931c2e47c]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:33:15 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:33:15 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692055995.4009008, 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:33:15 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] VM Started (Lifecycle Event)
Aug 14 23:33:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aabdb56-82e1-4eb4-ae9e-20514c1cba1a]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 (non-flash)
Aug 14 23:33:15 user nova-compute[72766]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 (non-flash)
Aug 14 23:33:15 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 (non-flash)
Aug 14 23:33:15 user nova-compute[72766]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 (non-flash)
Aug 14 23:33:15 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2 -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:33:15 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:33:15 user nova-compute[72766]: INFO nova.compute.manager [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Took 5.99 seconds to spawn the instance on the hypervisor.
Aug 14 23:33:15 user nova-compute[72766]: DEBUG nova.compute.manager [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee2757b-b864-4b6d-a071-f91a9ba37666]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2, portal: 172.16.0.220,3260]
Aug 14 23:33:15 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2, portal: 172.16.0.220,3260] successful.
Aug 14 23:33:15 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[388bc08b-1b98-40f4-8327-a9270d492c29]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf67188c-ec30-4a7b-95a1-87fe721b8751]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 (non-flash)
Aug 14 23:33:15 user nova-compute[72766]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 (non-flash)
Aug 14 23:33:15 user nova-compute[72766]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2 (non-flash)
Aug 14 23:33:15 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 (non-flash)
Aug 14 23:33:15 user nova-compute[72766]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 (non-flash)
Aug 14 23:33:15 user nova-compute[72766]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2 (non-flash)
Aug 14 23:33:15 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.389s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 23:33:15 user nova-compute[72766]: INFO nova.compute.manager [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Took 6.65 seconds to build instance.
Aug 14 23:33:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ad5d15fb-d4a5-498e-a4bc-30c06e34de83 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Lock "7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.749s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c38850a-5456-4332-9fe9-12b5b4a17163]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jZpLbwoF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG nova.compute.manager [req-c5ee045c-629f-455c-9d2b-0f282ce60217 req-92b4a376-e396-4fe3-8dd6-b489de3e611d service nova] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Received event network-vif-plugged-4ea9efeb-8a89-4ec0-9e64-7e0666be32f0 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-c5ee045c-629f-455c-9d2b-0f282ce60217 req-92b4a376-e396-4fe3-8dd6-b489de3e611d service nova] Acquiring lock "7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-c5ee045c-629f-455c-9d2b-0f282ce60217 req-92b4a376-e396-4fe3-8dd6-b489de3e611d service nova] Lock "7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-c5ee045c-629f-455c-9d2b-0f282ce60217 req-92b4a376-e396-4fe3-8dd6-b489de3e611d service nova] Lock "7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:33:15 user nova-compute[72766]: DEBUG nova.compute.manager [req-c5ee045c-629f-455c-9d2b-0f282ce60217 req-92b4a376-e396-4fe3-8dd6-b489de3e611d service nova] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] No waiting events found dispatching network-vif-plugged-4ea9efeb-8a89-4ec0-9e64-7e0666be32f0 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:33:15 user nova-compute[72766]: WARNING nova.compute.manager [req-c5ee045c-629f-455c-9d2b-0f282ce60217 req-92b4a376-e396-4fe3-8dd6-b489de3e611d service nova] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Received unexpected event network-vif-plugged-4ea9efeb-8a89-4ec0-9e64-7e0666be32f0 for instance with vm_state active and task_state None.
Aug 14 23:33:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.420s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:33:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] <== connect_volume: return (1421ms) {'type': 'block', 'scsi_wwn': '23538353436353436', 'path': '/dev/sdc'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:33:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 63418518-22e7-400e-9588-97682008a759] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538353436353436', 'path': '/dev/sdc'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 23:33:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:33:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1121239585',display_name='tempest-TestVolumeBootPattern-server-1121239585',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1121239585',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPvSbILRfrlJBoXiI6yAoEx23QxBOaut7EAv1f2wh2U36gaT4scPzMrBzJaFGwi3LSF0CotAN19+FTvGG2504Ya9pzKNYbrJtakJiRU4EWISkkDaslgouPorjyQ0mmkoOQ==',key_name='tempest-TestVolumeBootPattern-925108064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3c9f53727cc497c94516ff7fa1bbf4f',ramdisk_id='',reservation_id='r-0n1rskvk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-213280496',owner_user_name='tempest-TestVolumeBootPattern-213280496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:33:06Z,user_data=None,user_id='999390ac8e6240199c9a7484e234f3a7',uuid=63418518-22e7-400e-9588-97682008a759,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a42bd31-a608-4555-9822-b5529d2912ad", "address": "fa:16:3e:d8:88:75", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a42bd31-a6", "ovs_interfaceid": "0a42bd31-a608-4555-9822-b5529d2912ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:33:16 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Converting VIF {"id": "0a42bd31-a608-4555-9822-b5529d2912ad", "address": "fa:16:3e:d8:88:75", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a42bd31-a6", "ovs_interfaceid": "0a42bd31-a608-4555-9822-b5529d2912ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:33:16 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:88:75,bridge_name='br-int',has_traffic_filtering=True,id=0a42bd31-a608-4555-9822-b5529d2912ad,network=Network(f418a384-bbac-4892-8e0f-c7af2e9464ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a42bd31-a6') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:33:16 user nova-compute[72766]: DEBUG nova.objects.instance [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lazy-loading 'pci_devices' on Instance uuid 63418518-22e7-400e-9588-97682008a759 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:33:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 63418518-22e7-400e-9588-97682008a759] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:33:16 user nova-compute[72766]:   <uuid>63418518-22e7-400e-9588-97682008a759</uuid>
Aug 14 23:33:16 user nova-compute[72766]:   <name>instance-0000002e</name>
Aug 14 23:33:16 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:33:16 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:33:16 user nova-compute[72766]:   <metadata>
Aug 14 23:33:16 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:33:16 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:33:16 user nova-compute[72766]:       <nova:name>tempest-TestVolumeBootPattern-server-1121239585</nova:name>
Aug 14 23:33:16 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:33:15</nova:creationTime>
Aug 14 23:33:16 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:33:16 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:33:16 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:33:16 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:33:16 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:33:16 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:33:16 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:33:16 user nova-compute[72766]:       <nova:owner>
Aug 14 23:33:16 user nova-compute[72766]:         <nova:user uuid="999390ac8e6240199c9a7484e234f3a7">tempest-TestVolumeBootPattern-213280496-project-member</nova:user>
Aug 14 23:33:16 user nova-compute[72766]:         <nova:project uuid="a3c9f53727cc497c94516ff7fa1bbf4f">tempest-TestVolumeBootPattern-213280496</nova:project>
Aug 14 23:33:16 user nova-compute[72766]:       </nova:owner>
Aug 14 23:33:16 user nova-compute[72766]:       <nova:ports>
Aug 14 23:33:16 user nova-compute[72766]:         <nova:port uuid="0a42bd31-a608-4555-9822-b5529d2912ad">
Aug 14 23:33:16 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 14 23:33:16 user nova-compute[72766]:         </nova:port>
Aug 14 23:33:16 user nova-compute[72766]:       </nova:ports>
Aug 14 23:33:16 user nova-compute[72766]:     </nova:instance>
Aug 14 23:33:16 user nova-compute[72766]:   </metadata>
Aug 14 23:33:16 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:33:16 user nova-compute[72766]:     <system>
Aug 14 23:33:16 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:33:16 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:33:16 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:33:16 user nova-compute[72766]:       <entry name="serial">63418518-22e7-400e-9588-97682008a759</entry>
Aug 14 23:33:16 user nova-compute[72766]:       <entry name="uuid">63418518-22e7-400e-9588-97682008a759</entry>
Aug 14 23:33:16 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:33:16 user nova-compute[72766]:     </system>
Aug 14 23:33:16 user nova-compute[72766]:   </sysinfo>
Aug 14 23:33:16 user nova-compute[72766]:   <os>
Aug 14 23:33:16 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:33:16 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:33:16 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:33:16 user nova-compute[72766]:   </os>
Aug 14 23:33:16 user nova-compute[72766]:   <features>
Aug 14 23:33:16 user nova-compute[72766]:     <acpi/>
Aug 14 23:33:16 user nova-compute[72766]:     <apic/>
Aug 14 23:33:16 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:33:16 user nova-compute[72766]:   </features>
Aug 14 23:33:16 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:33:16 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:33:16 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:33:16 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:33:16 user nova-compute[72766]:   </clock>
Aug 14 23:33:16 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:33:16 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:33:16 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:33:16 user nova-compute[72766]:   </cpu>
Aug 14 23:33:16 user nova-compute[72766]:   <devices>
Aug 14 23:33:16 user nova-compute[72766]:     <disk type="block" device="disk">
Aug 14 23:33:16 user nova-compute[72766]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:33:16 user nova-compute[72766]:       <source dev="/dev/sdc"/>
Aug 14 23:33:16 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:33:16 user nova-compute[72766]:       <serial>bff7062a-71b2-4ea9-9960-032659ad0ea2</serial>
Aug 14 23:33:16 user nova-compute[72766]:     </disk>
Aug 14 23:33:16 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:33:16 user nova-compute[72766]:       <mac address="fa:16:3e:d8:88:75"/>
Aug 14 23:33:16 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:33:16 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:33:16 user nova-compute[72766]:       <target dev="tap0a42bd31-a6"/>
Aug 14 23:33:16 user nova-compute[72766]:     </interface>
Aug 14 23:33:16 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:33:16 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/63418518-22e7-400e-9588-97682008a759/console.log" append="off"/>
Aug 14 23:33:16 user nova-compute[72766]:     </serial>
Aug 14 23:33:16 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:33:16 user nova-compute[72766]:     <video>
Aug 14 23:33:16 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:33:16 user nova-compute[72766]:     </video>
Aug 14 23:33:16 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:33:16 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:33:16 user nova-compute[72766]:     </rng>
Aug 14 23:33:16 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:33:16 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:33:16 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:33:16 user nova-compute[72766]:     </memballoon>
Aug 14 23:33:16 user nova-compute[72766]:   </devices>
Aug 14 23:33:16 user nova-compute[72766]: </domain>
Aug 14 23:33:16 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:33:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:33:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1121239585',display_name='tempest-TestVolumeBootPattern-server-1121239585',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1121239585',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPvSbILRfrlJBoXiI6yAoEx23QxBOaut7EAv1f2wh2U36gaT4scPzMrBzJaFGwi3LSF0CotAN19+FTvGG2504Ya9pzKNYbrJtakJiRU4EWISkkDaslgouPorjyQ0mmkoOQ==',key_name='tempest-TestVolumeBootPattern-925108064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3c9f53727cc497c94516ff7fa1bbf4f',ramdisk_id='',reservation_id='r-0n1rskvk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-213280496',owner_user_name='tempest-TestVolumeBootPattern-213280496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:33:06Z,user_data=None,user_id='999390ac8e6240199c9a7484e234f3a7',uuid=63418518-22e7-400e-9588-97682008a759,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a42bd31-a608-4555-9822-b5529d2912ad", "address": "fa:16:3e:d8:88:75", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a42bd31-a6", "ovs_interfaceid": "0a42bd31-a608-4555-9822-b5529d2912ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:33:16 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Converting VIF {"id": "0a42bd31-a608-4555-9822-b5529d2912ad", "address": "fa:16:3e:d8:88:75", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a42bd31-a6", "ovs_interfaceid": "0a42bd31-a608-4555-9822-b5529d2912ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:33:16 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:88:75,bridge_name='br-int',has_traffic_filtering=True,id=0a42bd31-a608-4555-9822-b5529d2912ad,network=Network(f418a384-bbac-4892-8e0f-c7af2e9464ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a42bd31-a6') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:33:16 user nova-compute[72766]: DEBUG os_vif [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:88:75,bridge_name='br-int',has_traffic_filtering=True,id=0a42bd31-a608-4555-9822-b5529d2912ad,network=Network(f418a384-bbac-4892-8e0f-c7af2e9464ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a42bd31-a6') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:33:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:33:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:33:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a42bd31-a6, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:33:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0a42bd31-a6, col_values=(('external_ids', {'iface-id': '0a42bd31-a608-4555-9822-b5529d2912ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:88:75', 'vm-uuid': '63418518-22e7-400e-9588-97682008a759'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:33:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:33:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:16 user nova-compute[72766]: INFO os_vif [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:88:75,bridge_name='br-int',has_traffic_filtering=True,id=0a42bd31-a608-4555-9822-b5529d2912ad,network=Network(f418a384-bbac-4892-8e0f-c7af2e9464ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a42bd31-a6')
Aug 14 23:33:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:33:16 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] No VIF found with MAC fa:16:3e:d8:88:75, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:33:17 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:18 user nova-compute[72766]: DEBUG nova.compute.manager [req-fd7e160a-672e-4e65-94bf-ed44e9dfcba6 req-1337af6c-a874-46a6-9dd3-eb08426f7f92 service nova] [instance: 63418518-22e7-400e-9588-97682008a759] Received event network-vif-plugged-0a42bd31-a608-4555-9822-b5529d2912ad {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:33:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-fd7e160a-672e-4e65-94bf-ed44e9dfcba6 req-1337af6c-a874-46a6-9dd3-eb08426f7f92 service nova] Acquiring lock "63418518-22e7-400e-9588-97682008a759-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:33:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-fd7e160a-672e-4e65-94bf-ed44e9dfcba6 req-1337af6c-a874-46a6-9dd3-eb08426f7f92 service nova] Lock "63418518-22e7-400e-9588-97682008a759-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:33:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-fd7e160a-672e-4e65-94bf-ed44e9dfcba6 req-1337af6c-a874-46a6-9dd3-eb08426f7f92 service nova] Lock "63418518-22e7-400e-9588-97682008a759-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:33:18 user nova-compute[72766]: DEBUG nova.compute.manager [req-fd7e160a-672e-4e65-94bf-ed44e9dfcba6 req-1337af6c-a874-46a6-9dd3-eb08426f7f92 service nova] [instance: 63418518-22e7-400e-9588-97682008a759] No waiting events found dispatching network-vif-plugged-0a42bd31-a608-4555-9822-b5529d2912ad {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:33:18 user nova-compute[72766]: WARNING nova.compute.manager [req-fd7e160a-672e-4e65-94bf-ed44e9dfcba6 req-1337af6c-a874-46a6-9dd3-eb08426f7f92 service nova] [instance: 63418518-22e7-400e-9588-97682008a759] Received unexpected event network-vif-plugged-0a42bd31-a608-4555-9822-b5529d2912ad for instance with vm_state building and task_state spawning.
Aug 14 23:33:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:20 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692056000.1431308, 63418518-22e7-400e-9588-97682008a759 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:33:20 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 63418518-22e7-400e-9588-97682008a759] VM Resumed (Lifecycle Event)
Aug 14 23:33:20 user nova-compute[72766]: DEBUG nova.compute.manager [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 63418518-22e7-400e-9588-97682008a759] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:33:20 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 63418518-22e7-400e-9588-97682008a759] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 23:33:20 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 63418518-22e7-400e-9588-97682008a759] Instance spawned successfully.
Aug 14 23:33:20 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 63418518-22e7-400e-9588-97682008a759] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 23:33:20 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 63418518-22e7-400e-9588-97682008a759] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:33:20 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 63418518-22e7-400e-9588-97682008a759] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:33:20 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 63418518-22e7-400e-9588-97682008a759] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:33:20 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 63418518-22e7-400e-9588-97682008a759] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:33:20 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 63418518-22e7-400e-9588-97682008a759] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:33:20 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 63418518-22e7-400e-9588-97682008a759] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:33:20 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 63418518-22e7-400e-9588-97682008a759] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:33:20 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 63418518-22e7-400e-9588-97682008a759] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:33:20 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 63418518-22e7-400e-9588-97682008a759] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:33:20 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692056000.1466212, 63418518-22e7-400e-9588-97682008a759 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:33:20 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 63418518-22e7-400e-9588-97682008a759] VM Started (Lifecycle Event)
Aug 14 23:33:20 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 63418518-22e7-400e-9588-97682008a759] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:33:20 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 63418518-22e7-400e-9588-97682008a759] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:33:20 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 63418518-22e7-400e-9588-97682008a759] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:33:20 user nova-compute[72766]: DEBUG nova.compute.manager [req-23e7d4b7-0930-4467-bfed-c151a2364120 req-04e3a06d-3fdc-4d97-8484-c095cade9e07 service nova] [instance: 63418518-22e7-400e-9588-97682008a759] Received event network-vif-plugged-0a42bd31-a608-4555-9822-b5529d2912ad {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:33:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-23e7d4b7-0930-4467-bfed-c151a2364120 req-04e3a06d-3fdc-4d97-8484-c095cade9e07 service nova] Acquiring lock "63418518-22e7-400e-9588-97682008a759-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:33:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-23e7d4b7-0930-4467-bfed-c151a2364120 req-04e3a06d-3fdc-4d97-8484-c095cade9e07 service nova] Lock "63418518-22e7-400e-9588-97682008a759-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:33:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-23e7d4b7-0930-4467-bfed-c151a2364120 req-04e3a06d-3fdc-4d97-8484-c095cade9e07 service nova] Lock "63418518-22e7-400e-9588-97682008a759-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:33:20 user nova-compute[72766]: DEBUG nova.compute.manager [req-23e7d4b7-0930-4467-bfed-c151a2364120 req-04e3a06d-3fdc-4d97-8484-c095cade9e07 service nova] [instance: 63418518-22e7-400e-9588-97682008a759] No waiting events found dispatching network-vif-plugged-0a42bd31-a608-4555-9822-b5529d2912ad {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:33:20 user nova-compute[72766]: WARNING nova.compute.manager [req-23e7d4b7-0930-4467-bfed-c151a2364120 req-04e3a06d-3fdc-4d97-8484-c095cade9e07 service nova] [instance: 63418518-22e7-400e-9588-97682008a759] Received unexpected event network-vif-plugged-0a42bd31-a608-4555-9822-b5529d2912ad for instance with vm_state building and task_state spawning.
Aug 14 23:33:20 user nova-compute[72766]: INFO nova.compute.manager [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 63418518-22e7-400e-9588-97682008a759] Took 5.13 seconds to spawn the instance on the hypervisor.
Aug 14 23:33:20 user nova-compute[72766]: DEBUG nova.compute.manager [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 63418518-22e7-400e-9588-97682008a759] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:33:20 user nova-compute[72766]: INFO nova.compute.manager [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 63418518-22e7-400e-9588-97682008a759] Took 15.28 seconds to build instance.
Aug 14 23:33:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-bba461d5-73a4-4dec-932f-33ea65f27c67 tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "63418518-22e7-400e-9588-97682008a759" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.378s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:33:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:36 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:39 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:39 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:33:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:46 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:33:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:47 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:33:47 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:33:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-5965063c-8d1b-41d0-8c22-7d5b54925f94" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:33:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-5965063c-8d1b-41d0-8c22-7d5b54925f94" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:33:47 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:33:48 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Updating instance_info_cache with network_info: [{"id": "09bcfc13-ace1-4e60-8ed3-2a3b1a09e957", "address": "fa:16:3e:e8:a7:0c", "network": {"id": "c7828c64-4d71-4c57-8df8-bb4524d9b9cb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-160068070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbd47fb3d5eb408aa751d1d49f198906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09bcfc13-ac", "ovs_interfaceid": "09bcfc13-ace1-4e60-8ed3-2a3b1a09e957", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:33:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-5965063c-8d1b-41d0-8c22-7d5b54925f94" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:33:48 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:33:48 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:33:48 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:33:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:33:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:33:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:33:48 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:33:48 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:33:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:33:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:33:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:33:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:33:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:33:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:33:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:33:49 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:33:49 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:33:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5965063c-8d1b-41d0-8c22-7d5b54925f94/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:33:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5965063c-8d1b-41d0-8c22-7d5b54925f94/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:33:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5965063c-8d1b-41d0-8c22-7d5b54925f94/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:33:49 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5965063c-8d1b-41d0-8c22-7d5b54925f94/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:33:49 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:33:50 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:33:50 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:33:50 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=7984MB free_disk=25.203815460205078GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:33:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:33:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:33:50 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Applying migration context for instance 211043bf-dcc9-44af-834c-75cd7be859ec as it has an incoming, in-progress migration 6547e6b5-107f-4c3f-9d74-6a75e3427a67. Migration status is finished {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 14 23:33:50 user nova-compute[72766]: INFO nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Updating resource usage from migration 6547e6b5-107f-4c3f-9d74-6a75e3427a67
Aug 14 23:33:50 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance cbcf7851-e6f7-4f46-97cc-d773286ccddf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:33:50 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 5965063c-8d1b-41d0-8c22-7d5b54925f94 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:33:50 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance c5fe05bb-7204-47df-b033-a7462a21166c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:33:50 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Migration 6547e6b5-107f-4c3f-9d74-6a75e3427a67 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 14 23:33:50 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 211043bf-dcc9-44af-834c-75cd7be859ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:33:50 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 63418518-22e7-400e-9588-97682008a759 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:33:50 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:33:50 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:33:50 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:33:50 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:33:50 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:33:50 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:33:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.367s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:33:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:53 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:33:53 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:33:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c0be463b-fc00-4667-a713-ba32778479fa tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Acquiring lock "5965063c-8d1b-41d0-8c22-7d5b54925f94" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:33:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c0be463b-fc00-4667-a713-ba32778479fa tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "5965063c-8d1b-41d0-8c22-7d5b54925f94" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:33:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c0be463b-fc00-4667-a713-ba32778479fa tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Acquiring lock "5965063c-8d1b-41d0-8c22-7d5b54925f94-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:33:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c0be463b-fc00-4667-a713-ba32778479fa tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "5965063c-8d1b-41d0-8c22-7d5b54925f94-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:33:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c0be463b-fc00-4667-a713-ba32778479fa tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "5965063c-8d1b-41d0-8c22-7d5b54925f94-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:33:53 user nova-compute[72766]: INFO nova.compute.manager [None req-c0be463b-fc00-4667-a713-ba32778479fa tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Terminating instance
Aug 14 23:33:53 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c0be463b-fc00-4667-a713-ba32778479fa tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:33:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:54 user nova-compute[72766]: DEBUG nova.compute.manager [req-8a9eeb12-cc6d-49ca-9c05-7c17fddc7455 req-09b67438-b7b0-4e3f-b97a-19385e9b6c5e service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Received event network-vif-unplugged-09bcfc13-ace1-4e60-8ed3-2a3b1a09e957 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:33:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8a9eeb12-cc6d-49ca-9c05-7c17fddc7455 req-09b67438-b7b0-4e3f-b97a-19385e9b6c5e service nova] Acquiring lock "5965063c-8d1b-41d0-8c22-7d5b54925f94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:33:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8a9eeb12-cc6d-49ca-9c05-7c17fddc7455 req-09b67438-b7b0-4e3f-b97a-19385e9b6c5e service nova] Lock "5965063c-8d1b-41d0-8c22-7d5b54925f94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:33:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8a9eeb12-cc6d-49ca-9c05-7c17fddc7455 req-09b67438-b7b0-4e3f-b97a-19385e9b6c5e service nova] Lock "5965063c-8d1b-41d0-8c22-7d5b54925f94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:33:54 user nova-compute[72766]: DEBUG nova.compute.manager [req-8a9eeb12-cc6d-49ca-9c05-7c17fddc7455 req-09b67438-b7b0-4e3f-b97a-19385e9b6c5e service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] No waiting events found dispatching network-vif-unplugged-09bcfc13-ace1-4e60-8ed3-2a3b1a09e957 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:33:54 user nova-compute[72766]: DEBUG nova.compute.manager [req-8a9eeb12-cc6d-49ca-9c05-7c17fddc7455 req-09b67438-b7b0-4e3f-b97a-19385e9b6c5e service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Received event network-vif-unplugged-09bcfc13-ace1-4e60-8ed3-2a3b1a09e957 for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:33:54 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Instance destroyed successfully.
Aug 14 23:33:54 user nova-compute[72766]: DEBUG nova.objects.instance [None req-c0be463b-fc00-4667-a713-ba32778479fa tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lazy-loading 'resources' on Instance uuid 5965063c-8d1b-41d0-8c22-7d5b54925f94 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:33:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-c0be463b-fc00-4667-a713-ba32778479fa tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:28:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-550732363',display_name='tempest-TestMinimumBasicScenario-server-550732363',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-550732363',id=43,image_ref='e78205bc-79cc-4112-a712-fbea0fc21162',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBGPLpKpF5z05Eket3b6BVraB4mg9MjCuMlglJn7NYc6zoC1MJOaMkiuFix12gnjZLPz8Tt1GsD+fJsA3akyP/lx4Dxx04+Be5uUfpbx5Iu1WmkbxlTWUu51D/t5upfgg==',key_name='tempest-TestMinimumBasicScenario-1117827024',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:29:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cbd47fb3d5eb408aa751d1d49f198906',ramdisk_id='',reservation_id='r-2x8pvbxc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e78205bc-79cc-4112-a712-fbea0fc21162',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1491062679',owner_user_name='tempest-TestMinimumBasicScenario-1491062679-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:31:12Z,user_data=None,user_id='a2b1f48b1a594010befb4da227f8b473',uuid=5965063c-8d1b-41d0-8c22-7d5b54925f94,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09bcfc13-ace1-4e60-8ed3-2a3b1a09e957", "address": "fa:16:3e:e8:a7:0c", "network": {"id": "c7828c64-4d71-4c57-8df8-bb4524d9b9cb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-160068070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbd47fb3d5eb408aa751d1d49f198906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09bcfc13-ac", "ovs_interfaceid": "09bcfc13-ace1-4e60-8ed3-2a3b1a09e957", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:33:54 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-c0be463b-fc00-4667-a713-ba32778479fa tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Converting VIF {"id": "09bcfc13-ace1-4e60-8ed3-2a3b1a09e957", "address": "fa:16:3e:e8:a7:0c", "network": {"id": "c7828c64-4d71-4c57-8df8-bb4524d9b9cb", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-160068070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbd47fb3d5eb408aa751d1d49f198906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09bcfc13-ac", "ovs_interfaceid": "09bcfc13-ace1-4e60-8ed3-2a3b1a09e957", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:33:54 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-c0be463b-fc00-4667-a713-ba32778479fa tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:a7:0c,bridge_name='br-int',has_traffic_filtering=True,id=09bcfc13-ace1-4e60-8ed3-2a3b1a09e957,network=Network(c7828c64-4d71-4c57-8df8-bb4524d9b9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09bcfc13-ac') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:33:54 user nova-compute[72766]: DEBUG os_vif [None req-c0be463b-fc00-4667-a713-ba32778479fa tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:a7:0c,bridge_name='br-int',has_traffic_filtering=True,id=09bcfc13-ace1-4e60-8ed3-2a3b1a09e957,network=Network(c7828c64-4d71-4c57-8df8-bb4524d9b9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09bcfc13-ac') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:33:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09bcfc13-ac, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:33:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:54 user nova-compute[72766]: INFO os_vif [None req-c0be463b-fc00-4667-a713-ba32778479fa tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:a7:0c,bridge_name='br-int',has_traffic_filtering=True,id=09bcfc13-ace1-4e60-8ed3-2a3b1a09e957,network=Network(c7828c64-4d71-4c57-8df8-bb4524d9b9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09bcfc13-ac')
Aug 14 23:33:54 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-c0be463b-fc00-4667-a713-ba32778479fa tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Deleting instance files /opt/stack/data/nova/instances/5965063c-8d1b-41d0-8c22-7d5b54925f94_del
Aug 14 23:33:54 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-c0be463b-fc00-4667-a713-ba32778479fa tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Deletion of /opt/stack/data/nova/instances/5965063c-8d1b-41d0-8c22-7d5b54925f94_del complete
Aug 14 23:33:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:33:54 user nova-compute[72766]: INFO nova.compute.manager [None req-c0be463b-fc00-4667-a713-ba32778479fa tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 14 23:33:54 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-c0be463b-fc00-4667-a713-ba32778479fa tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:33:54 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:33:54 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:33:55 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:33:55 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Took 0.53 seconds to deallocate network for instance.
Aug 14 23:33:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c0be463b-fc00-4667-a713-ba32778479fa tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:33:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c0be463b-fc00-4667-a713-ba32778479fa tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:33:55 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c0be463b-fc00-4667-a713-ba32778479fa tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:33:55 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c0be463b-fc00-4667-a713-ba32778479fa tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:33:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c0be463b-fc00-4667-a713-ba32778479fa tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.259s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:33:55 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:33:55 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:33:55 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-c0be463b-fc00-4667-a713-ba32778479fa tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Deleted allocations for instance 5965063c-8d1b-41d0-8c22-7d5b54925f94
Aug 14 23:33:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c0be463b-fc00-4667-a713-ba32778479fa tempest-TestMinimumBasicScenario-1491062679 tempest-TestMinimumBasicScenario-1491062679-project-member] Lock "5965063c-8d1b-41d0-8c22-7d5b54925f94" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.989s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:33:56 user nova-compute[72766]: DEBUG nova.compute.manager [req-01d0a7ed-c8ed-47ea-91fd-a596f9b7673f req-832db9a3-dfe4-491f-b66e-3d29cb66bb0b service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Received event network-vif-plugged-09bcfc13-ace1-4e60-8ed3-2a3b1a09e957 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:33:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-01d0a7ed-c8ed-47ea-91fd-a596f9b7673f req-832db9a3-dfe4-491f-b66e-3d29cb66bb0b service nova] Acquiring lock "5965063c-8d1b-41d0-8c22-7d5b54925f94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:33:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-01d0a7ed-c8ed-47ea-91fd-a596f9b7673f req-832db9a3-dfe4-491f-b66e-3d29cb66bb0b service nova] Lock "5965063c-8d1b-41d0-8c22-7d5b54925f94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:33:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-01d0a7ed-c8ed-47ea-91fd-a596f9b7673f req-832db9a3-dfe4-491f-b66e-3d29cb66bb0b service nova] Lock "5965063c-8d1b-41d0-8c22-7d5b54925f94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:33:56 user nova-compute[72766]: DEBUG nova.compute.manager [req-01d0a7ed-c8ed-47ea-91fd-a596f9b7673f req-832db9a3-dfe4-491f-b66e-3d29cb66bb0b service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] No waiting events found dispatching network-vif-plugged-09bcfc13-ace1-4e60-8ed3-2a3b1a09e957 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:33:56 user nova-compute[72766]: WARNING nova.compute.manager [req-01d0a7ed-c8ed-47ea-91fd-a596f9b7673f req-832db9a3-dfe4-491f-b66e-3d29cb66bb0b service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Received unexpected event network-vif-plugged-09bcfc13-ace1-4e60-8ed3-2a3b1a09e957 for instance with vm_state deleted and task_state None.
Aug 14 23:33:56 user nova-compute[72766]: DEBUG nova.compute.manager [req-01d0a7ed-c8ed-47ea-91fd-a596f9b7673f req-832db9a3-dfe4-491f-b66e-3d29cb66bb0b service nova] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Received event network-vif-deleted-09bcfc13-ace1-4e60-8ed3-2a3b1a09e957 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:33:57 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:33:57 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:33:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-563be6dc-d507-4fa1-bd49-c3027c0bd6d4 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "211043bf-dcc9-44af-834c-75cd7be859ec" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:33:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-563be6dc-d507-4fa1-bd49-c3027c0bd6d4 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "211043bf-dcc9-44af-834c-75cd7be859ec" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:33:57 user nova-compute[72766]: DEBUG nova.compute.manager [None req-563be6dc-d507-4fa1-bd49-c3027c0bd6d4 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Going to confirm migration 2 {{(pid=72766) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 14 23:33:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-563be6dc-d507-4fa1-bd49-c3027c0bd6d4 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "refresh_cache-211043bf-dcc9-44af-834c-75cd7be859ec" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:33:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-563be6dc-d507-4fa1-bd49-c3027c0bd6d4 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquired lock "refresh_cache-211043bf-dcc9-44af-834c-75cd7be859ec" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:33:58 user nova-compute[72766]: DEBUG nova.network.neutron [None req-563be6dc-d507-4fa1-bd49-c3027c0bd6d4 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:33:58 user nova-compute[72766]: DEBUG nova.objects.instance [None req-563be6dc-d507-4fa1-bd49-c3027c0bd6d4 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lazy-loading 'info_cache' on Instance uuid 211043bf-dcc9-44af-834c-75cd7be859ec {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:33:58 user nova-compute[72766]: DEBUG nova.network.neutron [None req-563be6dc-d507-4fa1-bd49-c3027c0bd6d4 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Updating instance_info_cache with network_info: [{"id": "3e62931c-4358-4153-8d5e-c4675640e3fa", "address": "fa:16:3e:2b:91:b3", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e62931c-43", "ovs_interfaceid": "3e62931c-4358-4153-8d5e-c4675640e3fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:33:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-563be6dc-d507-4fa1-bd49-c3027c0bd6d4 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Releasing lock "refresh_cache-211043bf-dcc9-44af-834c-75cd7be859ec" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:33:58 user nova-compute[72766]: DEBUG nova.objects.instance [None req-563be6dc-d507-4fa1-bd49-c3027c0bd6d4 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lazy-loading 'migration_context' on Instance uuid 211043bf-dcc9-44af-834c-75cd7be859ec {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:33:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-563be6dc-d507-4fa1-bd49-c3027c0bd6d4 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:33:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-563be6dc-d507-4fa1-bd49-c3027c0bd6d4 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:33:58 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-563be6dc-d507-4fa1-bd49-c3027c0bd6d4 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:33:58 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-563be6dc-d507-4fa1-bd49-c3027c0bd6d4 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:33:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-563be6dc-d507-4fa1-bd49-c3027c0bd6d4 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.278s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:33:59 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-563be6dc-d507-4fa1-bd49-c3027c0bd6d4 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Deleted allocation for migration 6547e6b5-107f-4c3f-9d74-6a75e3427a67
Aug 14 23:33:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-563be6dc-d507-4fa1-bd49-c3027c0bd6d4 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "211043bf-dcc9-44af-834c-75cd7be859ec" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.218s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:33:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:34:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:34:09 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692056034.5471117, 5965063c-8d1b-41d0-8c22-7d5b54925f94 => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:34:09 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] VM Stopped (Lifecycle Event)
Aug 14 23:34:09 user nova-compute[72766]: DEBUG nova.compute.manager [None req-e89829f0-15b4-4450-b8a6-6e0f5166343d None None] [instance: 5965063c-8d1b-41d0-8c22-7d5b54925f94] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:34:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:34:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:34:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:34:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:34:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:34:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:34:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:34:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:34:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:34:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:34:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:34:39 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:34:40 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:34:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:34:47 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:34:47 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:34:47 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:34:47 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:34:47 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:34:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-211043bf-dcc9-44af-834c-75cd7be859ec" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:34:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-211043bf-dcc9-44af-834c-75cd7be859ec" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:34:47 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:34:48 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Updating instance_info_cache with network_info: [{"id": "3e62931c-4358-4153-8d5e-c4675640e3fa", "address": "fa:16:3e:2b:91:b3", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e62931c-43", "ovs_interfaceid": "3e62931c-4358-4153-8d5e-c4675640e3fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:34:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-211043bf-dcc9-44af-834c-75cd7be859ec" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:34:48 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:34:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:34:49 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:34:50 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:34:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:34:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:34:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:34:50 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:34:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:34:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:34:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:34:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:34:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:34:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:34:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:34:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:34:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:34:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:34:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:34:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:34:52 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:34:52 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:34:52 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=8182MB free_disk=25.270545959472656GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:34:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:34:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:34:52 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance cbcf7851-e6f7-4f46-97cc-d773286ccddf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:34:52 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance c5fe05bb-7204-47df-b033-a7462a21166c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:34:52 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 211043bf-dcc9-44af-834c-75cd7be859ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:34:52 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 63418518-22e7-400e-9588-97682008a759 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:34:52 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:34:52 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:34:52 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:34:52 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:34:52 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:34:52 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:34:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.312s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:34:54 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:34:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:34:56 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:34:56 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:34:56 user nova-compute[72766]: DEBUG nova.compute.manager [req-9a07b00f-9725-4088-8841-379db41e730b req-65c51cdb-3804-4f55-a6b5-e33345b789f9 service nova] [instance: 63418518-22e7-400e-9588-97682008a759] Received event network-changed-0a42bd31-a608-4555-9822-b5529d2912ad {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:34:56 user nova-compute[72766]: DEBUG nova.compute.manager [req-9a07b00f-9725-4088-8841-379db41e730b req-65c51cdb-3804-4f55-a6b5-e33345b789f9 service nova] [instance: 63418518-22e7-400e-9588-97682008a759] Refreshing instance network info cache due to event network-changed-0a42bd31-a608-4555-9822-b5529d2912ad. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:34:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9a07b00f-9725-4088-8841-379db41e730b req-65c51cdb-3804-4f55-a6b5-e33345b789f9 service nova] Acquiring lock "refresh_cache-63418518-22e7-400e-9588-97682008a759" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:34:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9a07b00f-9725-4088-8841-379db41e730b req-65c51cdb-3804-4f55-a6b5-e33345b789f9 service nova] Acquired lock "refresh_cache-63418518-22e7-400e-9588-97682008a759" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:34:56 user nova-compute[72766]: DEBUG nova.network.neutron [req-9a07b00f-9725-4088-8841-379db41e730b req-65c51cdb-3804-4f55-a6b5-e33345b789f9 service nova] [instance: 63418518-22e7-400e-9588-97682008a759] Refreshing network info cache for port 0a42bd31-a608-4555-9822-b5529d2912ad {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:34:57 user nova-compute[72766]: DEBUG nova.network.neutron [req-9a07b00f-9725-4088-8841-379db41e730b req-65c51cdb-3804-4f55-a6b5-e33345b789f9 service nova] [instance: 63418518-22e7-400e-9588-97682008a759] Updated VIF entry in instance network info cache for port 0a42bd31-a608-4555-9822-b5529d2912ad. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:34:57 user nova-compute[72766]: DEBUG nova.network.neutron [req-9a07b00f-9725-4088-8841-379db41e730b req-65c51cdb-3804-4f55-a6b5-e33345b789f9 service nova] [instance: 63418518-22e7-400e-9588-97682008a759] Updating instance_info_cache with network_info: [{"id": "0a42bd31-a608-4555-9822-b5529d2912ad", "address": "fa:16:3e:d8:88:75", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a42bd31-a6", "ovs_interfaceid": "0a42bd31-a608-4555-9822-b5529d2912ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:34:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9a07b00f-9725-4088-8841-379db41e730b req-65c51cdb-3804-4f55-a6b5-e33345b789f9 service nova] Releasing lock "refresh_cache-63418518-22e7-400e-9588-97682008a759" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:34:57 user nova-compute[72766]: DEBUG nova.compute.manager [req-b0af951a-d965-4c63-8cd9-e8b752a28b0c req-c213774e-93eb-4b70-81d0-26009e65617b service nova] [instance: 63418518-22e7-400e-9588-97682008a759] Received event network-changed-0a42bd31-a608-4555-9822-b5529d2912ad {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:34:57 user nova-compute[72766]: DEBUG nova.compute.manager [req-b0af951a-d965-4c63-8cd9-e8b752a28b0c req-c213774e-93eb-4b70-81d0-26009e65617b service nova] [instance: 63418518-22e7-400e-9588-97682008a759] Refreshing instance network info cache due to event network-changed-0a42bd31-a608-4555-9822-b5529d2912ad. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:34:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-b0af951a-d965-4c63-8cd9-e8b752a28b0c req-c213774e-93eb-4b70-81d0-26009e65617b service nova] Acquiring lock "refresh_cache-63418518-22e7-400e-9588-97682008a759" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:34:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-b0af951a-d965-4c63-8cd9-e8b752a28b0c req-c213774e-93eb-4b70-81d0-26009e65617b service nova] Acquired lock "refresh_cache-63418518-22e7-400e-9588-97682008a759" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:34:57 user nova-compute[72766]: DEBUG nova.network.neutron [req-b0af951a-d965-4c63-8cd9-e8b752a28b0c req-c213774e-93eb-4b70-81d0-26009e65617b service nova] [instance: 63418518-22e7-400e-9588-97682008a759] Refreshing network info cache for port 0a42bd31-a608-4555-9822-b5529d2912ad {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:34:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "63418518-22e7-400e-9588-97682008a759" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:34:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "63418518-22e7-400e-9588-97682008a759" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:34:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "63418518-22e7-400e-9588-97682008a759-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:34:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "63418518-22e7-400e-9588-97682008a759-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:34:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "63418518-22e7-400e-9588-97682008a759-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:34:57 user nova-compute[72766]: INFO nova.compute.manager [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 63418518-22e7-400e-9588-97682008a759] Terminating instance
Aug 14 23:34:57 user nova-compute[72766]: DEBUG nova.compute.manager [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 63418518-22e7-400e-9588-97682008a759] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:34:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:34:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG nova.network.neutron [req-b0af951a-d965-4c63-8cd9-e8b752a28b0c req-c213774e-93eb-4b70-81d0-26009e65617b service nova] [instance: 63418518-22e7-400e-9588-97682008a759] Updated VIF entry in instance network info cache for port 0a42bd31-a608-4555-9822-b5529d2912ad. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG nova.network.neutron [req-b0af951a-d965-4c63-8cd9-e8b752a28b0c req-c213774e-93eb-4b70-81d0-26009e65617b service nova] [instance: 63418518-22e7-400e-9588-97682008a759] Updating instance_info_cache with network_info: [{"id": "0a42bd31-a608-4555-9822-b5529d2912ad", "address": "fa:16:3e:d8:88:75", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a42bd31-a6", "ovs_interfaceid": "0a42bd31-a608-4555-9822-b5529d2912ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-b0af951a-d965-4c63-8cd9-e8b752a28b0c req-c213774e-93eb-4b70-81d0-26009e65617b service nova] Releasing lock "refresh_cache-63418518-22e7-400e-9588-97682008a759" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:34:58 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 63418518-22e7-400e-9588-97682008a759] Instance destroyed successfully.
Aug 14 23:34:58 user nova-compute[72766]: DEBUG nova.objects.instance [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lazy-loading 'resources' on Instance uuid 63418518-22e7-400e-9588-97682008a759 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:33:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1121239585',display_name='tempest-TestVolumeBootPattern-server-1121239585',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1121239585',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPvSbILRfrlJBoXiI6yAoEx23QxBOaut7EAv1f2wh2U36gaT4scPzMrBzJaFGwi3LSF0CotAN19+FTvGG2504Ya9pzKNYbrJtakJiRU4EWISkkDaslgouPorjyQ0mmkoOQ==',key_name='tempest-TestVolumeBootPattern-925108064',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:33:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3c9f53727cc497c94516ff7fa1bbf4f',ramdisk_id='',reservation_id='r-0n1rskvk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-213280496',owner_user_name='tempest-TestVolumeBootPattern-213280496-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:33:20Z,user_data=None,user_id='999390ac8e6240199c9a7484e234f3a7',uuid=63418518-22e7-400e-9588-97682008a759,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a42bd31-a608-4555-9822-b5529d2912ad", "address": "fa:16:3e:d8:88:75", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a42bd31-a6", "ovs_interfaceid": "0a42bd31-a608-4555-9822-b5529d2912ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Converting VIF {"id": "0a42bd31-a608-4555-9822-b5529d2912ad", "address": "fa:16:3e:d8:88:75", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a42bd31-a6", "ovs_interfaceid": "0a42bd31-a608-4555-9822-b5529d2912ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:88:75,bridge_name='br-int',has_traffic_filtering=True,id=0a42bd31-a608-4555-9822-b5529d2912ad,network=Network(f418a384-bbac-4892-8e0f-c7af2e9464ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a42bd31-a6') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG os_vif [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:88:75,bridge_name='br-int',has_traffic_filtering=True,id=0a42bd31-a608-4555-9822-b5529d2912ad,network=Network(f418a384-bbac-4892-8e0f-c7af2e9464ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a42bd31-a6') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a42bd31-a6, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:34:58 user nova-compute[72766]: INFO os_vif [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:88:75,bridge_name='br-int',has_traffic_filtering=True,id=0a42bd31-a608-4555-9822-b5529d2912ad,network=Network(f418a384-bbac-4892-8e0f-c7af2e9464ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a42bd31-a6')
Aug 14 23:34:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 63418518-22e7-400e-9588-97682008a759] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jZpLbwoF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:34:58 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:34:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[46fdb5a3-ec2d-4e84-a209-bd1c37580c94]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[745111af-2bb5-4f7b-a454-bdda3d44a9d9]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 (non-flash)
Aug 14 23:34:58 user nova-compute[72766]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 (non-flash)
Aug 14 23:34:58 user nova-compute[72766]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2 (non-flash)
Aug 14 23:34:58 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 (non-flash)
Aug 14 23:34:58 user nova-compute[72766]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 (non-flash)
Aug 14 23:34:58 user nova-compute[72766]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2 (non-flash)
Aug 14 23:34:58 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff154341090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2'): ({'sdc'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Removing single pathed devices sdc {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1c0c10-475a-4691-b75b-77bbed3ddd90]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee8af9b-1862-4f9c-8141-90138525067f]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Flushing IO for device /dev/sdc {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a5a1da-81e4-4a31-8a3d-04a82ec724ff]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[985903f2-bf06-482f-ba9b-5b75288ba0d5]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] SCSI volumes sdc have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_d79c105d', '/dev/disk/by-id/scsi-1SCST_BIOd79c105d-585465468de462bf', '/dev/disk/by-id/scsi-23538353436353436') {{(pid=83651) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2911ac78-a43a-47c3-a1b4-e46786ad2d6d]: (4, None) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74c88ed-5c00-4b1e-a88a-2d9d251a4def]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2 -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c1f9e5-688b-4d5d-837d-bf29b8c39b49]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2, portal: 172.16.0.220,3260]
Aug 14 23:34:58 user nova-compute[72766]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2, portal: 172.16.0.220,3260] successful.
Aug 14 23:34:58 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2 -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bff7062a-71b2-4ea9-9960-032659ad0ea2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c0def7-332f-4041-a319-e148b7d49a14]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] <== disconnect_volume: return (277ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 63418518-22e7-400e-9588-97682008a759] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:34:58 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 63418518-22e7-400e-9588-97682008a759] Deleting instance files /opt/stack/data/nova/instances/63418518-22e7-400e-9588-97682008a759_del
Aug 14 23:34:58 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 63418518-22e7-400e-9588-97682008a759] Deletion of /opt/stack/data/nova/instances/63418518-22e7-400e-9588-97682008a759_del complete
Aug 14 23:34:58 user nova-compute[72766]: DEBUG nova.compute.manager [req-d5e59468-3b7c-46d7-873e-e7319afcb5d6 req-17398854-ff34-4edd-9b03-ed6b4bae4538 service nova] [instance: 63418518-22e7-400e-9588-97682008a759] Received event network-vif-unplugged-0a42bd31-a608-4555-9822-b5529d2912ad {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d5e59468-3b7c-46d7-873e-e7319afcb5d6 req-17398854-ff34-4edd-9b03-ed6b4bae4538 service nova] Acquiring lock "63418518-22e7-400e-9588-97682008a759-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d5e59468-3b7c-46d7-873e-e7319afcb5d6 req-17398854-ff34-4edd-9b03-ed6b4bae4538 service nova] Lock "63418518-22e7-400e-9588-97682008a759-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d5e59468-3b7c-46d7-873e-e7319afcb5d6 req-17398854-ff34-4edd-9b03-ed6b4bae4538 service nova] Lock "63418518-22e7-400e-9588-97682008a759-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG nova.compute.manager [req-d5e59468-3b7c-46d7-873e-e7319afcb5d6 req-17398854-ff34-4edd-9b03-ed6b4bae4538 service nova] [instance: 63418518-22e7-400e-9588-97682008a759] No waiting events found dispatching network-vif-unplugged-0a42bd31-a608-4555-9822-b5529d2912ad {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG nova.compute.manager [req-d5e59468-3b7c-46d7-873e-e7319afcb5d6 req-17398854-ff34-4edd-9b03-ed6b4bae4538 service nova] [instance: 63418518-22e7-400e-9588-97682008a759] Received event network-vif-unplugged-0a42bd31-a608-4555-9822-b5529d2912ad for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG nova.compute.manager [req-d5e59468-3b7c-46d7-873e-e7319afcb5d6 req-17398854-ff34-4edd-9b03-ed6b4bae4538 service nova] [instance: 63418518-22e7-400e-9588-97682008a759] Received event network-vif-plugged-0a42bd31-a608-4555-9822-b5529d2912ad {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d5e59468-3b7c-46d7-873e-e7319afcb5d6 req-17398854-ff34-4edd-9b03-ed6b4bae4538 service nova] Acquiring lock "63418518-22e7-400e-9588-97682008a759-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d5e59468-3b7c-46d7-873e-e7319afcb5d6 req-17398854-ff34-4edd-9b03-ed6b4bae4538 service nova] Lock "63418518-22e7-400e-9588-97682008a759-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d5e59468-3b7c-46d7-873e-e7319afcb5d6 req-17398854-ff34-4edd-9b03-ed6b4bae4538 service nova] Lock "63418518-22e7-400e-9588-97682008a759-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG nova.compute.manager [req-d5e59468-3b7c-46d7-873e-e7319afcb5d6 req-17398854-ff34-4edd-9b03-ed6b4bae4538 service nova] [instance: 63418518-22e7-400e-9588-97682008a759] No waiting events found dispatching network-vif-plugged-0a42bd31-a608-4555-9822-b5529d2912ad {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:34:58 user nova-compute[72766]: WARNING nova.compute.manager [req-d5e59468-3b7c-46d7-873e-e7319afcb5d6 req-17398854-ff34-4edd-9b03-ed6b4bae4538 service nova] [instance: 63418518-22e7-400e-9588-97682008a759] Received unexpected event network-vif-plugged-0a42bd31-a608-4555-9822-b5529d2912ad for instance with vm_state active and task_state deleting.
Aug 14 23:34:58 user nova-compute[72766]: INFO nova.compute.manager [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 63418518-22e7-400e-9588-97682008a759] Took 1.12 seconds to destroy the instance on the hypervisor.
Aug 14 23:34:58 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: 63418518-22e7-400e-9588-97682008a759] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:34:58 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 63418518-22e7-400e-9588-97682008a759] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:34:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-40955194-f87a-480d-b97c-6c7f58e51e99 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Acquiring lock "7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:34:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-40955194-f87a-480d-b97c-6c7f58e51e99 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Lock "7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:34:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-40955194-f87a-480d-b97c-6c7f58e51e99 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Acquiring lock "7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:34:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-40955194-f87a-480d-b97c-6c7f58e51e99 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Lock "7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:34:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-40955194-f87a-480d-b97c-6c7f58e51e99 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Lock "7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:34:59 user nova-compute[72766]: INFO nova.compute.manager [None req-40955194-f87a-480d-b97c-6c7f58e51e99 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Terminating instance
Aug 14 23:34:59 user nova-compute[72766]: DEBUG nova.compute.manager [None req-40955194-f87a-480d-b97c-6c7f58e51e99 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:34:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:34:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:34:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:34:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:34:59 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 63418518-22e7-400e-9588-97682008a759] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:34:59 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 63418518-22e7-400e-9588-97682008a759] Took 0.55 seconds to deallocate network for instance.
Aug 14 23:34:59 user nova-compute[72766]: DEBUG nova.compute.manager [req-0bb77b88-358e-4bbd-bfe5-45e20c6943ec req-389258fe-07cf-4f3e-96b2-ac36e1ae6a41 service nova] [instance: 63418518-22e7-400e-9588-97682008a759] Received event network-vif-deleted-0a42bd31-a608-4555-9822-b5529d2912ad {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:34:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:34:59 user nova-compute[72766]: DEBUG nova.compute.manager [req-5fb05927-77e0-4c20-b6e8-00da32fd48fc req-539a6dae-b24e-4f9d-a4d3-b762e5956f2a service nova] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Received event network-vif-unplugged-4ea9efeb-8a89-4ec0-9e64-7e0666be32f0 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:34:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-5fb05927-77e0-4c20-b6e8-00da32fd48fc req-539a6dae-b24e-4f9d-a4d3-b762e5956f2a service nova] Acquiring lock "7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:34:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-5fb05927-77e0-4c20-b6e8-00da32fd48fc req-539a6dae-b24e-4f9d-a4d3-b762e5956f2a service nova] Lock "7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:34:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-5fb05927-77e0-4c20-b6e8-00da32fd48fc req-539a6dae-b24e-4f9d-a4d3-b762e5956f2a service nova] Lock "7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:34:59 user nova-compute[72766]: DEBUG nova.compute.manager [req-5fb05927-77e0-4c20-b6e8-00da32fd48fc req-539a6dae-b24e-4f9d-a4d3-b762e5956f2a service nova] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] No waiting events found dispatching network-vif-unplugged-4ea9efeb-8a89-4ec0-9e64-7e0666be32f0 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:34:59 user nova-compute[72766]: DEBUG nova.compute.manager [req-5fb05927-77e0-4c20-b6e8-00da32fd48fc req-539a6dae-b24e-4f9d-a4d3-b762e5956f2a service nova] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Received event network-vif-unplugged-4ea9efeb-8a89-4ec0-9e64-7e0666be32f0 for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:34:59 user nova-compute[72766]: DEBUG nova.compute.manager [req-5fb05927-77e0-4c20-b6e8-00da32fd48fc req-539a6dae-b24e-4f9d-a4d3-b762e5956f2a service nova] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Received event network-vif-plugged-4ea9efeb-8a89-4ec0-9e64-7e0666be32f0 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:34:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-5fb05927-77e0-4c20-b6e8-00da32fd48fc req-539a6dae-b24e-4f9d-a4d3-b762e5956f2a service nova] Acquiring lock "7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:34:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-5fb05927-77e0-4c20-b6e8-00da32fd48fc req-539a6dae-b24e-4f9d-a4d3-b762e5956f2a service nova] Lock "7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:34:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-5fb05927-77e0-4c20-b6e8-00da32fd48fc req-539a6dae-b24e-4f9d-a4d3-b762e5956f2a service nova] Lock "7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:34:59 user nova-compute[72766]: DEBUG nova.compute.manager [req-5fb05927-77e0-4c20-b6e8-00da32fd48fc req-539a6dae-b24e-4f9d-a4d3-b762e5956f2a service nova] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] No waiting events found dispatching network-vif-plugged-4ea9efeb-8a89-4ec0-9e64-7e0666be32f0 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:34:59 user nova-compute[72766]: WARNING nova.compute.manager [req-5fb05927-77e0-4c20-b6e8-00da32fd48fc req-539a6dae-b24e-4f9d-a4d3-b762e5956f2a service nova] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Received unexpected event network-vif-plugged-4ea9efeb-8a89-4ec0-9e64-7e0666be32f0 for instance with vm_state active and task_state deleting.
Aug 14 23:34:59 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Instance destroyed successfully.
Aug 14 23:34:59 user nova-compute[72766]: DEBUG nova.objects.instance [None req-40955194-f87a-480d-b97c-6c7f58e51e99 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Lazy-loading 'resources' on Instance uuid 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:34:59 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-40955194-f87a-480d-b97c-6c7f58e51e99 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:33:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-131801574',display_name='tempest-VolumesNegativeTest-instance-131801574',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-131801574',id=47,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:33:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d4015e97a3244b08fa5ab8ba0980983',ramdisk_id='',reservation_id='r-8cdg9909',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-736483761',owner_user_name='tempest-VolumesNegativeTest-736483761-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:33:16Z,user_data=None,user_id='bdc71e65fbee4548b9a4960af0c0e95d',uuid=7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ea9efeb-8a89-4ec0-9e64-7e0666be32f0", "address": "fa:16:3e:ee:b9:52", "network": {"id": "c086991d-4ab2-4f7d-a9b5-056742d31d53", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "de1de6bb5c864b4182031c597206cc71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea9efeb-8a", "ovs_interfaceid": "4ea9efeb-8a89-4ec0-9e64-7e0666be32f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:34:59 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-40955194-f87a-480d-b97c-6c7f58e51e99 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Converting VIF {"id": "4ea9efeb-8a89-4ec0-9e64-7e0666be32f0", "address": "fa:16:3e:ee:b9:52", "network": {"id": "c086991d-4ab2-4f7d-a9b5-056742d31d53", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "de1de6bb5c864b4182031c597206cc71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ea9efeb-8a", "ovs_interfaceid": "4ea9efeb-8a89-4ec0-9e64-7e0666be32f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:34:59 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-40955194-f87a-480d-b97c-6c7f58e51e99 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:b9:52,bridge_name='br-int',has_traffic_filtering=True,id=4ea9efeb-8a89-4ec0-9e64-7e0666be32f0,network=Network(c086991d-4ab2-4f7d-a9b5-056742d31d53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ea9efeb-8a') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:34:59 user nova-compute[72766]: DEBUG os_vif [None req-40955194-f87a-480d-b97c-6c7f58e51e99 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:b9:52,bridge_name='br-int',has_traffic_filtering=True,id=4ea9efeb-8a89-4ec0-9e64-7e0666be32f0,network=Network(c086991d-4ab2-4f7d-a9b5-056742d31d53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ea9efeb-8a') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:34:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:34:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ea9efeb-8a, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:34:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:34:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:34:59 user nova-compute[72766]: INFO os_vif [None req-40955194-f87a-480d-b97c-6c7f58e51e99 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:b9:52,bridge_name='br-int',has_traffic_filtering=True,id=4ea9efeb-8a89-4ec0-9e64-7e0666be32f0,network=Network(c086991d-4ab2-4f7d-a9b5-056742d31d53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ea9efeb-8a')
Aug 14 23:34:59 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-40955194-f87a-480d-b97c-6c7f58e51e99 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Deleting instance files /opt/stack/data/nova/instances/7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79_del
Aug 14 23:34:59 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-40955194-f87a-480d-b97c-6c7f58e51e99 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Deletion of /opt/stack/data/nova/instances/7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79_del complete
Aug 14 23:34:59 user nova-compute[72766]: INFO nova.compute.manager [None req-40955194-f87a-480d-b97c-6c7f58e51e99 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 14 23:34:59 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-40955194-f87a-480d-b97c-6c7f58e51e99 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:34:59 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:34:59 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:35:00 user nova-compute[72766]: INFO nova.compute.manager [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: 63418518-22e7-400e-9588-97682008a759] Took 0.79 seconds to detach 1 volumes for instance.
Aug 14 23:35:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:35:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:35:00 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:35:00 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:35:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.205s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:35:00 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Deleted allocations for instance 63418518-22e7-400e-9588-97682008a759
Aug 14 23:35:00 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:35:00 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Took 0.68 seconds to deallocate network for instance.
Aug 14 23:35:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-92334a6e-5a43-4313-9e4d-c5c7f5d8badd tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "63418518-22e7-400e-9588-97682008a759" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.848s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:35:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-40955194-f87a-480d-b97c-6c7f58e51e99 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:35:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-40955194-f87a-480d-b97c-6c7f58e51e99 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:35:00 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-40955194-f87a-480d-b97c-6c7f58e51e99 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:35:00 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-40955194-f87a-480d-b97c-6c7f58e51e99 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:35:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-40955194-f87a-480d-b97c-6c7f58e51e99 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.186s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:35:00 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-40955194-f87a-480d-b97c-6c7f58e51e99 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Deleted allocations for instance 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79
Aug 14 23:35:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-40955194-f87a-480d-b97c-6c7f58e51e99 tempest-VolumesNegativeTest-736483761 tempest-VolumesNegativeTest-736483761-project-member] Lock "7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.912s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:35:01 user nova-compute[72766]: DEBUG nova.compute.manager [req-4653c523-ba1e-47eb-8e6d-b087b164306a req-80e9848a-aaae-46bc-8067-5fdec1af2d37 service nova] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Received event network-vif-deleted-4ea9efeb-8a89-4ec0-9e64-7e0666be32f0 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:35:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:35:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:35:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:35:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:35:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:35:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:35:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:35:13 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692056098.5830986, 63418518-22e7-400e-9588-97682008a759 => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:35:13 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 63418518-22e7-400e-9588-97682008a759] VM Stopped (Lifecycle Event)
Aug 14 23:35:13 user nova-compute[72766]: DEBUG nova.compute.manager [None req-a8f5bd33-fe95-44a6-a413-20d1594d4d19 None None] [instance: 63418518-22e7-400e-9588-97682008a759] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:35:14 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692056099.8456397, 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79 => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:35:14 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] VM Stopped (Lifecycle Event)
Aug 14 23:35:14 user nova-compute[72766]: DEBUG nova.compute.manager [None req-ec2f31b4-5792-4f50-b91b-8be0f983cbc6 None None] [instance: 7ea46e37-e6f6-47d3-b9a4-c94aaa3d8b79] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:35:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:35:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:35:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:35:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:35:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:35:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:35:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:35:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:35:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:35:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:35:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:35:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:35:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:35:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:35:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:35:39 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:35:42 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:35:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:35:48 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:35:48 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:35:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-c5fe05bb-7204-47df-b033-a7462a21166c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:35:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-c5fe05bb-7204-47df-b033-a7462a21166c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:35:48 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:35:49 user nova-compute[72766]: INFO nova.compute.manager [None req-008a04de-7f20-4904-94b6-bd45d736085b tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Get console output
Aug 14 23:35:49 user nova-compute[72766]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 14 23:35:49 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Updating instance_info_cache with network_info: [{"id": "6346774b-2177-4e22-a7b2-faa064005d64", "address": "fa:16:3e:28:1f:4d", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6346774b-21", "ovs_interfaceid": "6346774b-2177-4e22-a7b2-faa064005d64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:35:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-c5fe05bb-7204-47df-b033-a7462a21166c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:35:49 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:35:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:35:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:35:50 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:35:50 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:35:51 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:35:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:35:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:35:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:35:51 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:35:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:35:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:35:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:35:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:35:52 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:35:52 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:35:52 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:35:52 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:35:52 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=8488MB free_disk=25.28921127319336GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:35:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:35:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:35:52 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance cbcf7851-e6f7-4f46-97cc-d773286ccddf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:35:52 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance c5fe05bb-7204-47df-b033-a7462a21166c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:35:52 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 211043bf-dcc9-44af-834c-75cd7be859ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:35:52 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:35:52 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:35:52 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:35:52 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:35:52 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:35:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.285s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:35:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:35:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:35:54 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:35:55 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:35:57 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:35:58 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:35:58 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:35:58 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:35:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:36:00 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:36:01 user nova-compute[72766]: DEBUG nova.compute.manager [req-775d82ea-9491-42cb-9179-833dbc20ca5f req-a2732289-c574-4156-9072-944b8b3931b5 service nova] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Received event network-changed-6346774b-2177-4e22-a7b2-faa064005d64 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:36:01 user nova-compute[72766]: DEBUG nova.compute.manager [req-775d82ea-9491-42cb-9179-833dbc20ca5f req-a2732289-c574-4156-9072-944b8b3931b5 service nova] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Refreshing instance network info cache due to event network-changed-6346774b-2177-4e22-a7b2-faa064005d64. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:36:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-775d82ea-9491-42cb-9179-833dbc20ca5f req-a2732289-c574-4156-9072-944b8b3931b5 service nova] Acquiring lock "refresh_cache-c5fe05bb-7204-47df-b033-a7462a21166c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:36:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-775d82ea-9491-42cb-9179-833dbc20ca5f req-a2732289-c574-4156-9072-944b8b3931b5 service nova] Acquired lock "refresh_cache-c5fe05bb-7204-47df-b033-a7462a21166c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:36:01 user nova-compute[72766]: DEBUG nova.network.neutron [req-775d82ea-9491-42cb-9179-833dbc20ca5f req-a2732289-c574-4156-9072-944b8b3931b5 service nova] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Refreshing network info cache for port 6346774b-2177-4e22-a7b2-faa064005d64 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:36:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "c5fe05bb-7204-47df-b033-a7462a21166c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:36:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "c5fe05bb-7204-47df-b033-a7462a21166c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:36:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "c5fe05bb-7204-47df-b033-a7462a21166c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:36:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "c5fe05bb-7204-47df-b033-a7462a21166c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:36:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "c5fe05bb-7204-47df-b033-a7462a21166c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:36:01 user nova-compute[72766]: INFO nova.compute.manager [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Terminating instance
Aug 14 23:36:01 user nova-compute[72766]: DEBUG nova.compute.manager [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:36:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:36:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:36:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:36:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:36:01 user nova-compute[72766]: DEBUG nova.compute.manager [req-d4756d48-f889-451d-875f-144e46ad13eb req-b22508ac-1140-4a83-a8b5-700451d6c255 service nova] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Received event network-vif-unplugged-6346774b-2177-4e22-a7b2-faa064005d64 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:36:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d4756d48-f889-451d-875f-144e46ad13eb req-b22508ac-1140-4a83-a8b5-700451d6c255 service nova] Acquiring lock "c5fe05bb-7204-47df-b033-a7462a21166c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:36:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d4756d48-f889-451d-875f-144e46ad13eb req-b22508ac-1140-4a83-a8b5-700451d6c255 service nova] Lock "c5fe05bb-7204-47df-b033-a7462a21166c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:36:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-d4756d48-f889-451d-875f-144e46ad13eb req-b22508ac-1140-4a83-a8b5-700451d6c255 service nova] Lock "c5fe05bb-7204-47df-b033-a7462a21166c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:36:01 user nova-compute[72766]: DEBUG nova.compute.manager [req-d4756d48-f889-451d-875f-144e46ad13eb req-b22508ac-1140-4a83-a8b5-700451d6c255 service nova] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] No waiting events found dispatching network-vif-unplugged-6346774b-2177-4e22-a7b2-faa064005d64 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:36:01 user nova-compute[72766]: DEBUG nova.compute.manager [req-d4756d48-f889-451d-875f-144e46ad13eb req-b22508ac-1140-4a83-a8b5-700451d6c255 service nova] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Received event network-vif-unplugged-6346774b-2177-4e22-a7b2-faa064005d64 for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:36:01 user nova-compute[72766]: DEBUG nova.network.neutron [req-775d82ea-9491-42cb-9179-833dbc20ca5f req-a2732289-c574-4156-9072-944b8b3931b5 service nova] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Updated VIF entry in instance network info cache for port 6346774b-2177-4e22-a7b2-faa064005d64. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:36:01 user nova-compute[72766]: DEBUG nova.network.neutron [req-775d82ea-9491-42cb-9179-833dbc20ca5f req-a2732289-c574-4156-9072-944b8b3931b5 service nova] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Updating instance_info_cache with network_info: [{"id": "6346774b-2177-4e22-a7b2-faa064005d64", "address": "fa:16:3e:28:1f:4d", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6346774b-21", "ovs_interfaceid": "6346774b-2177-4e22-a7b2-faa064005d64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:36:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-775d82ea-9491-42cb-9179-833dbc20ca5f req-a2732289-c574-4156-9072-944b8b3931b5 service nova] Releasing lock "refresh_cache-c5fe05bb-7204-47df-b033-a7462a21166c" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:36:01 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Instance destroyed successfully.
Aug 14 23:36:01 user nova-compute[72766]: DEBUG nova.objects.instance [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lazy-loading 'resources' on Instance uuid c5fe05bb-7204-47df-b033-a7462a21166c {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:36:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:30:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1198610515',display_name='tempest-TestVolumeBootPattern-server-1198610515',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1198610515',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPvSbILRfrlJBoXiI6yAoEx23QxBOaut7EAv1f2wh2U36gaT4scPzMrBzJaFGwi3LSF0CotAN19+FTvGG2504Ya9pzKNYbrJtakJiRU4EWISkkDaslgouPorjyQ0mmkoOQ==',key_name='tempest-TestVolumeBootPattern-925108064',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:31:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3c9f53727cc497c94516ff7fa1bbf4f',ramdisk_id='',reservation_id='r-f21rltkv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-213280496',owner_user_name='tempest-TestVolumeBootPattern-213280496-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:31:15Z,user_data=None,user_id='999390ac8e6240199c9a7484e234f3a7',uuid=c5fe05bb-7204-47df-b033-a7462a21166c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6346774b-2177-4e22-a7b2-faa064005d64", "address": "fa:16:3e:28:1f:4d", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6346774b-21", "ovs_interfaceid": "6346774b-2177-4e22-a7b2-faa064005d64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:36:01 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Converting VIF {"id": "6346774b-2177-4e22-a7b2-faa064005d64", "address": "fa:16:3e:28:1f:4d", "network": {"id": "f418a384-bbac-4892-8e0f-c7af2e9464ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1314437625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c9f53727cc497c94516ff7fa1bbf4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6346774b-21", "ovs_interfaceid": "6346774b-2177-4e22-a7b2-faa064005d64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:36:01 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:1f:4d,bridge_name='br-int',has_traffic_filtering=True,id=6346774b-2177-4e22-a7b2-faa064005d64,network=Network(f418a384-bbac-4892-8e0f-c7af2e9464ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6346774b-21') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:36:01 user nova-compute[72766]: DEBUG os_vif [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:1f:4d,bridge_name='br-int',has_traffic_filtering=True,id=6346774b-2177-4e22-a7b2-faa064005d64,network=Network(f418a384-bbac-4892-8e0f-c7af2e9464ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6346774b-21') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:36:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:36:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6346774b-21, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:36:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:36:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:36:01 user nova-compute[72766]: INFO os_vif [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:1f:4d,bridge_name='br-int',has_traffic_filtering=True,id=6346774b-2177-4e22-a7b2-faa064005d64,network=Network(f418a384-bbac-4892-8e0f-c7af2e9464ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6346774b-21')
Aug 14 23:36:01 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:36:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'muFVWivH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:36:01 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:36:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:36:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:36:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:36:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:36:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:36:01 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[78aae845-91a6-4ae1-9757-edf79a4e3f53]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:36:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:36:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:36:01 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dce289f-8f95-4000-8195-40c1223b7b7d]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:36:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 (non-flash)
Aug 14 23:36:01 user nova-compute[72766]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 (non-flash)
Aug 14 23:36:01 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:36:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 (non-flash)
Aug 14 23:36:01 user nova-compute[72766]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 (non-flash)
Aug 14 23:36:01 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:36:01 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff16c366290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1'): ({'sdd'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:36:01 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Removing single pathed devices sdd {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:36:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:36:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:36:02 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae75d64-ae90-4115-9f97-fadae078a265]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:36:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:36:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:36:02 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb16683a-1f83-4100-b14f-220589dada5f]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:36:02 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Flushing IO for device /dev/sdd {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:36:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:36:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:36:02 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f98a4b-2665-444f-8098-abdf2dee388e]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:36:02 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:36:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:36:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:36:02 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[415eb091-c8f3-46f2-90a8-014a6de782cb]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:36:02 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:36:02 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] SCSI volumes sdd have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:36:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:36:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:36:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:36:02 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[46df43aa-f54a-44fe-8040-eb98c9308f21]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:36:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:36:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:36:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:36:02 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a49556f-7440-4119-b88c-7c98b8648c8c]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:36:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1, portal: 172.16.0.220,3260]
Aug 14 23:36:02 user nova-compute[72766]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1, portal: 172.16.0.220,3260] successful.
Aug 14 23:36:02 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:36:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:36:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52e4fc71-e83e-49b1-b48b-aad06097b1e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:36:02 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b27d10e-be96-4568-ae85-4b53de331d86]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:36:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:36:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:36:02 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] <== disconnect_volume: return (306ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:36:02 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:36:02 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Deleting instance files /opt/stack/data/nova/instances/c5fe05bb-7204-47df-b033-a7462a21166c_del
Aug 14 23:36:02 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Deletion of /opt/stack/data/nova/instances/c5fe05bb-7204-47df-b033-a7462a21166c_del complete
Aug 14 23:36:02 user nova-compute[72766]: INFO nova.compute.manager [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Took 1.20 seconds to destroy the instance on the hypervisor.
Aug 14 23:36:02 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:36:02 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:36:02 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:36:02 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:36:02 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Took 0.55 seconds to deallocate network for instance.
Aug 14 23:36:03 user nova-compute[72766]: INFO nova.compute.manager [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Took 0.83 seconds to detach 1 volumes for instance.
Aug 14 23:36:03 user nova-compute[72766]: DEBUG nova.compute.manager [req-7a9bbb90-f46a-48f0-ae56-96d02748e10b req-9ba681c6-375f-443f-83bf-3bb96fb5ee3b service nova] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Received event network-vif-plugged-6346774b-2177-4e22-a7b2-faa064005d64 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:36:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7a9bbb90-f46a-48f0-ae56-96d02748e10b req-9ba681c6-375f-443f-83bf-3bb96fb5ee3b service nova] Acquiring lock "c5fe05bb-7204-47df-b033-a7462a21166c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:36:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7a9bbb90-f46a-48f0-ae56-96d02748e10b req-9ba681c6-375f-443f-83bf-3bb96fb5ee3b service nova] Lock "c5fe05bb-7204-47df-b033-a7462a21166c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:36:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7a9bbb90-f46a-48f0-ae56-96d02748e10b req-9ba681c6-375f-443f-83bf-3bb96fb5ee3b service nova] Lock "c5fe05bb-7204-47df-b033-a7462a21166c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:36:03 user nova-compute[72766]: DEBUG nova.compute.manager [req-7a9bbb90-f46a-48f0-ae56-96d02748e10b req-9ba681c6-375f-443f-83bf-3bb96fb5ee3b service nova] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] No waiting events found dispatching network-vif-plugged-6346774b-2177-4e22-a7b2-faa064005d64 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:36:03 user nova-compute[72766]: WARNING nova.compute.manager [req-7a9bbb90-f46a-48f0-ae56-96d02748e10b req-9ba681c6-375f-443f-83bf-3bb96fb5ee3b service nova] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Received unexpected event network-vif-plugged-6346774b-2177-4e22-a7b2-faa064005d64 for instance with vm_state active and task_state deleting.
Aug 14 23:36:03 user nova-compute[72766]: DEBUG nova.compute.manager [req-7a9bbb90-f46a-48f0-ae56-96d02748e10b req-9ba681c6-375f-443f-83bf-3bb96fb5ee3b service nova] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Received event network-vif-deleted-6346774b-2177-4e22-a7b2-faa064005d64 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:36:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:36:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:36:03 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:36:03 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:36:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.184s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:36:04 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Deleted allocations for instance c5fe05bb-7204-47df-b033-a7462a21166c
Aug 14 23:36:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ccc48e00-9ceb-4dac-a87e-b1dd871c761a tempest-TestVolumeBootPattern-213280496 tempest-TestVolumeBootPattern-213280496-project-member] Lock "c5fe05bb-7204-47df-b033-a7462a21166c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.973s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:36:06 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:36:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:36:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:36:10 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:36:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:36:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:36:16 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692056161.8891797, c5fe05bb-7204-47df-b033-a7462a21166c => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:36:16 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] VM Stopped (Lifecycle Event)
Aug 14 23:36:16 user nova-compute[72766]: DEBUG nova.compute.manager [None req-cda7d785-13ff-4b81-98c3-5b3033d838ab None None] [instance: c5fe05bb-7204-47df-b033-a7462a21166c] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:36:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:36:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:36:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Acquiring lock "fe0dad81-3f3a-4548-a267-1ba13cd65dff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:36:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "fe0dad81-3f3a-4548-a267-1ba13cd65dff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:36:24 user nova-compute[72766]: DEBUG nova.compute.manager [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 23:36:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:36:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:36:24 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 23:36:24 user nova-compute[72766]: INFO nova.compute.claims [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Claim successful on node user
Aug 14 23:36:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:36:24 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:36:24 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:36:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.235s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:36:24 user nova-compute[72766]: DEBUG nova.compute.manager [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 23:36:24 user nova-compute[72766]: DEBUG nova.compute.manager [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 23:36:24 user nova-compute[72766]: DEBUG nova.network.neutron [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 23:36:25 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 23:36:25 user nova-compute[72766]: DEBUG nova.compute.manager [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 23:36:25 user nova-compute[72766]: DEBUG nova.compute.manager [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 23:36:25 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 23:36:25 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Creating image(s)
Aug 14 23:36:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Acquiring lock "/opt/stack/data/nova/instances/fe0dad81-3f3a-4548-a267-1ba13cd65dff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:36:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "/opt/stack/data/nova/instances/fe0dad81-3f3a-4548-a267-1ba13cd65dff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:36:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "/opt/stack/data/nova/instances/fe0dad81-3f3a-4548-a267-1ba13cd65dff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:36:25 user nova-compute[72766]: DEBUG nova.policy [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dffd02cd8106437e8a9e4ab035bd4201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bfb5a00552451195ed2aa91d218c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 23:36:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:36:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.188s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:36:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Acquiring lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:36:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:36:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:36:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.181s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:36:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/fe0dad81-3f3a-4548-a267-1ba13cd65dff/disk 1073741824 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:36:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/fe0dad81-3f3a-4548-a267-1ba13cd65dff/disk 1073741824" returned: 0 in 0.052s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:36:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:36:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:36:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.183s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:36:25 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fe0dad81-3f3a-4548-a267-1ba13cd65dff/disk. size=1073741824 {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 23:36:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0dad81-3f3a-4548-a267-1ba13cd65dff/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:36:25 user nova-compute[72766]: DEBUG nova.network.neutron [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Successfully created port: cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 23:36:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0dad81-3f3a-4548-a267-1ba13cd65dff/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:36:25 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Cannot resize image /opt/stack/data/nova/instances/fe0dad81-3f3a-4548-a267-1ba13cd65dff/disk to a smaller size. {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 23:36:25 user nova-compute[72766]: DEBUG nova.objects.instance [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lazy-loading 'migration_context' on Instance uuid fe0dad81-3f3a-4548-a267-1ba13cd65dff {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:36:25 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 23:36:25 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Ensure instance console log exists: /opt/stack/data/nova/instances/fe0dad81-3f3a-4548-a267-1ba13cd65dff/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 23:36:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:36:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:36:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG nova.network.neutron [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Successfully updated port: cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Acquiring lock "refresh_cache-fe0dad81-3f3a-4548-a267-1ba13cd65dff" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Acquired lock "refresh_cache-fe0dad81-3f3a-4548-a267-1ba13cd65dff" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG nova.network.neutron [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG nova.compute.manager [req-19944de9-a781-4e90-937a-85e3f48bc9cb req-54dd17b3-9b73-43b6-ad42-fa5872ab5706 service nova] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Received event network-changed-cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG nova.compute.manager [req-19944de9-a781-4e90-937a-85e3f48bc9cb req-54dd17b3-9b73-43b6-ad42-fa5872ab5706 service nova] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Refreshing instance network info cache due to event network-changed-cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-19944de9-a781-4e90-937a-85e3f48bc9cb req-54dd17b3-9b73-43b6-ad42-fa5872ab5706 service nova] Acquiring lock "refresh_cache-fe0dad81-3f3a-4548-a267-1ba13cd65dff" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG nova.network.neutron [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG nova.network.neutron [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Updating instance_info_cache with network_info: [{"id": "cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a", "address": "fa:16:3e:80:76:8c", "network": {"id": "ac53cc42-a36b-4e59-a831-e240513cd6da", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-912624616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30bfb5a00552451195ed2aa91d218c8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf3a48f2-15", "ovs_interfaceid": "cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Releasing lock "refresh_cache-fe0dad81-3f3a-4548-a267-1ba13cd65dff" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG nova.compute.manager [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Instance network_info: |[{"id": "cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a", "address": "fa:16:3e:80:76:8c", "network": {"id": "ac53cc42-a36b-4e59-a831-e240513cd6da", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-912624616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30bfb5a00552451195ed2aa91d218c8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf3a48f2-15", "ovs_interfaceid": "cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-19944de9-a781-4e90-937a-85e3f48bc9cb req-54dd17b3-9b73-43b6-ad42-fa5872ab5706 service nova] Acquired lock "refresh_cache-fe0dad81-3f3a-4548-a267-1ba13cd65dff" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG nova.network.neutron [req-19944de9-a781-4e90-937a-85e3f48bc9cb req-54dd17b3-9b73-43b6-ad42-fa5872ab5706 service nova] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Refreshing network info cache for port cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Start _get_guest_xml network_info=[{"id": "cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a", "address": "fa:16:3e:80:76:8c", "network": {"id": "ac53cc42-a36b-4e59-a831-e240513cd6da", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-912624616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30bfb5a00552451195ed2aa91d218c8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf3a48f2-15", "ovs_interfaceid": "cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd2900d30-2c4c-4d57-9135-d45564c0c596'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:36:26 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:36:26 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:36:26 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:36:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2000256122',display_name='tempest-VolumesSnapshotTestJSON-instance-2000256122',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2000256122',id=48,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvzlCYfXAlqXGAaQK5MEVx23UbZS0McJw4PGZfmLOfuxG1lsznOSid32/TvP//0iq9feyQRlNaoiffQBc0/KiwNgh0u5QG0zyWo/WyYfTQ2uS2ORoCRD6mtV9n2yKFEuw==',key_name='tempest-keypair-652823648',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30bfb5a00552451195ed2aa91d218c8f',ramdisk_id='',reservation_id='r-jnlgee37',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1614321126',owner_user_name='tempest-VolumesSnapshotTestJSON-1614321126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:36:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dffd02cd8106437e8a9e4ab035bd4201',uuid=fe0dad81-3f3a-4548-a267-1ba13cd65dff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a", "address": "fa:16:3e:80:76:8c", "network": {"id": "ac53cc42-a36b-4e59-a831-e240513cd6da", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-912624616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30bfb5a00552451195ed2aa91d218c8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf3a48f2-15", "ovs_interfaceid": "cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Converting VIF {"id": "cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a", "address": "fa:16:3e:80:76:8c", "network": {"id": "ac53cc42-a36b-4e59-a831-e240513cd6da", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-912624616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30bfb5a00552451195ed2aa91d218c8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf3a48f2-15", "ovs_interfaceid": "cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:76:8c,bridge_name='br-int',has_traffic_filtering=True,id=cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a,network=Network(ac53cc42-a36b-4e59-a831-e240513cd6da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf3a48f2-15') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG nova.objects.instance [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lazy-loading 'pci_devices' on Instance uuid fe0dad81-3f3a-4548-a267-1ba13cd65dff {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:36:26 user nova-compute[72766]:   <uuid>fe0dad81-3f3a-4548-a267-1ba13cd65dff</uuid>
Aug 14 23:36:26 user nova-compute[72766]:   <name>instance-00000030</name>
Aug 14 23:36:26 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:36:26 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:36:26 user nova-compute[72766]:   <metadata>
Aug 14 23:36:26 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:36:26 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:36:26 user nova-compute[72766]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2000256122</nova:name>
Aug 14 23:36:26 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:36:26</nova:creationTime>
Aug 14 23:36:26 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:36:26 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:36:26 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:36:26 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:36:26 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:36:26 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:36:26 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:36:26 user nova-compute[72766]:       <nova:owner>
Aug 14 23:36:26 user nova-compute[72766]:         <nova:user uuid="dffd02cd8106437e8a9e4ab035bd4201">tempest-VolumesSnapshotTestJSON-1614321126-project-member</nova:user>
Aug 14 23:36:26 user nova-compute[72766]:         <nova:project uuid="30bfb5a00552451195ed2aa91d218c8f">tempest-VolumesSnapshotTestJSON-1614321126</nova:project>
Aug 14 23:36:26 user nova-compute[72766]:       </nova:owner>
Aug 14 23:36:26 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 23:36:26 user nova-compute[72766]:       <nova:ports>
Aug 14 23:36:26 user nova-compute[72766]:         <nova:port uuid="cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a">
Aug 14 23:36:26 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 14 23:36:26 user nova-compute[72766]:         </nova:port>
Aug 14 23:36:26 user nova-compute[72766]:       </nova:ports>
Aug 14 23:36:26 user nova-compute[72766]:     </nova:instance>
Aug 14 23:36:26 user nova-compute[72766]:   </metadata>
Aug 14 23:36:26 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:36:26 user nova-compute[72766]:     <system>
Aug 14 23:36:26 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:36:26 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:36:26 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:36:26 user nova-compute[72766]:       <entry name="serial">fe0dad81-3f3a-4548-a267-1ba13cd65dff</entry>
Aug 14 23:36:26 user nova-compute[72766]:       <entry name="uuid">fe0dad81-3f3a-4548-a267-1ba13cd65dff</entry>
Aug 14 23:36:26 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:36:26 user nova-compute[72766]:     </system>
Aug 14 23:36:26 user nova-compute[72766]:   </sysinfo>
Aug 14 23:36:26 user nova-compute[72766]:   <os>
Aug 14 23:36:26 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:36:26 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:36:26 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:36:26 user nova-compute[72766]:   </os>
Aug 14 23:36:26 user nova-compute[72766]:   <features>
Aug 14 23:36:26 user nova-compute[72766]:     <acpi/>
Aug 14 23:36:26 user nova-compute[72766]:     <apic/>
Aug 14 23:36:26 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:36:26 user nova-compute[72766]:   </features>
Aug 14 23:36:26 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:36:26 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:36:26 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:36:26 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:36:26 user nova-compute[72766]:   </clock>
Aug 14 23:36:26 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:36:26 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:36:26 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:36:26 user nova-compute[72766]:   </cpu>
Aug 14 23:36:26 user nova-compute[72766]:   <devices>
Aug 14 23:36:26 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 23:36:26 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 23:36:26 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/fe0dad81-3f3a-4548-a267-1ba13cd65dff/disk"/>
Aug 14 23:36:26 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:36:26 user nova-compute[72766]:     </disk>
Aug 14 23:36:26 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:36:26 user nova-compute[72766]:       <mac address="fa:16:3e:80:76:8c"/>
Aug 14 23:36:26 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:36:26 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:36:26 user nova-compute[72766]:       <target dev="tapcf3a48f2-15"/>
Aug 14 23:36:26 user nova-compute[72766]:     </interface>
Aug 14 23:36:26 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:36:26 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/fe0dad81-3f3a-4548-a267-1ba13cd65dff/console.log" append="off"/>
Aug 14 23:36:26 user nova-compute[72766]:     </serial>
Aug 14 23:36:26 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:36:26 user nova-compute[72766]:     <video>
Aug 14 23:36:26 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:36:26 user nova-compute[72766]:     </video>
Aug 14 23:36:26 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:36:26 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:36:26 user nova-compute[72766]:     </rng>
Aug 14 23:36:26 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:36:26 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:36:26 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:36:26 user nova-compute[72766]:     </memballoon>
Aug 14 23:36:26 user nova-compute[72766]:   </devices>
Aug 14 23:36:26 user nova-compute[72766]: </domain>
Aug 14 23:36:26 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:36:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2000256122',display_name='tempest-VolumesSnapshotTestJSON-instance-2000256122',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2000256122',id=48,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvzlCYfXAlqXGAaQK5MEVx23UbZS0McJw4PGZfmLOfuxG1lsznOSid32/TvP//0iq9feyQRlNaoiffQBc0/KiwNgh0u5QG0zyWo/WyYfTQ2uS2ORoCRD6mtV9n2yKFEuw==',key_name='tempest-keypair-652823648',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30bfb5a00552451195ed2aa91d218c8f',ramdisk_id='',reservation_id='r-jnlgee37',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1614321126',owner_user_name='tempest-VolumesSnapshotTestJSON-1614321126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:36:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dffd02cd8106437e8a9e4ab035bd4201',uuid=fe0dad81-3f3a-4548-a267-1ba13cd65dff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a", "address": "fa:16:3e:80:76:8c", "network": {"id": "ac53cc42-a36b-4e59-a831-e240513cd6da", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-912624616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30bfb5a00552451195ed2aa91d218c8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf3a48f2-15", "ovs_interfaceid": "cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Converting VIF {"id": "cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a", "address": "fa:16:3e:80:76:8c", "network": {"id": "ac53cc42-a36b-4e59-a831-e240513cd6da", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-912624616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30bfb5a00552451195ed2aa91d218c8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf3a48f2-15", "ovs_interfaceid": "cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:76:8c,bridge_name='br-int',has_traffic_filtering=True,id=cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a,network=Network(ac53cc42-a36b-4e59-a831-e240513cd6da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf3a48f2-15') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG os_vif [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:76:8c,bridge_name='br-int',has_traffic_filtering=True,id=cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a,network=Network(ac53cc42-a36b-4e59-a831-e240513cd6da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf3a48f2-15') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcf3a48f2-15, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcf3a48f2-15, col_values=(('external_ids', {'iface-id': 'cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:76:8c', 'vm-uuid': 'fe0dad81-3f3a-4548-a267-1ba13cd65dff'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:36:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:36:26 user nova-compute[72766]: INFO os_vif [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:76:8c,bridge_name='br-int',has_traffic_filtering=True,id=cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a,network=Network(ac53cc42-a36b-4e59-a831-e240513cd6da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf3a48f2-15')
Aug 14 23:36:27 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:36:27 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] No VIF found with MAC fa:16:3e:80:76:8c, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:36:27 user nova-compute[72766]: DEBUG nova.network.neutron [req-19944de9-a781-4e90-937a-85e3f48bc9cb req-54dd17b3-9b73-43b6-ad42-fa5872ab5706 service nova] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Updated VIF entry in instance network info cache for port cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:36:27 user nova-compute[72766]: DEBUG nova.network.neutron [req-19944de9-a781-4e90-937a-85e3f48bc9cb req-54dd17b3-9b73-43b6-ad42-fa5872ab5706 service nova] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Updating instance_info_cache with network_info: [{"id": "cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a", "address": "fa:16:3e:80:76:8c", "network": {"id": "ac53cc42-a36b-4e59-a831-e240513cd6da", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-912624616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30bfb5a00552451195ed2aa91d218c8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf3a48f2-15", "ovs_interfaceid": "cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:36:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-19944de9-a781-4e90-937a-85e3f48bc9cb req-54dd17b3-9b73-43b6-ad42-fa5872ab5706 service nova] Releasing lock "refresh_cache-fe0dad81-3f3a-4548-a267-1ba13cd65dff" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:36:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:36:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:36:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:36:28 user nova-compute[72766]: DEBUG nova.compute.manager [req-5daa7448-6e6c-41cc-87af-3880ea12631b req-2da3a1e2-389d-42e5-baef-383a3b70ad44 service nova] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Received event network-vif-plugged-cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:36:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-5daa7448-6e6c-41cc-87af-3880ea12631b req-2da3a1e2-389d-42e5-baef-383a3b70ad44 service nova] Acquiring lock "fe0dad81-3f3a-4548-a267-1ba13cd65dff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:36:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-5daa7448-6e6c-41cc-87af-3880ea12631b req-2da3a1e2-389d-42e5-baef-383a3b70ad44 service nova] Lock "fe0dad81-3f3a-4548-a267-1ba13cd65dff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:36:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-5daa7448-6e6c-41cc-87af-3880ea12631b req-2da3a1e2-389d-42e5-baef-383a3b70ad44 service nova] Lock "fe0dad81-3f3a-4548-a267-1ba13cd65dff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:36:28 user nova-compute[72766]: DEBUG nova.compute.manager [req-5daa7448-6e6c-41cc-87af-3880ea12631b req-2da3a1e2-389d-42e5-baef-383a3b70ad44 service nova] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] No waiting events found dispatching network-vif-plugged-cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:36:28 user nova-compute[72766]: WARNING nova.compute.manager [req-5daa7448-6e6c-41cc-87af-3880ea12631b req-2da3a1e2-389d-42e5-baef-383a3b70ad44 service nova] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Received unexpected event network-vif-plugged-cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a for instance with vm_state building and task_state spawning.
Aug 14 23:36:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:36:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:36:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:36:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:36:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:36:30 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692056190.4032516, fe0dad81-3f3a-4548-a267-1ba13cd65dff => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:36:30 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] VM Resumed (Lifecycle Event)
Aug 14 23:36:30 user nova-compute[72766]: DEBUG nova.compute.manager [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:36:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 23:36:30 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Instance spawned successfully.
Aug 14 23:36:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 23:36:30 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:36:30 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:36:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:36:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:36:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:36:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:36:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:36:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:36:30 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:36:30 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692056190.4046855, fe0dad81-3f3a-4548-a267-1ba13cd65dff => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:36:30 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] VM Started (Lifecycle Event)
Aug 14 23:36:30 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:36:30 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:36:30 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:36:30 user nova-compute[72766]: INFO nova.compute.manager [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Took 5.38 seconds to spawn the instance on the hypervisor.
Aug 14 23:36:30 user nova-compute[72766]: DEBUG nova.compute.manager [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:36:30 user nova-compute[72766]: INFO nova.compute.manager [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Took 5.92 seconds to build instance.
Aug 14 23:36:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-05d8517a-2cb9-41eb-8a85-12f0bbcb7ac3 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "fe0dad81-3f3a-4548-a267-1ba13cd65dff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.006s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:36:30 user nova-compute[72766]: DEBUG nova.compute.manager [req-bb278fef-355e-4b02-ad3f-018da4994020 req-6f7e043b-8b4b-43bc-86e1-aa927e5941b3 service nova] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Received event network-vif-plugged-cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:36:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-bb278fef-355e-4b02-ad3f-018da4994020 req-6f7e043b-8b4b-43bc-86e1-aa927e5941b3 service nova] Acquiring lock "fe0dad81-3f3a-4548-a267-1ba13cd65dff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:36:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-bb278fef-355e-4b02-ad3f-018da4994020 req-6f7e043b-8b4b-43bc-86e1-aa927e5941b3 service nova] Lock "fe0dad81-3f3a-4548-a267-1ba13cd65dff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:36:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-bb278fef-355e-4b02-ad3f-018da4994020 req-6f7e043b-8b4b-43bc-86e1-aa927e5941b3 service nova] Lock "fe0dad81-3f3a-4548-a267-1ba13cd65dff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:36:30 user nova-compute[72766]: DEBUG nova.compute.manager [req-bb278fef-355e-4b02-ad3f-018da4994020 req-6f7e043b-8b4b-43bc-86e1-aa927e5941b3 service nova] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] No waiting events found dispatching network-vif-plugged-cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:36:30 user nova-compute[72766]: WARNING nova.compute.manager [req-bb278fef-355e-4b02-ad3f-018da4994020 req-6f7e043b-8b4b-43bc-86e1-aa927e5941b3 service nova] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Received unexpected event network-vif-plugged-cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a for instance with vm_state active and task_state None.
Aug 14 23:36:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:36:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:36:36 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:36:39 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:36:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:36:44 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:36:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:36:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:36:49 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:36:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:36:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "211043bf-dcc9-44af-834c-75cd7be859ec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:36:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "211043bf-dcc9-44af-834c-75cd7be859ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:36:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "211043bf-dcc9-44af-834c-75cd7be859ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:36:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "211043bf-dcc9-44af-834c-75cd7be859ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:36:49 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "211043bf-dcc9-44af-834c-75cd7be859ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:36:49 user nova-compute[72766]: INFO nova.compute.manager [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Terminating instance
Aug 14 23:36:50 user nova-compute[72766]: DEBUG nova.compute.manager [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG nova.compute.manager [req-ace3500b-aaea-4878-8fb2-6e1e681770c8 req-ddfc5232-2087-4cc4-880c-5a647ad03735 service nova] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Received event network-vif-unplugged-3e62931c-4358-4153-8d5e-c4675640e3fa {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ace3500b-aaea-4878-8fb2-6e1e681770c8 req-ddfc5232-2087-4cc4-880c-5a647ad03735 service nova] Acquiring lock "211043bf-dcc9-44af-834c-75cd7be859ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ace3500b-aaea-4878-8fb2-6e1e681770c8 req-ddfc5232-2087-4cc4-880c-5a647ad03735 service nova] Lock "211043bf-dcc9-44af-834c-75cd7be859ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ace3500b-aaea-4878-8fb2-6e1e681770c8 req-ddfc5232-2087-4cc4-880c-5a647ad03735 service nova] Lock "211043bf-dcc9-44af-834c-75cd7be859ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG nova.compute.manager [req-ace3500b-aaea-4878-8fb2-6e1e681770c8 req-ddfc5232-2087-4cc4-880c-5a647ad03735 service nova] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] No waiting events found dispatching network-vif-unplugged-3e62931c-4358-4153-8d5e-c4675640e3fa {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG nova.compute.manager [req-ace3500b-aaea-4878-8fb2-6e1e681770c8 req-ddfc5232-2087-4cc4-880c-5a647ad03735 service nova] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Received event network-vif-unplugged-3e62931c-4358-4153-8d5e-c4675640e3fa for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Rebuilding the list of instances to heal {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Skipping network cache update for instance because it is being deleted. {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9859}}
Aug 14 23:36:50 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Instance destroyed successfully.
Aug 14 23:36:50 user nova-compute[72766]: DEBUG nova.objects.instance [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lazy-loading 'resources' on Instance uuid 211043bf-dcc9-44af-834c-75cd7be859ec {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:30:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1043518379',display_name='tempest-ServerActionsTestOtherA-server-1043518379',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1043518379',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDoXZolQqtFAUPpymn6Ku7JgXGw46vxp59imOajNHAEz0LQOA2HZ029jKc7yJ8uxT7IHJ390d7ScJ6pqdFfhcnBy/F6i10LDXWERfUkUg5mrEOI4hiQbJjkhq6PVnEbSQ==',key_name='tempest-keypair-1635999225',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:32:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b0d4f038dbd47b1aad9829f19cb4896',ramdisk_id='',reservation_id='r-ultip2q1',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-242565278',owner_user_name='tempest-ServerActionsTestOtherA-242565278-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:33:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11bf21631dd0447f8f1a3f2b012ec43a',uuid=211043bf-dcc9-44af-834c-75cd7be859ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e62931c-4358-4153-8d5e-c4675640e3fa", "address": "fa:16:3e:2b:91:b3", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e62931c-43", "ovs_interfaceid": "3e62931c-4358-4153-8d5e-c4675640e3fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Converting VIF {"id": "3e62931c-4358-4153-8d5e-c4675640e3fa", "address": "fa:16:3e:2b:91:b3", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e62931c-43", "ovs_interfaceid": "3e62931c-4358-4153-8d5e-c4675640e3fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:91:b3,bridge_name='br-int',has_traffic_filtering=True,id=3e62931c-4358-4153-8d5e-c4675640e3fa,network=Network(e0bbc182-f700-4a82-84ae-7cbcb2e517c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e62931c-43') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG os_vif [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:91:b3,bridge_name='br-int',has_traffic_filtering=True,id=3e62931c-4358-4153-8d5e-c4675640e3fa,network=Network(e0bbc182-f700-4a82-84ae-7cbcb2e517c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e62931c-43') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e62931c-43, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:36:50 user nova-compute[72766]: INFO os_vif [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:91:b3,bridge_name='br-int',has_traffic_filtering=True,id=3e62931c-4358-4153-8d5e-c4675640e3fa,network=Network(e0bbc182-f700-4a82-84ae-7cbcb2e517c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e62931c-43')
Aug 14 23:36:50 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FcvtBHop', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:36:50 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:36:50 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4438994-5295-4233-974e-295a38e81576]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-cbcf7851-e6f7-4f46-97cc-d773286ccddf" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-cbcf7851-e6f7-4f46-97cc-d773286ccddf" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG nova.objects.instance [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lazy-loading 'info_cache' on Instance uuid cbcf7851-e6f7-4f46-97cc-d773286ccddf {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[484b70a7-9b44-4cef-9701-d7a458f5ac4a]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 (non-flash)
Aug 14 23:36:50 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 (non-flash)
Aug 14 23:36:50 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff154343d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737'): ({'sdb'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Removing single pathed devices sdb {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[da11e83d-34eb-4ff8-aa8c-a55507eb1b6e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[565f174f-18aa-4fef-abc7-1e38e927f447]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Flushing IO for device /dev/sdb {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3a789b-6aae-4973-bbc1-081e92154380]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69e0e91-4a3f-44a0-b1fe-0d2deaee12d2]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] SCSI volumes sdb have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_53840b11', '/dev/disk/by-id/scsi-23238316530333662', '/dev/disk/by-id/scsi-1SCST_BIO53840b11-281e036b3e5c212f') {{(pid=83651) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e7611d-db01-4d97-9e39-9ddb0006dec8]: (4, None) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:36:50 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:36:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9da63d4-198d-47ab-b912-b07c6d97a40e]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:36:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:36:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:36:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:36:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cec250a-06d5-4c8a-8029-7097c3c9abd1]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:36:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737, portal: 172.16.0.220,3260]
Aug 14 23:36:51 user nova-compute[72766]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737, portal: 172.16.0.220,3260] successful.
Aug 14 23:36:51 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:36:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:36:51 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:36:51 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b60bf4b-c439-415f-945d-d3a1737bcacc]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:36:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:36:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:36:51 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] <== disconnect_volume: return (287ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:36:51 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:36:51 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Deleting instance files /opt/stack/data/nova/instances/211043bf-dcc9-44af-834c-75cd7be859ec_del
Aug 14 23:36:51 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Deletion of /opt/stack/data/nova/instances/211043bf-dcc9-44af-834c-75cd7be859ec_del complete
Aug 14 23:36:51 user nova-compute[72766]: INFO nova.compute.manager [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 14 23:36:51 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:36:51 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:36:51 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:36:51 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Updating instance_info_cache with network_info: [{"id": "8f65f8f0-60fe-4fdb-af66-424a85b12caf", "address": "fa:16:3e:70:30:66", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f65f8f0-60", "ovs_interfaceid": "8f65f8f0-60fe-4fdb-af66-424a85b12caf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:36:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-cbcf7851-e6f7-4f46-97cc-d773286ccddf" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:36:51 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:36:51 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:36:51 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:36:51 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Took 0.83 seconds to deallocate network for instance.
Aug 14 23:36:51 user nova-compute[72766]: DEBUG nova.compute.manager [req-f4375b74-a023-43a0-ab66-c1a67d063821 req-4d5e50e6-62f6-4128-94a0-58850d9c8d9f service nova] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Received event network-vif-deleted-3e62931c-4358-4153-8d5e-c4675640e3fa {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:36:52 user nova-compute[72766]: DEBUG nova.compute.manager [req-22e87738-b8e9-4007-88c0-705ce754b38b req-cbb74c3b-b232-4b94-8639-cb9fd51ac39b service nova] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Received event network-vif-plugged-3e62931c-4358-4153-8d5e-c4675640e3fa {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:36:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-22e87738-b8e9-4007-88c0-705ce754b38b req-cbb74c3b-b232-4b94-8639-cb9fd51ac39b service nova] Acquiring lock "211043bf-dcc9-44af-834c-75cd7be859ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:36:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-22e87738-b8e9-4007-88c0-705ce754b38b req-cbb74c3b-b232-4b94-8639-cb9fd51ac39b service nova] Lock "211043bf-dcc9-44af-834c-75cd7be859ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:36:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-22e87738-b8e9-4007-88c0-705ce754b38b req-cbb74c3b-b232-4b94-8639-cb9fd51ac39b service nova] Lock "211043bf-dcc9-44af-834c-75cd7be859ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:36:52 user nova-compute[72766]: DEBUG nova.compute.manager [req-22e87738-b8e9-4007-88c0-705ce754b38b req-cbb74c3b-b232-4b94-8639-cb9fd51ac39b service nova] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] No waiting events found dispatching network-vif-plugged-3e62931c-4358-4153-8d5e-c4675640e3fa {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:36:52 user nova-compute[72766]: WARNING nova.compute.manager [req-22e87738-b8e9-4007-88c0-705ce754b38b req-cbb74c3b-b232-4b94-8639-cb9fd51ac39b service nova] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Received unexpected event network-vif-plugged-3e62931c-4358-4153-8d5e-c4675640e3fa for instance with vm_state active and task_state deleting.
Aug 14 23:36:52 user nova-compute[72766]: INFO nova.compute.manager [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Took 0.78 seconds to detach 1 volumes for instance.
Aug 14 23:36:52 user nova-compute[72766]: DEBUG nova.compute.manager [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Deleting volume: 9dcddaf6-f82a-4ea1-96cc-12d5fe6a1737 {{(pid=72766) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 23:36:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:36:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:36:53 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Refreshing inventories for resource provider 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 23:36:53 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Updating ProviderTree inventory for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 23:36:53 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Updating inventory in ProviderTree for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 23:36:53 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Refreshing aggregate associations for resource provider 45c8ff08-bf31-4ab6-8452-2e293102f899, aggregates: None {{(pid=72766) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 23:36:53 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Refreshing trait associations for resource provider 45c8ff08-bf31-4ab6-8452-2e293102f899, traits: COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=72766) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 23:36:53 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:36:53 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:36:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.443s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:36:53 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Deleted allocations for instance 211043bf-dcc9-44af-834c-75cd7be859ec
Aug 14 23:36:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-34cc6599-992d-4852-82cc-3fbbd515720a tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "211043bf-dcc9-44af-834c-75cd7be859ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.530s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:36:53 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:36:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:36:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:36:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:36:53 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:36:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:36:54 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:36:54 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:36:54 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:36:54 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0dad81-3f3a-4548-a267-1ba13cd65dff/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:36:54 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0dad81-3f3a-4548-a267-1ba13cd65dff/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:36:54 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0dad81-3f3a-4548-a267-1ba13cd65dff/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:36:54 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0dad81-3f3a-4548-a267-1ba13cd65dff/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:36:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:36:55 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:36:55 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:36:55 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=8488MB free_disk=25.25802993774414GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:36:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:36:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:36:55 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance cbcf7851-e6f7-4f46-97cc-d773286ccddf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:36:55 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance fe0dad81-3f3a-4548-a267-1ba13cd65dff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:36:55 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:36:55 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:36:55 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:36:55 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:36:55 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:36:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.234s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:36:55 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:36:56 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:36:58 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:36:58 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:36:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:37:00 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:37:00 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:37:00 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:37:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:37:05 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692056210.7322419, 211043bf-dcc9-44af-834c-75cd7be859ec => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:37:05 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] VM Stopped (Lifecycle Event)
Aug 14 23:37:05 user nova-compute[72766]: DEBUG nova.compute.manager [None req-50fd6adc-3836-4bf4-a4b7-344c60c8546c None None] [instance: 211043bf-dcc9-44af-834c-75cd7be859ec] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:37:05 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:37:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:37:10 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:37:10 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:37:15 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:37:16 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:37:16 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Cleaning up deleted instances {{(pid=72766) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 23:37:16 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] There are 0 instances to clean {{(pid=72766) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 23:37:19 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:37:19 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72766) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 23:37:20 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:37:21 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:37:25 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:37:30 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:37:35 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:37:40 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:37:45 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:37:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:37:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-20ad2d42-8286-4fca-8ba7-c7b2a227cca0 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "cbcf7851-e6f7-4f46-97cc-d773286ccddf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:37:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-20ad2d42-8286-4fca-8ba7-c7b2a227cca0 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "cbcf7851-e6f7-4f46-97cc-d773286ccddf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:37:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-20ad2d42-8286-4fca-8ba7-c7b2a227cca0 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "cbcf7851-e6f7-4f46-97cc-d773286ccddf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:37:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-20ad2d42-8286-4fca-8ba7-c7b2a227cca0 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "cbcf7851-e6f7-4f46-97cc-d773286ccddf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:37:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-20ad2d42-8286-4fca-8ba7-c7b2a227cca0 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "cbcf7851-e6f7-4f46-97cc-d773286ccddf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:37:46 user nova-compute[72766]: INFO nova.compute.manager [None req-20ad2d42-8286-4fca-8ba7-c7b2a227cca0 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Terminating instance
Aug 14 23:37:46 user nova-compute[72766]: DEBUG nova.compute.manager [None req-20ad2d42-8286-4fca-8ba7-c7b2a227cca0 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:37:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:37:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:37:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:37:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:37:46 user nova-compute[72766]: DEBUG nova.compute.manager [req-f1046a53-ee52-4512-9cbe-b55eadb647a1 req-e4671987-ad72-4d88-ba86-297ef8f2388b service nova] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Received event network-vif-unplugged-8f65f8f0-60fe-4fdb-af66-424a85b12caf {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:37:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f1046a53-ee52-4512-9cbe-b55eadb647a1 req-e4671987-ad72-4d88-ba86-297ef8f2388b service nova] Acquiring lock "cbcf7851-e6f7-4f46-97cc-d773286ccddf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:37:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f1046a53-ee52-4512-9cbe-b55eadb647a1 req-e4671987-ad72-4d88-ba86-297ef8f2388b service nova] Lock "cbcf7851-e6f7-4f46-97cc-d773286ccddf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:37:46 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-f1046a53-ee52-4512-9cbe-b55eadb647a1 req-e4671987-ad72-4d88-ba86-297ef8f2388b service nova] Lock "cbcf7851-e6f7-4f46-97cc-d773286ccddf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:37:46 user nova-compute[72766]: DEBUG nova.compute.manager [req-f1046a53-ee52-4512-9cbe-b55eadb647a1 req-e4671987-ad72-4d88-ba86-297ef8f2388b service nova] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] No waiting events found dispatching network-vif-unplugged-8f65f8f0-60fe-4fdb-af66-424a85b12caf {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:37:46 user nova-compute[72766]: DEBUG nova.compute.manager [req-f1046a53-ee52-4512-9cbe-b55eadb647a1 req-e4671987-ad72-4d88-ba86-297ef8f2388b service nova] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Received event network-vif-unplugged-8f65f8f0-60fe-4fdb-af66-424a85b12caf for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:37:46 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Instance destroyed successfully.
Aug 14 23:37:46 user nova-compute[72766]: DEBUG nova.objects.instance [None req-20ad2d42-8286-4fca-8ba7-c7b2a227cca0 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lazy-loading 'resources' on Instance uuid cbcf7851-e6f7-4f46-97cc-d773286ccddf {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:37:47 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-20ad2d42-8286-4fca-8ba7-c7b2a227cca0 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:03:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-412394783',display_name='tempest-ServerActionsTestOtherA-server-412394783',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-412394783',id=19,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDoXZolQqtFAUPpymn6Ku7JgXGw46vxp59imOajNHAEz0LQOA2HZ029jKc7yJ8uxT7IHJ390d7ScJ6pqdFfhcnBy/F6i10LDXWERfUkUg5mrEOI4hiQbJjkhq6PVnEbSQ==',key_name='tempest-keypair-1635999225',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:03:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b0d4f038dbd47b1aad9829f19cb4896',ramdisk_id='',reservation_id='r-htpz13qh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-242565278',owner_user_name='tempest-ServerActionsTestOtherA-242565278-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:03:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11bf21631dd0447f8f1a3f2b012ec43a',uuid=cbcf7851-e6f7-4f46-97cc-d773286ccddf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f65f8f0-60fe-4fdb-af66-424a85b12caf", "address": "fa:16:3e:70:30:66", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f65f8f0-60", "ovs_interfaceid": "8f65f8f0-60fe-4fdb-af66-424a85b12caf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:37:47 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-20ad2d42-8286-4fca-8ba7-c7b2a227cca0 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Converting VIF {"id": "8f65f8f0-60fe-4fdb-af66-424a85b12caf", "address": "fa:16:3e:70:30:66", "network": {"id": "e0bbc182-f700-4a82-84ae-7cbcb2e517c5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1477248697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b0d4f038dbd47b1aad9829f19cb4896", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f65f8f0-60", "ovs_interfaceid": "8f65f8f0-60fe-4fdb-af66-424a85b12caf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:37:47 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-20ad2d42-8286-4fca-8ba7-c7b2a227cca0 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:30:66,bridge_name='br-int',has_traffic_filtering=True,id=8f65f8f0-60fe-4fdb-af66-424a85b12caf,network=Network(e0bbc182-f700-4a82-84ae-7cbcb2e517c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f65f8f0-60') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:37:47 user nova-compute[72766]: DEBUG os_vif [None req-20ad2d42-8286-4fca-8ba7-c7b2a227cca0 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:30:66,bridge_name='br-int',has_traffic_filtering=True,id=8f65f8f0-60fe-4fdb-af66-424a85b12caf,network=Network(e0bbc182-f700-4a82-84ae-7cbcb2e517c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f65f8f0-60') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:37:47 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:37:47 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f65f8f0-60, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:37:47 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:37:47 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:37:47 user nova-compute[72766]: INFO os_vif [None req-20ad2d42-8286-4fca-8ba7-c7b2a227cca0 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:30:66,bridge_name='br-int',has_traffic_filtering=True,id=8f65f8f0-60fe-4fdb-af66-424a85b12caf,network=Network(e0bbc182-f700-4a82-84ae-7cbcb2e517c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f65f8f0-60')
Aug 14 23:37:47 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-20ad2d42-8286-4fca-8ba7-c7b2a227cca0 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Deleting instance files /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf_del
Aug 14 23:37:47 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-20ad2d42-8286-4fca-8ba7-c7b2a227cca0 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Deletion of /opt/stack/data/nova/instances/cbcf7851-e6f7-4f46-97cc-d773286ccddf_del complete
Aug 14 23:37:47 user nova-compute[72766]: INFO nova.compute.manager [None req-20ad2d42-8286-4fca-8ba7-c7b2a227cca0 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Took 0.68 seconds to destroy the instance on the hypervisor.
Aug 14 23:37:47 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-20ad2d42-8286-4fca-8ba7-c7b2a227cca0 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:37:47 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:37:47 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:37:47 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:37:47 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Took 0.54 seconds to deallocate network for instance.
Aug 14 23:37:47 user nova-compute[72766]: DEBUG nova.compute.manager [req-77ca4943-dcc9-4871-bc11-58171f768abe req-8ca0147b-fe07-415d-8388-4b788e00dbc1 service nova] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Received event network-vif-deleted-8f65f8f0-60fe-4fdb-af66-424a85b12caf {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:37:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-20ad2d42-8286-4fca-8ba7-c7b2a227cca0 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:37:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-20ad2d42-8286-4fca-8ba7-c7b2a227cca0 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:37:47 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-20ad2d42-8286-4fca-8ba7-c7b2a227cca0 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:37:47 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-20ad2d42-8286-4fca-8ba7-c7b2a227cca0 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:37:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-20ad2d42-8286-4fca-8ba7-c7b2a227cca0 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.138s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:37:47 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-20ad2d42-8286-4fca-8ba7-c7b2a227cca0 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Deleted allocations for instance cbcf7851-e6f7-4f46-97cc-d773286ccddf
Aug 14 23:37:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-20ad2d42-8286-4fca-8ba7-c7b2a227cca0 tempest-ServerActionsTestOtherA-242565278 tempest-ServerActionsTestOtherA-242565278-project-member] Lock "cbcf7851-e6f7-4f46-97cc-d773286ccddf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.542s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:37:48 user nova-compute[72766]: DEBUG nova.compute.manager [req-2b099990-91d5-4acf-862a-77292caaa0a0 req-8f8f4aa0-c5ce-47fc-b561-26278e22f672 service nova] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Received event network-vif-plugged-8f65f8f0-60fe-4fdb-af66-424a85b12caf {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:37:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2b099990-91d5-4acf-862a-77292caaa0a0 req-8f8f4aa0-c5ce-47fc-b561-26278e22f672 service nova] Acquiring lock "cbcf7851-e6f7-4f46-97cc-d773286ccddf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:37:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2b099990-91d5-4acf-862a-77292caaa0a0 req-8f8f4aa0-c5ce-47fc-b561-26278e22f672 service nova] Lock "cbcf7851-e6f7-4f46-97cc-d773286ccddf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:37:48 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-2b099990-91d5-4acf-862a-77292caaa0a0 req-8f8f4aa0-c5ce-47fc-b561-26278e22f672 service nova] Lock "cbcf7851-e6f7-4f46-97cc-d773286ccddf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:37:48 user nova-compute[72766]: DEBUG nova.compute.manager [req-2b099990-91d5-4acf-862a-77292caaa0a0 req-8f8f4aa0-c5ce-47fc-b561-26278e22f672 service nova] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] No waiting events found dispatching network-vif-plugged-8f65f8f0-60fe-4fdb-af66-424a85b12caf {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:37:48 user nova-compute[72766]: WARNING nova.compute.manager [req-2b099990-91d5-4acf-862a-77292caaa0a0 req-8f8f4aa0-c5ce-47fc-b561-26278e22f672 service nova] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Received unexpected event network-vif-plugged-8f65f8f0-60fe-4fdb-af66-424a85b12caf for instance with vm_state deleted and task_state None.
Aug 14 23:37:50 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:37:50 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:37:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-fe0dad81-3f3a-4548-a267-1ba13cd65dff" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:37:50 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-fe0dad81-3f3a-4548-a267-1ba13cd65dff" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:37:50 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:37:51 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Updating instance_info_cache with network_info: [{"id": "cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a", "address": "fa:16:3e:80:76:8c", "network": {"id": "ac53cc42-a36b-4e59-a831-e240513cd6da", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-912624616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30bfb5a00552451195ed2aa91d218c8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf3a48f2-15", "ovs_interfaceid": "cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:37:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-fe0dad81-3f3a-4548-a267-1ba13cd65dff" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:37:51 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:37:51 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:37:51 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:37:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:37:53 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:37:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:37:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:37:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:37:53 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:37:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0dad81-3f3a-4548-a267-1ba13cd65dff/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:37:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0dad81-3f3a-4548-a267-1ba13cd65dff/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:37:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0dad81-3f3a-4548-a267-1ba13cd65dff/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:37:54 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0dad81-3f3a-4548-a267-1ba13cd65dff/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:37:54 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:37:54 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:37:54 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=8732MB free_disk=25.275848388671875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:37:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:37:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:37:54 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance fe0dad81-3f3a-4548-a267-1ba13cd65dff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:37:54 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:37:54 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:37:54 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:37:54 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:37:54 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:37:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:37:55 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:37:55 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:37:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:37:58 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:37:59 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:38:00 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:38:00 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:38:01 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692056266.9865768, cbcf7851-e6f7-4f46-97cc-d773286ccddf => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:38:01 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] VM Stopped (Lifecycle Event)
Aug 14 23:38:02 user nova-compute[72766]: DEBUG nova.compute.manager [None req-455b5c3e-59b6-47e3-bfd8-7444af193a69 None None] [instance: cbcf7851-e6f7-4f46-97cc-d773286ccddf] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:38:02 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:38:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:38:12 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:38:15 user nova-compute[72766]: DEBUG nova.compute.manager [req-1c761fc9-0dad-4b79-b736-6f691040213f req-5e894521-6f9b-4044-8d50-89c1e7ba5e60 service nova] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Received event network-changed-cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:38:15 user nova-compute[72766]: DEBUG nova.compute.manager [req-1c761fc9-0dad-4b79-b736-6f691040213f req-5e894521-6f9b-4044-8d50-89c1e7ba5e60 service nova] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Refreshing instance network info cache due to event network-changed-cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:38:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-1c761fc9-0dad-4b79-b736-6f691040213f req-5e894521-6f9b-4044-8d50-89c1e7ba5e60 service nova] Acquiring lock "refresh_cache-fe0dad81-3f3a-4548-a267-1ba13cd65dff" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:38:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-1c761fc9-0dad-4b79-b736-6f691040213f req-5e894521-6f9b-4044-8d50-89c1e7ba5e60 service nova] Acquired lock "refresh_cache-fe0dad81-3f3a-4548-a267-1ba13cd65dff" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:38:15 user nova-compute[72766]: DEBUG nova.network.neutron [req-1c761fc9-0dad-4b79-b736-6f691040213f req-5e894521-6f9b-4044-8d50-89c1e7ba5e60 service nova] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Refreshing network info cache for port cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:38:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Acquiring lock "fe0dad81-3f3a-4548-a267-1ba13cd65dff" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:38:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "fe0dad81-3f3a-4548-a267-1ba13cd65dff" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:38:15 user nova-compute[72766]: DEBUG nova.objects.instance [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lazy-loading 'flavor' on Instance uuid fe0dad81-3f3a-4548-a267-1ba13cd65dff {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:38:15 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Ignoring supplied device name: /dev/vdb
Aug 14 23:38:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "fe0dad81-3f3a-4548-a267-1ba13cd65dff" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:38:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Acquiring lock "fe0dad81-3f3a-4548-a267-1ba13cd65dff" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:38:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "fe0dad81-3f3a-4548-a267-1ba13cd65dff" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:38:16 user nova-compute[72766]: INFO nova.compute.manager [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Attaching volume c350e5f3-d815-4ab4-ac05-36c7dace2dc2 to /dev/vdb
Aug 14 23:38:16 user nova-compute[72766]: DEBUG nova.network.neutron [req-1c761fc9-0dad-4b79-b736-6f691040213f req-5e894521-6f9b-4044-8d50-89c1e7ba5e60 service nova] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Updated VIF entry in instance network info cache for port cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:38:16 user nova-compute[72766]: DEBUG nova.network.neutron [req-1c761fc9-0dad-4b79-b736-6f691040213f req-5e894521-6f9b-4044-8d50-89c1e7ba5e60 service nova] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Updating instance_info_cache with network_info: [{"id": "cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a", "address": "fa:16:3e:80:76:8c", "network": {"id": "ac53cc42-a36b-4e59-a831-e240513cd6da", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-912624616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30bfb5a00552451195ed2aa91d218c8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf3a48f2-15", "ovs_interfaceid": "cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:38:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-1c761fc9-0dad-4b79-b736-6f691040213f req-5e894521-6f9b-4044-8d50-89c1e7ba5e60 service nova] Releasing lock "refresh_cache-fe0dad81-3f3a-4548-a267-1ba13cd65dff" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:38:16 user nova-compute[72766]: DEBUG os_brick.utils [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:38:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:38:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:38:16 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c86fa76-98d3-4932-8035-b8f280242ede]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:38:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:38:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:38:16 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a97e12-797c-4a7d-ae67-a0a387ccc307]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:38:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:38:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:38:16 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2211a067-41e2-4a6b-9836-74db95265e74]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:38:16 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[553056fd-319a-4d16-8918-261de76209a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:38:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:38:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:38:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 23:38:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:38:16 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:38:16 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 23:38:16 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bff8f07-976b-47ba-bc4a-746791dd7de3]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:38:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 23:38:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 23:38:16 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 23:38:16 user nova-compute[72766]: DEBUG os_brick.utils [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:38:16 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Updating existing volume attachment record: b4349a47-2e1f-458c-a1f2-d2e1a5c7a31d {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 23:38:17 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:38:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:38:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'acbtZQxq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:38:24 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:38:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:38:24 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:38:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:38:24 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 23:38:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2 -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d67df79-ee13-4352-a5ba-53ab7a063e3f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 23:38:24 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2 -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[edae8cbc-802a-4e02-b5d0-90dda7fd09f3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2] added
Aug 14 23:38:24 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2cc7fd5-a196-4515-8714-ebce88d41215]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa19fb1-eb20-4e5a-9ba6-12f497928ade]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v acbtZQxq {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v acbtZQxq" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[225f5180-9d72-4f37-bccd-64373bdb82d5]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'acbtZQxq'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8504fe83-170e-4785-8489-16fa6f24d42b]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc2d66b-63d1-43ca-856f-d76a3c8e7e55]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 23:38:24 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 23:38:24 user nova-compute[72766]:  {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:38:24 user nova-compute[72766]: WARNING os_brick.initiator.connectors.iscsi [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 23:38:24 user nova-compute[72766]: 
Aug 14 23:38:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2 -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[36178472-8833-42de-8c09-a008d1456bcb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2, portal: 172.16.0.220,3260]
Aug 14 23:38:24 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2, portal: 172.16.0.220,3260] successful.
Aug 14 23:38:24 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea46bc3-fd58-419a-acc4-ecc499660ee1]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[8599bbe9-246d-41b0-b7b3-688914a677fa]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2 (non-flash)
Aug 14 23:38:24 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2 (non-flash)
Aug 14 23:38:24 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fad812-b0fa-4ccb-99a5-a9c345d46cf0]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'acbtZQxq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 23:38:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:38:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:38:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23761313937303331', 'path': '/dev/sdb'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:38:25 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761313937303331', 'path': '/dev/sdb'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 23:38:25 user nova-compute[72766]: DEBUG nova.objects.instance [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lazy-loading 'flavor' on Instance uuid fe0dad81-3f3a-4548-a267-1ba13cd65dff {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:38:25 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 23:38:25 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:38:25 user nova-compute[72766]:   <source dev="/dev/sdb"/>
Aug 14 23:38:25 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:38:25 user nova-compute[72766]:   <serial>c350e5f3-d815-4ab4-ac05-36c7dace2dc2</serial>
Aug 14 23:38:25 user nova-compute[72766]: </disk>
Aug 14 23:38:25 user nova-compute[72766]:  {{(pid=72766) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 23:38:26 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:38:26 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:38:26 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] No VIF found with MAC fa:16:3e:80:76:8c, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:38:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-5c343d7f-7c9f-477b-9b9b-c0423d97b4b9 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "fe0dad81-3f3a-4548-a267-1ba13cd65dff" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.018s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:38:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:38:32 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:38:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:38:36 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:38:37 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:38:39 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:38:42 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:38:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:38:47 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:38:47 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:38:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:38:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:38:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquiring lock "2262995c-232a-4bfd-b8f4-c83b24c12f62" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:38:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:38:51 user nova-compute[72766]: DEBUG nova.compute.manager [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 23:38:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:38:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:38:51 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 23:38:51 user nova-compute[72766]: INFO nova.compute.claims [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Claim successful on node user
Aug 14 23:38:51 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:38:51 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:38:51 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:38:51 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Rebuilding the list of instances to heal {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 23:38:51 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:38:51 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Skipping network cache update for instance because it is Building. {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 14 23:38:51 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:38:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.609s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:38:51 user nova-compute[72766]: DEBUG nova.compute.manager [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 23:38:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-fe0dad81-3f3a-4548-a267-1ba13cd65dff" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:38:51 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-fe0dad81-3f3a-4548-a267-1ba13cd65dff" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:38:51 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:38:51 user nova-compute[72766]: DEBUG nova.objects.instance [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lazy-loading 'info_cache' on Instance uuid fe0dad81-3f3a-4548-a267-1ba13cd65dff {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:38:51 user nova-compute[72766]: DEBUG nova.compute.manager [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 23:38:51 user nova-compute[72766]: DEBUG nova.network.neutron [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 23:38:51 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 23:38:51 user nova-compute[72766]: DEBUG nova.compute.manager [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 23:38:51 user nova-compute[72766]: DEBUG nova.policy [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a1c0e7bd2744a349ecfef160a6f54f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaadde665b704e4d882299b7f747d7a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 23:38:52 user nova-compute[72766]: DEBUG nova.compute.manager [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 23:38:52 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 23:38:52 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Creating image(s)
Aug 14 23:38:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquiring lock "/opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:38:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "/opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:38:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "/opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:38:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:38:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:38:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.229s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:38:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquiring lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:38:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:38:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:38:52 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Updating instance_info_cache with network_info: [{"id": "cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a", "address": "fa:16:3e:80:76:8c", "network": {"id": "ac53cc42-a36b-4e59-a831-e240513cd6da", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-912624616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30bfb5a00552451195ed2aa91d218c8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf3a48f2-15", "ovs_interfaceid": "cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:38:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-fe0dad81-3f3a-4548-a267-1ba13cd65dff" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:38:52 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:38:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.208s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:38:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquiring lock "b9ede44b-eef5-473f-a279-8166a442a45d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:38:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "b9ede44b-eef5-473f-a279-8166a442a45d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:38:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk 1073741824 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:38:52 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 23:38:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk 1073741824" returned: 0 in 0.057s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:38:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:38:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:38:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:38:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:38:52 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 23:38:52 user nova-compute[72766]: INFO nova.compute.claims [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Claim successful on node user
Aug 14 23:38:52 user nova-compute[72766]: DEBUG nova.network.neutron [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Successfully created port: 69550d14-e1fb-4c2e-9526-19cae208fd08 {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 23:38:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.217s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:38:52 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk. size=1073741824 {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 23:38:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:38:52 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:38:52 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:38:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.282s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:38:52 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 23:38:52 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:38:52 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Cannot resize image /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk to a smaller size. {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 23:38:52 user nova-compute[72766]: DEBUG nova.objects.instance [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lazy-loading 'migration_context' on Instance uuid 2262995c-232a-4bfd-b8f4-c83b24c12f62 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:38:52 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 23:38:52 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Ensure instance console log exists: /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 23:38:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:38:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:38:52 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:38:52 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 23:38:52 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 23:38:53 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 23:38:53 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 23:38:53 user nova-compute[72766]: DEBUG nova.policy [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a1c0e7bd2744a349ecfef160a6f54f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaadde665b704e4d882299b7f747d7a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 23:38:53 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 23:38:53 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 23:38:53 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Creating image(s)
Aug 14 23:38:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquiring lock "/opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:38:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "/opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:38:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "/opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:38:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:38:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.187s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:38:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquiring lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:38:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:38:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:38:53 user nova-compute[72766]: DEBUG nova.network.neutron [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Successfully updated port: 69550d14-e1fb-4c2e-9526-19cae208fd08 {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 23:38:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquiring lock "refresh_cache-2262995c-232a-4bfd-b8f4-c83b24c12f62" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:38:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquired lock "refresh_cache-2262995c-232a-4bfd-b8f4-c83b24c12f62" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:38:53 user nova-compute[72766]: DEBUG nova.network.neutron [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:38:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.185s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:38:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk 1073741824 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:38:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk 1073741824" returned: 0 in 0.059s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:38:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:38:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:38:53 user nova-compute[72766]: DEBUG nova.compute.manager [req-21ce537a-f150-4f8b-a0c5-894a5ab36194 req-ffe2d8f9-7b8f-45e8-b279-a4ed93917191 service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Received event network-changed-69550d14-e1fb-4c2e-9526-19cae208fd08 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:38:53 user nova-compute[72766]: DEBUG nova.compute.manager [req-21ce537a-f150-4f8b-a0c5-894a5ab36194 req-ffe2d8f9-7b8f-45e8-b279-a4ed93917191 service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Refreshing instance network info cache due to event network-changed-69550d14-e1fb-4c2e-9526-19cae208fd08. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:38:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-21ce537a-f150-4f8b-a0c5-894a5ab36194 req-ffe2d8f9-7b8f-45e8-b279-a4ed93917191 service nova] Acquiring lock "refresh_cache-2262995c-232a-4bfd-b8f4-c83b24c12f62" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:38:53 user nova-compute[72766]: DEBUG nova.network.neutron [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 23:38:53 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:38:53 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Successfully created port: 02fed6c3-ea8a-4fd6-a404-29ea7c038c6a {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 23:38:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.203s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:38:53 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk. size=1073741824 {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 23:38:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:38:53 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:38:53 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Cannot resize image /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk to a smaller size. {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 23:38:53 user nova-compute[72766]: DEBUG nova.objects.instance [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lazy-loading 'migration_context' on Instance uuid b9ede44b-eef5-473f-a279-8166a442a45d {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:38:53 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Ensure instance console log exists: /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.network.neutron [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Updating instance_info_cache with network_info: [{"id": "69550d14-e1fb-4c2e-9526-19cae208fd08", "address": "fa:16:3e:bd:82:2f", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69550d14-e1", "ovs_interfaceid": "69550d14-e1fb-4c2e-9526-19cae208fd08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Releasing lock "refresh_cache-2262995c-232a-4bfd-b8f4-c83b24c12f62" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Instance network_info: |[{"id": "69550d14-e1fb-4c2e-9526-19cae208fd08", "address": "fa:16:3e:bd:82:2f", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69550d14-e1", "ovs_interfaceid": "69550d14-e1fb-4c2e-9526-19cae208fd08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-21ce537a-f150-4f8b-a0c5-894a5ab36194 req-ffe2d8f9-7b8f-45e8-b279-a4ed93917191 service nova] Acquired lock "refresh_cache-2262995c-232a-4bfd-b8f4-c83b24c12f62" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.network.neutron [req-21ce537a-f150-4f8b-a0c5-894a5ab36194 req-ffe2d8f9-7b8f-45e8-b279-a4ed93917191 service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Refreshing network info cache for port 69550d14-e1fb-4c2e-9526-19cae208fd08 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Start _get_guest_xml network_info=[{"id": "69550d14-e1fb-4c2e-9526-19cae208fd08", "address": "fa:16:3e:bd:82:2f", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69550d14-e1", "ovs_interfaceid": "69550d14-e1fb-4c2e-9526-19cae208fd08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd2900d30-2c4c-4d57-9135-d45564c0c596'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:38:54 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:38:54 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:38:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-987629422',display_name='tempest-ServerRescueNegativeTestJSON-server-987629422',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-987629422',id=49,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eaadde665b704e4d882299b7f747d7a5',ramdisk_id='',reservation_id='r-e060wqz6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1344834449',owner_user_name='tempest-ServerRescueNegativeTestJSON-1344834449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:38:52Z,user_data=None,user_id='4a1c0e7bd2744a349ecfef160a6f54f5',uuid=2262995c-232a-4bfd-b8f4-c83b24c12f62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69550d14-e1fb-4c2e-9526-19cae208fd08", "address": "fa:16:3e:bd:82:2f", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69550d14-e1", "ovs_interfaceid": "69550d14-e1fb-4c2e-9526-19cae208fd08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Converting VIF {"id": "69550d14-e1fb-4c2e-9526-19cae208fd08", "address": "fa:16:3e:bd:82:2f", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69550d14-e1", "ovs_interfaceid": "69550d14-e1fb-4c2e-9526-19cae208fd08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:82:2f,bridge_name='br-int',has_traffic_filtering=True,id=69550d14-e1fb-4c2e-9526-19cae208fd08,network=Network(71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69550d14-e1') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.objects.instance [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lazy-loading 'pci_devices' on Instance uuid 2262995c-232a-4bfd-b8f4-c83b24c12f62 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:38:54 user nova-compute[72766]:   <uuid>2262995c-232a-4bfd-b8f4-c83b24c12f62</uuid>
Aug 14 23:38:54 user nova-compute[72766]:   <name>instance-00000031</name>
Aug 14 23:38:54 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:38:54 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:38:54 user nova-compute[72766]:   <metadata>
Aug 14 23:38:54 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:38:54 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:38:54 user nova-compute[72766]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-987629422</nova:name>
Aug 14 23:38:54 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:38:54</nova:creationTime>
Aug 14 23:38:54 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:38:54 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:38:54 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:38:54 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:38:54 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:38:54 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:38:54 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:38:54 user nova-compute[72766]:       <nova:owner>
Aug 14 23:38:54 user nova-compute[72766]:         <nova:user uuid="4a1c0e7bd2744a349ecfef160a6f54f5">tempest-ServerRescueNegativeTestJSON-1344834449-project-member</nova:user>
Aug 14 23:38:54 user nova-compute[72766]:         <nova:project uuid="eaadde665b704e4d882299b7f747d7a5">tempest-ServerRescueNegativeTestJSON-1344834449</nova:project>
Aug 14 23:38:54 user nova-compute[72766]:       </nova:owner>
Aug 14 23:38:54 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 23:38:54 user nova-compute[72766]:       <nova:ports>
Aug 14 23:38:54 user nova-compute[72766]:         <nova:port uuid="69550d14-e1fb-4c2e-9526-19cae208fd08">
Aug 14 23:38:54 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 23:38:54 user nova-compute[72766]:         </nova:port>
Aug 14 23:38:54 user nova-compute[72766]:       </nova:ports>
Aug 14 23:38:54 user nova-compute[72766]:     </nova:instance>
Aug 14 23:38:54 user nova-compute[72766]:   </metadata>
Aug 14 23:38:54 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:38:54 user nova-compute[72766]:     <system>
Aug 14 23:38:54 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:38:54 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:38:54 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:38:54 user nova-compute[72766]:       <entry name="serial">2262995c-232a-4bfd-b8f4-c83b24c12f62</entry>
Aug 14 23:38:54 user nova-compute[72766]:       <entry name="uuid">2262995c-232a-4bfd-b8f4-c83b24c12f62</entry>
Aug 14 23:38:54 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:38:54 user nova-compute[72766]:     </system>
Aug 14 23:38:54 user nova-compute[72766]:   </sysinfo>
Aug 14 23:38:54 user nova-compute[72766]:   <os>
Aug 14 23:38:54 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:38:54 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:38:54 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:38:54 user nova-compute[72766]:   </os>
Aug 14 23:38:54 user nova-compute[72766]:   <features>
Aug 14 23:38:54 user nova-compute[72766]:     <acpi/>
Aug 14 23:38:54 user nova-compute[72766]:     <apic/>
Aug 14 23:38:54 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:38:54 user nova-compute[72766]:   </features>
Aug 14 23:38:54 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:38:54 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:38:54 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:38:54 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:38:54 user nova-compute[72766]:   </clock>
Aug 14 23:38:54 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:38:54 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:38:54 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:38:54 user nova-compute[72766]:   </cpu>
Aug 14 23:38:54 user nova-compute[72766]:   <devices>
Aug 14 23:38:54 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 23:38:54 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 23:38:54 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk"/>
Aug 14 23:38:54 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:38:54 user nova-compute[72766]:     </disk>
Aug 14 23:38:54 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:38:54 user nova-compute[72766]:       <mac address="fa:16:3e:bd:82:2f"/>
Aug 14 23:38:54 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:38:54 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:38:54 user nova-compute[72766]:       <target dev="tap69550d14-e1"/>
Aug 14 23:38:54 user nova-compute[72766]:     </interface>
Aug 14 23:38:54 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:38:54 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/console.log" append="off"/>
Aug 14 23:38:54 user nova-compute[72766]:     </serial>
Aug 14 23:38:54 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:38:54 user nova-compute[72766]:     <video>
Aug 14 23:38:54 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:38:54 user nova-compute[72766]:     </video>
Aug 14 23:38:54 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:38:54 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:38:54 user nova-compute[72766]:     </rng>
Aug 14 23:38:54 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:38:54 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:38:54 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:38:54 user nova-compute[72766]:     </memballoon>
Aug 14 23:38:54 user nova-compute[72766]:   </devices>
Aug 14 23:38:54 user nova-compute[72766]: </domain>
Aug 14 23:38:54 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:38:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-987629422',display_name='tempest-ServerRescueNegativeTestJSON-server-987629422',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-987629422',id=49,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eaadde665b704e4d882299b7f747d7a5',ramdisk_id='',reservation_id='r-e060wqz6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1344834449',owner_user_name='tempest-ServerRescueNegativeTestJSON-1344834449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:38:52Z,user_data=None,user_id='4a1c0e7bd2744a349ecfef160a6f54f5',uuid=2262995c-232a-4bfd-b8f4-c83b24c12f62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69550d14-e1fb-4c2e-9526-19cae208fd08", "address": "fa:16:3e:bd:82:2f", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69550d14-e1", "ovs_interfaceid": "69550d14-e1fb-4c2e-9526-19cae208fd08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Converting VIF {"id": "69550d14-e1fb-4c2e-9526-19cae208fd08", "address": "fa:16:3e:bd:82:2f", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69550d14-e1", "ovs_interfaceid": "69550d14-e1fb-4c2e-9526-19cae208fd08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:82:2f,bridge_name='br-int',has_traffic_filtering=True,id=69550d14-e1fb-4c2e-9526-19cae208fd08,network=Network(71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69550d14-e1') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG os_vif [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:82:2f,bridge_name='br-int',has_traffic_filtering=True,id=69550d14-e1fb-4c2e-9526-19cae208fd08,network=Network(71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69550d14-e1') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69550d14-e1, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap69550d14-e1, col_values=(('external_ids', {'iface-id': '69550d14-e1fb-4c2e-9526-19cae208fd08', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:82:2f', 'vm-uuid': '2262995c-232a-4bfd-b8f4-c83b24c12f62'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:38:54 user nova-compute[72766]: INFO os_vif [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:82:2f,bridge_name='br-int',has_traffic_filtering=True,id=69550d14-e1fb-4c2e-9526-19cae208fd08,network=Network(71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69550d14-e1')
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] No VIF found with MAC fa:16:3e:bd:82:2f, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Successfully updated port: 02fed6c3-ea8a-4fd6-a404-29ea7c038c6a {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquiring lock "refresh_cache-b9ede44b-eef5-473f-a279-8166a442a45d" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquired lock "refresh_cache-b9ede44b-eef5-473f-a279-8166a442a45d" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.network.neutron [req-21ce537a-f150-4f8b-a0c5-894a5ab36194 req-ffe2d8f9-7b8f-45e8-b279-a4ed93917191 service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Updated VIF entry in instance network info cache for port 69550d14-e1fb-4c2e-9526-19cae208fd08. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.network.neutron [req-21ce537a-f150-4f8b-a0c5-894a5ab36194 req-ffe2d8f9-7b8f-45e8-b279-a4ed93917191 service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Updating instance_info_cache with network_info: [{"id": "69550d14-e1fb-4c2e-9526-19cae208fd08", "address": "fa:16:3e:bd:82:2f", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69550d14-e1", "ovs_interfaceid": "69550d14-e1fb-4c2e-9526-19cae208fd08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-21ce537a-f150-4f8b-a0c5-894a5ab36194 req-ffe2d8f9-7b8f-45e8-b279-a4ed93917191 service nova] Releasing lock "refresh_cache-2262995c-232a-4bfd-b8f4-c83b24c12f62" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.compute.manager [req-1cd0be4b-00a6-4d4d-982f-b0f99c6f2f6f req-56939555-1c9c-4dfb-97e1-0f337f4bcfba service nova] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Received event network-changed-02fed6c3-ea8a-4fd6-a404-29ea7c038c6a {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.compute.manager [req-1cd0be4b-00a6-4d4d-982f-b0f99c6f2f6f req-56939555-1c9c-4dfb-97e1-0f337f4bcfba service nova] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Refreshing instance network info cache due to event network-changed-02fed6c3-ea8a-4fd6-a404-29ea7c038c6a. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-1cd0be4b-00a6-4d4d-982f-b0f99c6f2f6f req-56939555-1c9c-4dfb-97e1-0f337f4bcfba service nova] Acquiring lock "refresh_cache-b9ede44b-eef5-473f-a279-8166a442a45d" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Updating instance_info_cache with network_info: [{"id": "02fed6c3-ea8a-4fd6-a404-29ea7c038c6a", "address": "fa:16:3e:52:c1:fe", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02fed6c3-ea", "ovs_interfaceid": "02fed6c3-ea8a-4fd6-a404-29ea7c038c6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Releasing lock "refresh_cache-b9ede44b-eef5-473f-a279-8166a442a45d" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Instance network_info: |[{"id": "02fed6c3-ea8a-4fd6-a404-29ea7c038c6a", "address": "fa:16:3e:52:c1:fe", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02fed6c3-ea", "ovs_interfaceid": "02fed6c3-ea8a-4fd6-a404-29ea7c038c6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-1cd0be4b-00a6-4d4d-982f-b0f99c6f2f6f req-56939555-1c9c-4dfb-97e1-0f337f4bcfba service nova] Acquired lock "refresh_cache-b9ede44b-eef5-473f-a279-8166a442a45d" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.network.neutron [req-1cd0be4b-00a6-4d4d-982f-b0f99c6f2f6f req-56939555-1c9c-4dfb-97e1-0f337f4bcfba service nova] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Refreshing network info cache for port 02fed6c3-ea8a-4fd6-a404-29ea7c038c6a {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Start _get_guest_xml network_info=[{"id": "02fed6c3-ea8a-4fd6-a404-29ea7c038c6a", "address": "fa:16:3e:52:c1:fe", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02fed6c3-ea", "ovs_interfaceid": "02fed6c3-ea8a-4fd6-a404-29ea7c038c6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd2900d30-2c4c-4d57-9135-d45564c0c596'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:38:54 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:38:54 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:38:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-103213439',display_name='tempest-ServerRescueNegativeTestJSON-server-103213439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-103213439',id=50,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eaadde665b704e4d882299b7f747d7a5',ramdisk_id='',reservation_id='r-2kiiyowb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1344834449',owner_user_name='tempest-ServerRescueNegativeTestJSON-1344834449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:38:53Z,user_data=None,user_id='4a1c0e7bd2744a349ecfef160a6f54f5',uuid=b9ede44b-eef5-473f-a279-8166a442a45d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02fed6c3-ea8a-4fd6-a404-29ea7c038c6a", "address": "fa:16:3e:52:c1:fe", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02fed6c3-ea", "ovs_interfaceid": "02fed6c3-ea8a-4fd6-a404-29ea7c038c6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Converting VIF {"id": "02fed6c3-ea8a-4fd6-a404-29ea7c038c6a", "address": "fa:16:3e:52:c1:fe", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02fed6c3-ea", "ovs_interfaceid": "02fed6c3-ea8a-4fd6-a404-29ea7c038c6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:c1:fe,bridge_name='br-int',has_traffic_filtering=True,id=02fed6c3-ea8a-4fd6-a404-29ea7c038c6a,network=Network(71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02fed6c3-ea') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.objects.instance [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lazy-loading 'pci_devices' on Instance uuid b9ede44b-eef5-473f-a279-8166a442a45d {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:38:54 user nova-compute[72766]:   <uuid>b9ede44b-eef5-473f-a279-8166a442a45d</uuid>
Aug 14 23:38:54 user nova-compute[72766]:   <name>instance-00000032</name>
Aug 14 23:38:54 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:38:54 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:38:54 user nova-compute[72766]:   <metadata>
Aug 14 23:38:54 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:38:54 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:38:54 user nova-compute[72766]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-103213439</nova:name>
Aug 14 23:38:54 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:38:54</nova:creationTime>
Aug 14 23:38:54 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:38:54 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:38:54 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:38:54 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:38:54 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:38:54 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:38:54 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:38:54 user nova-compute[72766]:       <nova:owner>
Aug 14 23:38:54 user nova-compute[72766]:         <nova:user uuid="4a1c0e7bd2744a349ecfef160a6f54f5">tempest-ServerRescueNegativeTestJSON-1344834449-project-member</nova:user>
Aug 14 23:38:54 user nova-compute[72766]:         <nova:project uuid="eaadde665b704e4d882299b7f747d7a5">tempest-ServerRescueNegativeTestJSON-1344834449</nova:project>
Aug 14 23:38:54 user nova-compute[72766]:       </nova:owner>
Aug 14 23:38:54 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 23:38:54 user nova-compute[72766]:       <nova:ports>
Aug 14 23:38:54 user nova-compute[72766]:         <nova:port uuid="02fed6c3-ea8a-4fd6-a404-29ea7c038c6a">
Aug 14 23:38:54 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 14 23:38:54 user nova-compute[72766]:         </nova:port>
Aug 14 23:38:54 user nova-compute[72766]:       </nova:ports>
Aug 14 23:38:54 user nova-compute[72766]:     </nova:instance>
Aug 14 23:38:54 user nova-compute[72766]:   </metadata>
Aug 14 23:38:54 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:38:54 user nova-compute[72766]:     <system>
Aug 14 23:38:54 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:38:54 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:38:54 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:38:54 user nova-compute[72766]:       <entry name="serial">b9ede44b-eef5-473f-a279-8166a442a45d</entry>
Aug 14 23:38:54 user nova-compute[72766]:       <entry name="uuid">b9ede44b-eef5-473f-a279-8166a442a45d</entry>
Aug 14 23:38:54 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:38:54 user nova-compute[72766]:     </system>
Aug 14 23:38:54 user nova-compute[72766]:   </sysinfo>
Aug 14 23:38:54 user nova-compute[72766]:   <os>
Aug 14 23:38:54 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:38:54 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:38:54 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:38:54 user nova-compute[72766]:   </os>
Aug 14 23:38:54 user nova-compute[72766]:   <features>
Aug 14 23:38:54 user nova-compute[72766]:     <acpi/>
Aug 14 23:38:54 user nova-compute[72766]:     <apic/>
Aug 14 23:38:54 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:38:54 user nova-compute[72766]:   </features>
Aug 14 23:38:54 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:38:54 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:38:54 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:38:54 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:38:54 user nova-compute[72766]:   </clock>
Aug 14 23:38:54 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:38:54 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:38:54 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:38:54 user nova-compute[72766]:   </cpu>
Aug 14 23:38:54 user nova-compute[72766]:   <devices>
Aug 14 23:38:54 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 23:38:54 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 23:38:54 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk"/>
Aug 14 23:38:54 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:38:54 user nova-compute[72766]:     </disk>
Aug 14 23:38:54 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:38:54 user nova-compute[72766]:       <mac address="fa:16:3e:52:c1:fe"/>
Aug 14 23:38:54 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:38:54 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:38:54 user nova-compute[72766]:       <target dev="tap02fed6c3-ea"/>
Aug 14 23:38:54 user nova-compute[72766]:     </interface>
Aug 14 23:38:54 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:38:54 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/console.log" append="off"/>
Aug 14 23:38:54 user nova-compute[72766]:     </serial>
Aug 14 23:38:54 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:38:54 user nova-compute[72766]:     <video>
Aug 14 23:38:54 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:38:54 user nova-compute[72766]:     </video>
Aug 14 23:38:54 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:38:54 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:38:54 user nova-compute[72766]:     </rng>
Aug 14 23:38:54 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:38:54 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:38:54 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:38:54 user nova-compute[72766]:     </memballoon>
Aug 14 23:38:54 user nova-compute[72766]:   </devices>
Aug 14 23:38:54 user nova-compute[72766]: </domain>
Aug 14 23:38:54 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:38:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-103213439',display_name='tempest-ServerRescueNegativeTestJSON-server-103213439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-103213439',id=50,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eaadde665b704e4d882299b7f747d7a5',ramdisk_id='',reservation_id='r-2kiiyowb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1344834449',owner_user_name='tempest-ServerRescueNegativeTestJSON-1344834449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:38:53Z,user_data=None,user_id='4a1c0e7bd2744a349ecfef160a6f54f5',uuid=b9ede44b-eef5-473f-a279-8166a442a45d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02fed6c3-ea8a-4fd6-a404-29ea7c038c6a", "address": "fa:16:3e:52:c1:fe", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02fed6c3-ea", "ovs_interfaceid": "02fed6c3-ea8a-4fd6-a404-29ea7c038c6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Converting VIF {"id": "02fed6c3-ea8a-4fd6-a404-29ea7c038c6a", "address": "fa:16:3e:52:c1:fe", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02fed6c3-ea", "ovs_interfaceid": "02fed6c3-ea8a-4fd6-a404-29ea7c038c6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:c1:fe,bridge_name='br-int',has_traffic_filtering=True,id=02fed6c3-ea8a-4fd6-a404-29ea7c038c6a,network=Network(71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02fed6c3-ea') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG os_vif [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:c1:fe,bridge_name='br-int',has_traffic_filtering=True,id=02fed6c3-ea8a-4fd6-a404-29ea7c038c6a,network=Network(71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02fed6c3-ea') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap02fed6c3-ea, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap02fed6c3-ea, col_values=(('external_ids', {'iface-id': '02fed6c3-ea8a-4fd6-a404-29ea7c038c6a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:c1:fe', 'vm-uuid': 'b9ede44b-eef5-473f-a279-8166a442a45d'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:38:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:38:54 user nova-compute[72766]: INFO os_vif [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:c1:fe,bridge_name='br-int',has_traffic_filtering=True,id=02fed6c3-ea8a-4fd6-a404-29ea7c038c6a,network=Network(71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02fed6c3-ea')
Aug 14 23:38:55 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:38:55 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] No VIF found with MAC fa:16:3e:52:c1:fe, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:38:55 user nova-compute[72766]: DEBUG nova.network.neutron [req-1cd0be4b-00a6-4d4d-982f-b0f99c6f2f6f req-56939555-1c9c-4dfb-97e1-0f337f4bcfba service nova] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Updated VIF entry in instance network info cache for port 02fed6c3-ea8a-4fd6-a404-29ea7c038c6a. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:38:55 user nova-compute[72766]: DEBUG nova.network.neutron [req-1cd0be4b-00a6-4d4d-982f-b0f99c6f2f6f req-56939555-1c9c-4dfb-97e1-0f337f4bcfba service nova] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Updating instance_info_cache with network_info: [{"id": "02fed6c3-ea8a-4fd6-a404-29ea7c038c6a", "address": "fa:16:3e:52:c1:fe", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02fed6c3-ea", "ovs_interfaceid": "02fed6c3-ea8a-4fd6-a404-29ea7c038c6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:38:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-1cd0be4b-00a6-4d4d-982f-b0f99c6f2f6f req-56939555-1c9c-4dfb-97e1-0f337f4bcfba service nova] Releasing lock "refresh_cache-b9ede44b-eef5-473f-a279-8166a442a45d" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:38:55 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:38:55 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:38:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:38:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:38:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:38:55 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:38:55 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:38:55 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:38:55 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:38:55 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:38:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:38:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:38:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:38:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:38:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:38:56 user nova-compute[72766]: DEBUG nova.compute.manager [req-44ec24d3-a00d-4803-9120-7ddf655807db req-96d028ad-c9df-40e7-b50d-cb8fc04564e3 service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Received event network-vif-plugged-69550d14-e1fb-4c2e-9526-19cae208fd08 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:38:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-44ec24d3-a00d-4803-9120-7ddf655807db req-96d028ad-c9df-40e7-b50d-cb8fc04564e3 service nova] Acquiring lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:38:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-44ec24d3-a00d-4803-9120-7ddf655807db req-96d028ad-c9df-40e7-b50d-cb8fc04564e3 service nova] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:38:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-44ec24d3-a00d-4803-9120-7ddf655807db req-96d028ad-c9df-40e7-b50d-cb8fc04564e3 service nova] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:38:56 user nova-compute[72766]: DEBUG nova.compute.manager [req-44ec24d3-a00d-4803-9120-7ddf655807db req-96d028ad-c9df-40e7-b50d-cb8fc04564e3 service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] No waiting events found dispatching network-vif-plugged-69550d14-e1fb-4c2e-9526-19cae208fd08 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:38:56 user nova-compute[72766]: WARNING nova.compute.manager [req-44ec24d3-a00d-4803-9120-7ddf655807db req-96d028ad-c9df-40e7-b50d-cb8fc04564e3 service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Received unexpected event network-vif-plugged-69550d14-e1fb-4c2e-9526-19cae208fd08 for instance with vm_state building and task_state spawning.
Aug 14 23:38:56 user nova-compute[72766]: DEBUG nova.compute.manager [req-44ec24d3-a00d-4803-9120-7ddf655807db req-96d028ad-c9df-40e7-b50d-cb8fc04564e3 service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Received event network-vif-plugged-69550d14-e1fb-4c2e-9526-19cae208fd08 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:38:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-44ec24d3-a00d-4803-9120-7ddf655807db req-96d028ad-c9df-40e7-b50d-cb8fc04564e3 service nova] Acquiring lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:38:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-44ec24d3-a00d-4803-9120-7ddf655807db req-96d028ad-c9df-40e7-b50d-cb8fc04564e3 service nova] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:38:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-44ec24d3-a00d-4803-9120-7ddf655807db req-96d028ad-c9df-40e7-b50d-cb8fc04564e3 service nova] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:38:56 user nova-compute[72766]: DEBUG nova.compute.manager [req-44ec24d3-a00d-4803-9120-7ddf655807db req-96d028ad-c9df-40e7-b50d-cb8fc04564e3 service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] No waiting events found dispatching network-vif-plugged-69550d14-e1fb-4c2e-9526-19cae208fd08 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:38:56 user nova-compute[72766]: WARNING nova.compute.manager [req-44ec24d3-a00d-4803-9120-7ddf655807db req-96d028ad-c9df-40e7-b50d-cb8fc04564e3 service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Received unexpected event network-vif-plugged-69550d14-e1fb-4c2e-9526-19cae208fd08 for instance with vm_state building and task_state spawning.
Aug 14 23:38:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:38:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:38:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:38:57 user nova-compute[72766]: DEBUG nova.compute.manager [req-5cc2479b-e23c-429e-8bb1-32ab64442714 req-9a8364af-582f-433f-8320-a5f5e869415c service nova] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Received event network-vif-plugged-02fed6c3-ea8a-4fd6-a404-29ea7c038c6a {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:38:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-5cc2479b-e23c-429e-8bb1-32ab64442714 req-9a8364af-582f-433f-8320-a5f5e869415c service nova] Acquiring lock "b9ede44b-eef5-473f-a279-8166a442a45d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:38:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-5cc2479b-e23c-429e-8bb1-32ab64442714 req-9a8364af-582f-433f-8320-a5f5e869415c service nova] Lock "b9ede44b-eef5-473f-a279-8166a442a45d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:38:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-5cc2479b-e23c-429e-8bb1-32ab64442714 req-9a8364af-582f-433f-8320-a5f5e869415c service nova] Lock "b9ede44b-eef5-473f-a279-8166a442a45d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:38:57 user nova-compute[72766]: DEBUG nova.compute.manager [req-5cc2479b-e23c-429e-8bb1-32ab64442714 req-9a8364af-582f-433f-8320-a5f5e869415c service nova] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] No waiting events found dispatching network-vif-plugged-02fed6c3-ea8a-4fd6-a404-29ea7c038c6a {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:38:57 user nova-compute[72766]: WARNING nova.compute.manager [req-5cc2479b-e23c-429e-8bb1-32ab64442714 req-9a8364af-582f-433f-8320-a5f5e869415c service nova] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Received unexpected event network-vif-plugged-02fed6c3-ea8a-4fd6-a404-29ea7c038c6a for instance with vm_state building and task_state spawning.
Aug 14 23:38:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:38:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:38:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:38:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:38:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:38:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:38:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:38:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:38:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:38:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:38:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0dad81-3f3a-4548-a267-1ba13cd65dff/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:38:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0dad81-3f3a-4548-a267-1ba13cd65dff/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:38:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0dad81-3f3a-4548-a267-1ba13cd65dff/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:38:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0dad81-3f3a-4548-a267-1ba13cd65dff/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:38:58 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:38:59 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692056339.1218035, 2262995c-232a-4bfd-b8f4-c83b24c12f62 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:38:59 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] VM Resumed (Lifecycle Event)
Aug 14 23:38:59 user nova-compute[72766]: DEBUG nova.compute.manager [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:38:59 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 23:38:59 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Instance spawned successfully.
Aug 14 23:38:59 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 23:38:59 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:38:59 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:38:59 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=8649MB free_disk=25.272823333740234GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:38:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:38:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:38:59 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:38:59 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:38:59 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:38:59 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:38:59 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:38:59 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:38:59 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:38:59 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:38:59 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:38:59 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692056339.1234496, 2262995c-232a-4bfd-b8f4-c83b24c12f62 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:38:59 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] VM Started (Lifecycle Event)
Aug 14 23:38:59 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:38:59 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:38:59 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:38:59 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 23:38:59 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Instance spawned successfully.
Aug 14 23:38:59 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 23:38:59 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance fe0dad81-3f3a-4548-a267-1ba13cd65dff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:38:59 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 2262995c-232a-4bfd-b8f4-c83b24c12f62 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:38:59 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance b9ede44b-eef5-473f-a279-8166a442a45d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:38:59 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:38:59 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:38:59 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:38:59 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:38:59 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:38:59 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:38:59 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:38:59 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:38:59 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:38:59 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692056339.2224262, b9ede44b-eef5-473f-a279-8166a442a45d => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:38:59 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] VM Resumed (Lifecycle Event)
Aug 14 23:38:59 user nova-compute[72766]: INFO nova.compute.manager [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Took 7.24 seconds to spawn the instance on the hypervisor.
Aug 14 23:38:59 user nova-compute[72766]: DEBUG nova.compute.manager [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:38:59 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:38:59 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:38:59 user nova-compute[72766]: DEBUG nova.compute.manager [req-66e6d608-637f-4d32-9b3d-68ac778be5e2 req-bc8f1509-b187-4b04-9978-02a0e7445850 service nova] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Received event network-vif-plugged-02fed6c3-ea8a-4fd6-a404-29ea7c038c6a {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:38:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-66e6d608-637f-4d32-9b3d-68ac778be5e2 req-bc8f1509-b187-4b04-9978-02a0e7445850 service nova] Acquiring lock "b9ede44b-eef5-473f-a279-8166a442a45d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:38:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-66e6d608-637f-4d32-9b3d-68ac778be5e2 req-bc8f1509-b187-4b04-9978-02a0e7445850 service nova] Lock "b9ede44b-eef5-473f-a279-8166a442a45d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:38:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-66e6d608-637f-4d32-9b3d-68ac778be5e2 req-bc8f1509-b187-4b04-9978-02a0e7445850 service nova] Lock "b9ede44b-eef5-473f-a279-8166a442a45d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:38:59 user nova-compute[72766]: DEBUG nova.compute.manager [req-66e6d608-637f-4d32-9b3d-68ac778be5e2 req-bc8f1509-b187-4b04-9978-02a0e7445850 service nova] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] No waiting events found dispatching network-vif-plugged-02fed6c3-ea8a-4fd6-a404-29ea7c038c6a {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:38:59 user nova-compute[72766]: WARNING nova.compute.manager [req-66e6d608-637f-4d32-9b3d-68ac778be5e2 req-bc8f1509-b187-4b04-9978-02a0e7445850 service nova] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Received unexpected event network-vif-plugged-02fed6c3-ea8a-4fd6-a404-29ea7c038c6a for instance with vm_state building and task_state spawning.
Aug 14 23:38:59 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:38:59 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692056339.223217, b9ede44b-eef5-473f-a279-8166a442a45d => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:38:59 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] VM Started (Lifecycle Event)
Aug 14 23:38:59 user nova-compute[72766]: INFO nova.compute.manager [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Took 6.27 seconds to spawn the instance on the hypervisor.
Aug 14 23:38:59 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:38:59 user nova-compute[72766]: INFO nova.compute.manager [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Took 8.27 seconds to build instance.
Aug 14 23:38:59 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:38:59 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:38:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-2ef800ac-233c-456e-bb0f-3b147b4811e7 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.372s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:38:59 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:38:59 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:38:59 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:38:59 user nova-compute[72766]: INFO nova.compute.manager [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Took 6.88 seconds to build instance.
Aug 14 23:38:59 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:38:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.341s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:38:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c350a98c-1f19-49a3-bb0f-b3ba8366bbfa tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "b9ede44b-eef5-473f-a279-8166a442a45d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.021s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:38:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:38:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:39:04 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:39:04 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:39:04 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:39:04 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:39:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:39:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:39:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-16b8e9eb-e6dd-4ff6-9ae3-da8be6de0e11 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Acquiring lock "fe0dad81-3f3a-4548-a267-1ba13cd65dff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:39:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-16b8e9eb-e6dd-4ff6-9ae3-da8be6de0e11 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "fe0dad81-3f3a-4548-a267-1ba13cd65dff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:39:06 user nova-compute[72766]: INFO nova.compute.manager [None req-16b8e9eb-e6dd-4ff6-9ae3-da8be6de0e11 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Detaching volume c350e5f3-d815-4ab4-ac05-36c7dace2dc2
Aug 14 23:39:06 user nova-compute[72766]: INFO nova.virt.block_device [None req-16b8e9eb-e6dd-4ff6-9ae3-da8be6de0e11 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Attempting to driver detach volume c350e5f3-d815-4ab4-ac05-36c7dace2dc2 from mountpoint /dev/vdb
Aug 14 23:39:06 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-16b8e9eb-e6dd-4ff6-9ae3-da8be6de0e11 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Attempting to detach device vdb from instance fe0dad81-3f3a-4548-a267-1ba13cd65dff from the persistent domain config. {{(pid=72766) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 23:39:06 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-16b8e9eb-e6dd-4ff6-9ae3-da8be6de0e11 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 23:39:06 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:39:06 user nova-compute[72766]:   <source dev="/dev/sdb"/>
Aug 14 23:39:06 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:39:06 user nova-compute[72766]:   <serial>c350e5f3-d815-4ab4-ac05-36c7dace2dc2</serial>
Aug 14 23:39:06 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 23:39:06 user nova-compute[72766]: </disk>
Aug 14 23:39:06 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 23:39:06 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-16b8e9eb-e6dd-4ff6-9ae3-da8be6de0e11 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Successfully detached device vdb from instance fe0dad81-3f3a-4548-a267-1ba13cd65dff from the persistent domain config.
Aug 14 23:39:06 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-16b8e9eb-e6dd-4ff6-9ae3-da8be6de0e11 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fe0dad81-3f3a-4548-a267-1ba13cd65dff from the live domain config. {{(pid=72766) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 23:39:06 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-16b8e9eb-e6dd-4ff6-9ae3-da8be6de0e11 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 23:39:06 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:39:06 user nova-compute[72766]:   <source dev="/dev/sdb"/>
Aug 14 23:39:06 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:39:06 user nova-compute[72766]:   <serial>c350e5f3-d815-4ab4-ac05-36c7dace2dc2</serial>
Aug 14 23:39:06 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 23:39:06 user nova-compute[72766]: </disk>
Aug 14 23:39:06 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 23:39:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d72b5fd0-59c2-4b74-be0a-25e76f375591 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Acquiring lock "fe0dad81-3f3a-4548-a267-1ba13cd65dff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:39:06 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Received event <DeviceRemovedEvent: 1692056346.8251479, fe0dad81-3f3a-4548-a267-1ba13cd65dff => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72766) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 23:39:06 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-16b8e9eb-e6dd-4ff6-9ae3-da8be6de0e11 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fe0dad81-3f3a-4548-a267-1ba13cd65dff {{(pid=72766) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 23:39:06 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-16b8e9eb-e6dd-4ff6-9ae3-da8be6de0e11 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Successfully detached device vdb from instance fe0dad81-3f3a-4548-a267-1ba13cd65dff from the live domain config.
Aug 14 23:39:06 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16b8e9eb-e6dd-4ff6-9ae3-da8be6de0e11 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:39:06 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b8e9eb-e6dd-4ff6-9ae3-da8be6de0e11 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'acbtZQxq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:39:06 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-16b8e9eb-e6dd-4ff6-9ae3-da8be6de0e11 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:39:06 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-16b8e9eb-e6dd-4ff6-9ae3-da8be6de0e11 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:39:06 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-16b8e9eb-e6dd-4ff6-9ae3-da8be6de0e11 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:39:06 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b8e9eb-e6dd-4ff6-9ae3-da8be6de0e11 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:39:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:39:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:39:06 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ead9e5c-a5dc-4fb4-bf46-24b70714f71e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:39:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:39:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:39:06 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a72e58-17e9-49ad-837c-3658babc7b38]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:39:06 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b8e9eb-e6dd-4ff6-9ae3-da8be6de0e11 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2 (non-flash)
Aug 14 23:39:06 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:39:06 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b8e9eb-e6dd-4ff6-9ae3-da8be6de0e11 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2 (non-flash)
Aug 14 23:39:06 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:39:06 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b8e9eb-e6dd-4ff6-9ae3-da8be6de0e11 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff154348e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2'): ({'sdb'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:39:06 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-16b8e9eb-e6dd-4ff6-9ae3-da8be6de0e11 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Removing single pathed devices sdb {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:39:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:39:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:39:06 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e06f754-2599-4b1a-ab1a-0663df248c2b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:39:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:39:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:39:06 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fc0b06-3726-4080-a7e7-31593a663762]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:39:06 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-16b8e9eb-e6dd-4ff6-9ae3-da8be6de0e11 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Flushing IO for device /dev/sdb {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:39:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:39:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:39:06 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54dd11c-09ad-426c-9fc7-23e7f4cef127]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:39:06 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-16b8e9eb-e6dd-4ff6-9ae3-da8be6de0e11 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:39:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:39:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:39:07 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[3928d731-120a-4a43-997d-171c07452ae1]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:39:07 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-16b8e9eb-e6dd-4ff6-9ae3-da8be6de0e11 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:39:07 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-16b8e9eb-e6dd-4ff6-9ae3-da8be6de0e11 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] SCSI volumes sdb have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:39:07 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b8e9eb-e6dd-4ff6-9ae3-da8be6de0e11 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:39:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:39:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:39:07 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[10883842-6ce2-43dc-a32d-252785e64992]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:39:07 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b8e9eb-e6dd-4ff6-9ae3-da8be6de0e11 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:39:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2 -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:39:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:39:07 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3d3ae1-e5be-4963-a82e-f2b645449c30]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:39:07 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b8e9eb-e6dd-4ff6-9ae3-da8be6de0e11 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2, portal: 172.16.0.220,3260]
Aug 14 23:39:07 user nova-compute[72766]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2, portal: 172.16.0.220,3260] successful.
Aug 14 23:39:07 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:39:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2 -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:39:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:39:07 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4615753a-2626-4966-a966-947738f33570]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:39:07 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b8e9eb-e6dd-4ff6-9ae3-da8be6de0e11 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:39:07 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-16b8e9eb-e6dd-4ff6-9ae3-da8be6de0e11 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:39:07 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b8e9eb-e6dd-4ff6-9ae3-da8be6de0e11 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] <== disconnect_volume: return (269ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:39:07 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16b8e9eb-e6dd-4ff6-9ae3-da8be6de0e11 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:39:07 user nova-compute[72766]: DEBUG nova.objects.instance [None req-16b8e9eb-e6dd-4ff6-9ae3-da8be6de0e11 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lazy-loading 'flavor' on Instance uuid fe0dad81-3f3a-4548-a267-1ba13cd65dff {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:39:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-16b8e9eb-e6dd-4ff6-9ae3-da8be6de0e11 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "fe0dad81-3f3a-4548-a267-1ba13cd65dff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.616s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:39:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d72b5fd0-59c2-4b74-be0a-25e76f375591 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "fe0dad81-3f3a-4548-a267-1ba13cd65dff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.442s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:39:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d72b5fd0-59c2-4b74-be0a-25e76f375591 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Acquiring lock "fe0dad81-3f3a-4548-a267-1ba13cd65dff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:39:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d72b5fd0-59c2-4b74-be0a-25e76f375591 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "fe0dad81-3f3a-4548-a267-1ba13cd65dff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:39:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d72b5fd0-59c2-4b74-be0a-25e76f375591 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "fe0dad81-3f3a-4548-a267-1ba13cd65dff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:39:07 user nova-compute[72766]: INFO nova.compute.manager [None req-d72b5fd0-59c2-4b74-be0a-25e76f375591 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Terminating instance
Aug 14 23:39:07 user nova-compute[72766]: DEBUG nova.compute.manager [None req-d72b5fd0-59c2-4b74-be0a-25e76f375591 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:39:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:39:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:39:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:39:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:39:08 user nova-compute[72766]: DEBUG nova.compute.manager [req-a6458768-99c4-4e4a-a8bd-cdc267159a6f req-3174d3aa-b4a3-4a56-a962-b1a35d24d751 service nova] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Received event network-vif-unplugged-cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:39:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a6458768-99c4-4e4a-a8bd-cdc267159a6f req-3174d3aa-b4a3-4a56-a962-b1a35d24d751 service nova] Acquiring lock "fe0dad81-3f3a-4548-a267-1ba13cd65dff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:39:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a6458768-99c4-4e4a-a8bd-cdc267159a6f req-3174d3aa-b4a3-4a56-a962-b1a35d24d751 service nova] Lock "fe0dad81-3f3a-4548-a267-1ba13cd65dff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:39:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a6458768-99c4-4e4a-a8bd-cdc267159a6f req-3174d3aa-b4a3-4a56-a962-b1a35d24d751 service nova] Lock "fe0dad81-3f3a-4548-a267-1ba13cd65dff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:39:08 user nova-compute[72766]: DEBUG nova.compute.manager [req-a6458768-99c4-4e4a-a8bd-cdc267159a6f req-3174d3aa-b4a3-4a56-a962-b1a35d24d751 service nova] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] No waiting events found dispatching network-vif-unplugged-cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:39:08 user nova-compute[72766]: DEBUG nova.compute.manager [req-a6458768-99c4-4e4a-a8bd-cdc267159a6f req-3174d3aa-b4a3-4a56-a962-b1a35d24d751 service nova] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Received event network-vif-unplugged-cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:39:08 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Instance destroyed successfully.
Aug 14 23:39:08 user nova-compute[72766]: DEBUG nova.objects.instance [None req-d72b5fd0-59c2-4b74-be0a-25e76f375591 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lazy-loading 'resources' on Instance uuid fe0dad81-3f3a-4548-a267-1ba13cd65dff {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:39:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-d72b5fd0-59c2-4b74-be0a-25e76f375591 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:36:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2000256122',display_name='tempest-VolumesSnapshotTestJSON-instance-2000256122',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2000256122',id=48,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvzlCYfXAlqXGAaQK5MEVx23UbZS0McJw4PGZfmLOfuxG1lsznOSid32/TvP//0iq9feyQRlNaoiffQBc0/KiwNgh0u5QG0zyWo/WyYfTQ2uS2ORoCRD6mtV9n2yKFEuw==',key_name='tempest-keypair-652823648',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:36:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='30bfb5a00552451195ed2aa91d218c8f',ramdisk_id='',reservation_id='r-jnlgee37',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1614321126',owner_user_name='tempest-VolumesSnapshotTestJSON-1614321126-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:36:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dffd02cd8106437e8a9e4ab035bd4201',uuid=fe0dad81-3f3a-4548-a267-1ba13cd65dff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a", "address": "fa:16:3e:80:76:8c", "network": {"id": "ac53cc42-a36b-4e59-a831-e240513cd6da", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-912624616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30bfb5a00552451195ed2aa91d218c8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf3a48f2-15", "ovs_interfaceid": "cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:39:08 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-d72b5fd0-59c2-4b74-be0a-25e76f375591 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Converting VIF {"id": "cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a", "address": "fa:16:3e:80:76:8c", "network": {"id": "ac53cc42-a36b-4e59-a831-e240513cd6da", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-912624616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30bfb5a00552451195ed2aa91d218c8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf3a48f2-15", "ovs_interfaceid": "cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:39:08 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-d72b5fd0-59c2-4b74-be0a-25e76f375591 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:76:8c,bridge_name='br-int',has_traffic_filtering=True,id=cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a,network=Network(ac53cc42-a36b-4e59-a831-e240513cd6da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf3a48f2-15') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:39:08 user nova-compute[72766]: DEBUG os_vif [None req-d72b5fd0-59c2-4b74-be0a-25e76f375591 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:76:8c,bridge_name='br-int',has_traffic_filtering=True,id=cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a,network=Network(ac53cc42-a36b-4e59-a831-e240513cd6da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf3a48f2-15') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:39:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:39:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf3a48f2-15, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:39:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:39:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:39:08 user nova-compute[72766]: INFO os_vif [None req-d72b5fd0-59c2-4b74-be0a-25e76f375591 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:76:8c,bridge_name='br-int',has_traffic_filtering=True,id=cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a,network=Network(ac53cc42-a36b-4e59-a831-e240513cd6da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf3a48f2-15')
Aug 14 23:39:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d72b5fd0-59c2-4b74-be0a-25e76f375591 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:39:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72b5fd0-59c2-4b74-be0a-25e76f375591 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'acbtZQxq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:39:08 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-d72b5fd0-59c2-4b74-be0a-25e76f375591 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:39:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-d72b5fd0-59c2-4b74-be0a-25e76f375591 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:39:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-d72b5fd0-59c2-4b74-be0a-25e76f375591 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:39:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72b5fd0-59c2-4b74-be0a-25e76f375591 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c350e5f3-d815-4ab4-ac05-36c7dace2dc2', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:39:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:39:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 21 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:39:08 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c5e6ad-9b8c-4ed3-ab5f-024a2e0bad26]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:39:08 user nova-compute[72766]: WARNING os_brick.initiator.connectors.iscsi [None req-d72b5fd0-59c2-4b74-be0a-25e76f375591 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Couldn't find iSCSI nodes because iscsiadm err: iscsiadm: No records found
Aug 14 23:39:08 user nova-compute[72766]: 
Aug 14 23:39:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:39:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:39:08 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[425ef519-5096-49ee-900d-c9f57f654ed7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:39:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72b5fd0-59c2-4b74-be0a-25e76f375591 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 23:39:08 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:39:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72b5fd0-59c2-4b74-be0a-25e76f375591 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 23:39:08 user nova-compute[72766]:  {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:39:08 user nova-compute[72766]: WARNING os_brick.initiator.connectors.iscsi [None req-d72b5fd0-59c2-4b74-be0a-25e76f375591 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 23:39:08 user nova-compute[72766]: 
Aug 14 23:39:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72b5fd0-59c2-4b74-be0a-25e76f375591 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff15430ecb0>, {}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:39:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72b5fd0-59c2-4b74-be0a-25e76f375591 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Disconnecting from: [] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:39:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-d72b5fd0-59c2-4b74-be0a-25e76f375591 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.043s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:39:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72b5fd0-59c2-4b74-be0a-25e76f375591 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] <== disconnect_volume: return (44ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:39:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d72b5fd0-59c2-4b74-be0a-25e76f375591 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:39:08 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-d72b5fd0-59c2-4b74-be0a-25e76f375591 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Deleting instance files /opt/stack/data/nova/instances/fe0dad81-3f3a-4548-a267-1ba13cd65dff_del
Aug 14 23:39:08 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-d72b5fd0-59c2-4b74-be0a-25e76f375591 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Deletion of /opt/stack/data/nova/instances/fe0dad81-3f3a-4548-a267-1ba13cd65dff_del complete
Aug 14 23:39:08 user nova-compute[72766]: INFO nova.compute.manager [None req-d72b5fd0-59c2-4b74-be0a-25e76f375591 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 14 23:39:08 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-d72b5fd0-59c2-4b74-be0a-25e76f375591 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:39:08 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:39:08 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:39:09 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:39:09 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Took 0.96 seconds to deallocate network for instance.
Aug 14 23:39:09 user nova-compute[72766]: WARNING nova.volume.cinder [None req-d72b5fd0-59c2-4b74-be0a-25e76f375591 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Attachment b4349a47-2e1f-458c-a1f2-d2e1a5c7a31d does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = b4349a47-2e1f-458c-a1f2-d2e1a5c7a31d. (HTTP 404) (Request-ID: req-3f39deb9-817a-49e2-ac0f-ff716b9c0438)
Aug 14 23:39:09 user nova-compute[72766]: INFO nova.compute.manager [None req-d72b5fd0-59c2-4b74-be0a-25e76f375591 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Took 0.03 seconds to detach 1 volumes for instance.
Aug 14 23:39:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d72b5fd0-59c2-4b74-be0a-25e76f375591 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:39:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d72b5fd0-59c2-4b74-be0a-25e76f375591 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:39:10 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-d72b5fd0-59c2-4b74-be0a-25e76f375591 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:39:10 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-d72b5fd0-59c2-4b74-be0a-25e76f375591 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:39:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d72b5fd0-59c2-4b74-be0a-25e76f375591 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.202s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:39:10 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-d72b5fd0-59c2-4b74-be0a-25e76f375591 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Deleted allocations for instance fe0dad81-3f3a-4548-a267-1ba13cd65dff
Aug 14 23:39:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d72b5fd0-59c2-4b74-be0a-25e76f375591 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "fe0dad81-3f3a-4548-a267-1ba13cd65dff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.312s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:39:10 user nova-compute[72766]: DEBUG nova.compute.manager [req-687b945f-77de-48fc-95eb-ae3b222c9ee4 req-e1154d79-46e1-4411-afe6-eac0908ad524 service nova] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Received event network-vif-plugged-cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:39:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-687b945f-77de-48fc-95eb-ae3b222c9ee4 req-e1154d79-46e1-4411-afe6-eac0908ad524 service nova] Acquiring lock "fe0dad81-3f3a-4548-a267-1ba13cd65dff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:39:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-687b945f-77de-48fc-95eb-ae3b222c9ee4 req-e1154d79-46e1-4411-afe6-eac0908ad524 service nova] Lock "fe0dad81-3f3a-4548-a267-1ba13cd65dff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:39:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-687b945f-77de-48fc-95eb-ae3b222c9ee4 req-e1154d79-46e1-4411-afe6-eac0908ad524 service nova] Lock "fe0dad81-3f3a-4548-a267-1ba13cd65dff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:39:10 user nova-compute[72766]: DEBUG nova.compute.manager [req-687b945f-77de-48fc-95eb-ae3b222c9ee4 req-e1154d79-46e1-4411-afe6-eac0908ad524 service nova] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] No waiting events found dispatching network-vif-plugged-cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:39:10 user nova-compute[72766]: WARNING nova.compute.manager [req-687b945f-77de-48fc-95eb-ae3b222c9ee4 req-e1154d79-46e1-4411-afe6-eac0908ad524 service nova] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Received unexpected event network-vif-plugged-cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a for instance with vm_state deleted and task_state None.
Aug 14 23:39:10 user nova-compute[72766]: DEBUG nova.compute.manager [req-687b945f-77de-48fc-95eb-ae3b222c9ee4 req-e1154d79-46e1-4411-afe6-eac0908ad524 service nova] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Received event network-vif-deleted-cf3a48f2-1571-4e63-8d0d-3e3546b1ca6a {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:39:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:39:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:39:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:39:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:39:23 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692056348.6864588, fe0dad81-3f3a-4548-a267-1ba13cd65dff => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:39:23 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] VM Stopped (Lifecycle Event)
Aug 14 23:39:23 user nova-compute[72766]: DEBUG nova.compute.manager [None req-a2b14f70-bfd2-41b8-884d-ba8ca73e0a10 None None] [instance: fe0dad81-3f3a-4548-a267-1ba13cd65dff] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:39:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:39:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:39:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:39:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:39:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:39:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:39:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:39:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:39:47 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:39:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:39:52 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:39:53 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:39:53 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:39:53 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Rebuilding the list of instances to heal {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 23:39:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:39:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-2262995c-232a-4bfd-b8f4-c83b24c12f62" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:39:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-2262995c-232a-4bfd-b8f4-c83b24c12f62" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:39:53 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:39:53 user nova-compute[72766]: DEBUG nova.objects.instance [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lazy-loading 'info_cache' on Instance uuid 2262995c-232a-4bfd-b8f4-c83b24c12f62 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:39:54 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Updating instance_info_cache with network_info: [{"id": "69550d14-e1fb-4c2e-9526-19cae208fd08", "address": "fa:16:3e:bd:82:2f", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69550d14-e1", "ovs_interfaceid": "69550d14-e1fb-4c2e-9526-19cae208fd08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:39:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-2262995c-232a-4bfd-b8f4-c83b24c12f62" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:39:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:39:54 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:39:55 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:39:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:39:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:39:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:39:55 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:39:55 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:39:55 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:39:55 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:39:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:39:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:39:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:39:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:39:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:39:56 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:39:56 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:39:56 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=8605MB free_disk=25.243148803710938GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:39:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:39:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:39:57 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 2262995c-232a-4bfd-b8f4-c83b24c12f62 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:39:57 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance b9ede44b-eef5-473f-a279-8166a442a45d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:39:57 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:39:57 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:39:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:39:57 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:39:57 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:39:57 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:39:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.232s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:39:58 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:39:58 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:39:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:40:01 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:40:01 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:40:01 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:40:01 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:40:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:40:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:40:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:40:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:40:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:40:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Acquiring lock "79fc46e4-1245-49b9-a2ff-6ec857d15713" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:40:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "79fc46e4-1245-49b9-a2ff-6ec857d15713" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:40:26 user nova-compute[72766]: DEBUG nova.compute.manager [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 23:40:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:40:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:40:26 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 23:40:26 user nova-compute[72766]: INFO nova.compute.claims [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Claim successful on node user
Aug 14 23:40:26 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:40:26 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:40:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.268s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:40:26 user nova-compute[72766]: DEBUG nova.compute.manager [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 23:40:26 user nova-compute[72766]: DEBUG nova.compute.manager [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 23:40:26 user nova-compute[72766]: DEBUG nova.network.neutron [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 23:40:26 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 23:40:26 user nova-compute[72766]: DEBUG nova.compute.manager [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 23:40:26 user nova-compute[72766]: DEBUG nova.policy [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dffd02cd8106437e8a9e4ab035bd4201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30bfb5a00552451195ed2aa91d218c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 23:40:26 user nova-compute[72766]: DEBUG nova.compute.manager [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 23:40:26 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 23:40:26 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Creating image(s)
Aug 14 23:40:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Acquiring lock "/opt/stack/data/nova/instances/79fc46e4-1245-49b9-a2ff-6ec857d15713/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:40:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "/opt/stack/data/nova/instances/79fc46e4-1245-49b9-a2ff-6ec857d15713/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:40:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "/opt/stack/data/nova/instances/79fc46e4-1245-49b9-a2ff-6ec857d15713/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:40:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:40:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.192s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:40:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Acquiring lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:40:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:40:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:40:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.176s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:40:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/79fc46e4-1245-49b9-a2ff-6ec857d15713/disk 1073741824 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:40:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/79fc46e4-1245-49b9-a2ff-6ec857d15713/disk 1073741824" returned: 0 in 0.058s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:40:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:40:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:40:27 user nova-compute[72766]: DEBUG nova.network.neutron [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Successfully created port: 5e98e3de-0b7e-4228-a692-bcfb144878d7 {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 23:40:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.192s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:40:27 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Checking if we can resize image /opt/stack/data/nova/instances/79fc46e4-1245-49b9-a2ff-6ec857d15713/disk. size=1073741824 {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 23:40:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79fc46e4-1245-49b9-a2ff-6ec857d15713/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:40:27 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79fc46e4-1245-49b9-a2ff-6ec857d15713/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:40:27 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Cannot resize image /opt/stack/data/nova/instances/79fc46e4-1245-49b9-a2ff-6ec857d15713/disk to a smaller size. {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 23:40:27 user nova-compute[72766]: DEBUG nova.objects.instance [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lazy-loading 'migration_context' on Instance uuid 79fc46e4-1245-49b9-a2ff-6ec857d15713 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:40:27 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 23:40:27 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Ensure instance console log exists: /opt/stack/data/nova/instances/79fc46e4-1245-49b9-a2ff-6ec857d15713/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 23:40:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:40:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:40:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG nova.network.neutron [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Successfully updated port: 5e98e3de-0b7e-4228-a692-bcfb144878d7 {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Acquiring lock "refresh_cache-79fc46e4-1245-49b9-a2ff-6ec857d15713" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Acquired lock "refresh_cache-79fc46e4-1245-49b9-a2ff-6ec857d15713" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG nova.network.neutron [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG nova.compute.manager [req-5845ea2c-0d1f-4b1d-a559-362172d530b4 req-c06f2818-95f2-4489-8677-2759e934d97b service nova] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Received event network-changed-5e98e3de-0b7e-4228-a692-bcfb144878d7 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG nova.compute.manager [req-5845ea2c-0d1f-4b1d-a559-362172d530b4 req-c06f2818-95f2-4489-8677-2759e934d97b service nova] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Refreshing instance network info cache due to event network-changed-5e98e3de-0b7e-4228-a692-bcfb144878d7. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-5845ea2c-0d1f-4b1d-a559-362172d530b4 req-c06f2818-95f2-4489-8677-2759e934d97b service nova] Acquiring lock "refresh_cache-79fc46e4-1245-49b9-a2ff-6ec857d15713" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG nova.network.neutron [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG nova.network.neutron [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Updating instance_info_cache with network_info: [{"id": "5e98e3de-0b7e-4228-a692-bcfb144878d7", "address": "fa:16:3e:f8:43:b5", "network": {"id": "ac53cc42-a36b-4e59-a831-e240513cd6da", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-912624616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30bfb5a00552451195ed2aa91d218c8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e98e3de-0b", "ovs_interfaceid": "5e98e3de-0b7e-4228-a692-bcfb144878d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Releasing lock "refresh_cache-79fc46e4-1245-49b9-a2ff-6ec857d15713" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG nova.compute.manager [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Instance network_info: |[{"id": "5e98e3de-0b7e-4228-a692-bcfb144878d7", "address": "fa:16:3e:f8:43:b5", "network": {"id": "ac53cc42-a36b-4e59-a831-e240513cd6da", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-912624616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30bfb5a00552451195ed2aa91d218c8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e98e3de-0b", "ovs_interfaceid": "5e98e3de-0b7e-4228-a692-bcfb144878d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-5845ea2c-0d1f-4b1d-a559-362172d530b4 req-c06f2818-95f2-4489-8677-2759e934d97b service nova] Acquired lock "refresh_cache-79fc46e4-1245-49b9-a2ff-6ec857d15713" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG nova.network.neutron [req-5845ea2c-0d1f-4b1d-a559-362172d530b4 req-c06f2818-95f2-4489-8677-2759e934d97b service nova] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Refreshing network info cache for port 5e98e3de-0b7e-4228-a692-bcfb144878d7 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Start _get_guest_xml network_info=[{"id": "5e98e3de-0b7e-4228-a692-bcfb144878d7", "address": "fa:16:3e:f8:43:b5", "network": {"id": "ac53cc42-a36b-4e59-a831-e240513cd6da", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-912624616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30bfb5a00552451195ed2aa91d218c8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e98e3de-0b", "ovs_interfaceid": "5e98e3de-0b7e-4228-a692-bcfb144878d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd2900d30-2c4c-4d57-9135-d45564c0c596'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:40:28 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:40:28 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:40:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-831006203',display_name='tempest-VolumesSnapshotTestJSON-instance-831006203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-831006203',id=51,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZQdHMWMWjcdNtFRfFaP7IM66AW+1p2xApeIdxOb1uJVXf9LRgOgKXISzZacOWr1Qu50HiRmAksOq5eJ88cWRwG5u0bcmevP7wDTxJTKFhePg97T0D7jZAAr+XN43zVjw==',key_name='tempest-keypair-669452243',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30bfb5a00552451195ed2aa91d218c8f',ramdisk_id='',reservation_id='r-sw0ama90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1614321126',owner_user_name='tempest-VolumesSnapshotTestJSON-1614321126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:40:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dffd02cd8106437e8a9e4ab035bd4201',uuid=79fc46e4-1245-49b9-a2ff-6ec857d15713,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e98e3de-0b7e-4228-a692-bcfb144878d7", "address": "fa:16:3e:f8:43:b5", "network": {"id": "ac53cc42-a36b-4e59-a831-e240513cd6da", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-912624616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30bfb5a00552451195ed2aa91d218c8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e98e3de-0b", "ovs_interfaceid": "5e98e3de-0b7e-4228-a692-bcfb144878d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Converting VIF {"id": "5e98e3de-0b7e-4228-a692-bcfb144878d7", "address": "fa:16:3e:f8:43:b5", "network": {"id": "ac53cc42-a36b-4e59-a831-e240513cd6da", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-912624616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30bfb5a00552451195ed2aa91d218c8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e98e3de-0b", "ovs_interfaceid": "5e98e3de-0b7e-4228-a692-bcfb144878d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:43:b5,bridge_name='br-int',has_traffic_filtering=True,id=5e98e3de-0b7e-4228-a692-bcfb144878d7,network=Network(ac53cc42-a36b-4e59-a831-e240513cd6da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e98e3de-0b') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG nova.objects.instance [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lazy-loading 'pci_devices' on Instance uuid 79fc46e4-1245-49b9-a2ff-6ec857d15713 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:40:28 user nova-compute[72766]:   <uuid>79fc46e4-1245-49b9-a2ff-6ec857d15713</uuid>
Aug 14 23:40:28 user nova-compute[72766]:   <name>instance-00000033</name>
Aug 14 23:40:28 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:40:28 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:40:28 user nova-compute[72766]:   <metadata>
Aug 14 23:40:28 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:40:28 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:40:28 user nova-compute[72766]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-831006203</nova:name>
Aug 14 23:40:28 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:40:28</nova:creationTime>
Aug 14 23:40:28 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:40:28 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:40:28 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:40:28 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:40:28 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:40:28 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:40:28 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:40:28 user nova-compute[72766]:       <nova:owner>
Aug 14 23:40:28 user nova-compute[72766]:         <nova:user uuid="dffd02cd8106437e8a9e4ab035bd4201">tempest-VolumesSnapshotTestJSON-1614321126-project-member</nova:user>
Aug 14 23:40:28 user nova-compute[72766]:         <nova:project uuid="30bfb5a00552451195ed2aa91d218c8f">tempest-VolumesSnapshotTestJSON-1614321126</nova:project>
Aug 14 23:40:28 user nova-compute[72766]:       </nova:owner>
Aug 14 23:40:28 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 23:40:28 user nova-compute[72766]:       <nova:ports>
Aug 14 23:40:28 user nova-compute[72766]:         <nova:port uuid="5e98e3de-0b7e-4228-a692-bcfb144878d7">
Aug 14 23:40:28 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 23:40:28 user nova-compute[72766]:         </nova:port>
Aug 14 23:40:28 user nova-compute[72766]:       </nova:ports>
Aug 14 23:40:28 user nova-compute[72766]:     </nova:instance>
Aug 14 23:40:28 user nova-compute[72766]:   </metadata>
Aug 14 23:40:28 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:40:28 user nova-compute[72766]:     <system>
Aug 14 23:40:28 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:40:28 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:40:28 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:40:28 user nova-compute[72766]:       <entry name="serial">79fc46e4-1245-49b9-a2ff-6ec857d15713</entry>
Aug 14 23:40:28 user nova-compute[72766]:       <entry name="uuid">79fc46e4-1245-49b9-a2ff-6ec857d15713</entry>
Aug 14 23:40:28 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:40:28 user nova-compute[72766]:     </system>
Aug 14 23:40:28 user nova-compute[72766]:   </sysinfo>
Aug 14 23:40:28 user nova-compute[72766]:   <os>
Aug 14 23:40:28 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:40:28 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:40:28 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:40:28 user nova-compute[72766]:   </os>
Aug 14 23:40:28 user nova-compute[72766]:   <features>
Aug 14 23:40:28 user nova-compute[72766]:     <acpi/>
Aug 14 23:40:28 user nova-compute[72766]:     <apic/>
Aug 14 23:40:28 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:40:28 user nova-compute[72766]:   </features>
Aug 14 23:40:28 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:40:28 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:40:28 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:40:28 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:40:28 user nova-compute[72766]:   </clock>
Aug 14 23:40:28 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:40:28 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:40:28 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:40:28 user nova-compute[72766]:   </cpu>
Aug 14 23:40:28 user nova-compute[72766]:   <devices>
Aug 14 23:40:28 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 23:40:28 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 23:40:28 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/79fc46e4-1245-49b9-a2ff-6ec857d15713/disk"/>
Aug 14 23:40:28 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:40:28 user nova-compute[72766]:     </disk>
Aug 14 23:40:28 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:40:28 user nova-compute[72766]:       <mac address="fa:16:3e:f8:43:b5"/>
Aug 14 23:40:28 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:40:28 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:40:28 user nova-compute[72766]:       <target dev="tap5e98e3de-0b"/>
Aug 14 23:40:28 user nova-compute[72766]:     </interface>
Aug 14 23:40:28 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:40:28 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/79fc46e4-1245-49b9-a2ff-6ec857d15713/console.log" append="off"/>
Aug 14 23:40:28 user nova-compute[72766]:     </serial>
Aug 14 23:40:28 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:40:28 user nova-compute[72766]:     <video>
Aug 14 23:40:28 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:40:28 user nova-compute[72766]:     </video>
Aug 14 23:40:28 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:40:28 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:40:28 user nova-compute[72766]:     </rng>
Aug 14 23:40:28 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:40:28 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:40:28 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:40:28 user nova-compute[72766]:     </memballoon>
Aug 14 23:40:28 user nova-compute[72766]:   </devices>
Aug 14 23:40:28 user nova-compute[72766]: </domain>
Aug 14 23:40:28 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-831006203',display_name='tempest-VolumesSnapshotTestJSON-instance-831006203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-831006203',id=51,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZQdHMWMWjcdNtFRfFaP7IM66AW+1p2xApeIdxOb1uJVXf9LRgOgKXISzZacOWr1Qu50HiRmAksOq5eJ88cWRwG5u0bcmevP7wDTxJTKFhePg97T0D7jZAAr+XN43zVjw==',key_name='tempest-keypair-669452243',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30bfb5a00552451195ed2aa91d218c8f',ramdisk_id='',reservation_id='r-sw0ama90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1614321126',owner_user_name='tempest-VolumesSnapshotTestJSON-1614321126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:40:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dffd02cd8106437e8a9e4ab035bd4201',uuid=79fc46e4-1245-49b9-a2ff-6ec857d15713,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e98e3de-0b7e-4228-a692-bcfb144878d7", "address": "fa:16:3e:f8:43:b5", "network": {"id": "ac53cc42-a36b-4e59-a831-e240513cd6da", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-912624616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30bfb5a00552451195ed2aa91d218c8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e98e3de-0b", "ovs_interfaceid": "5e98e3de-0b7e-4228-a692-bcfb144878d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Converting VIF {"id": "5e98e3de-0b7e-4228-a692-bcfb144878d7", "address": "fa:16:3e:f8:43:b5", "network": {"id": "ac53cc42-a36b-4e59-a831-e240513cd6da", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-912624616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30bfb5a00552451195ed2aa91d218c8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e98e3de-0b", "ovs_interfaceid": "5e98e3de-0b7e-4228-a692-bcfb144878d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:43:b5,bridge_name='br-int',has_traffic_filtering=True,id=5e98e3de-0b7e-4228-a692-bcfb144878d7,network=Network(ac53cc42-a36b-4e59-a831-e240513cd6da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e98e3de-0b') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG os_vif [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:43:b5,bridge_name='br-int',has_traffic_filtering=True,id=5e98e3de-0b7e-4228-a692-bcfb144878d7,network=Network(ac53cc42-a36b-4e59-a831-e240513cd6da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e98e3de-0b') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e98e3de-0b, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5e98e3de-0b, col_values=(('external_ids', {'iface-id': '5e98e3de-0b7e-4228-a692-bcfb144878d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:43:b5', 'vm-uuid': '79fc46e4-1245-49b9-a2ff-6ec857d15713'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:40:28 user nova-compute[72766]: INFO os_vif [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:43:b5,bridge_name='br-int',has_traffic_filtering=True,id=5e98e3de-0b7e-4228-a692-bcfb144878d7,network=Network(ac53cc42-a36b-4e59-a831-e240513cd6da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e98e3de-0b')
Aug 14 23:40:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:40:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] No VIF found with MAC fa:16:3e:f8:43:b5, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:40:29 user nova-compute[72766]: DEBUG nova.network.neutron [req-5845ea2c-0d1f-4b1d-a559-362172d530b4 req-c06f2818-95f2-4489-8677-2759e934d97b service nova] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Updated VIF entry in instance network info cache for port 5e98e3de-0b7e-4228-a692-bcfb144878d7. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:40:29 user nova-compute[72766]: DEBUG nova.network.neutron [req-5845ea2c-0d1f-4b1d-a559-362172d530b4 req-c06f2818-95f2-4489-8677-2759e934d97b service nova] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Updating instance_info_cache with network_info: [{"id": "5e98e3de-0b7e-4228-a692-bcfb144878d7", "address": "fa:16:3e:f8:43:b5", "network": {"id": "ac53cc42-a36b-4e59-a831-e240513cd6da", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-912624616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30bfb5a00552451195ed2aa91d218c8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e98e3de-0b", "ovs_interfaceid": "5e98e3de-0b7e-4228-a692-bcfb144878d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:40:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-5845ea2c-0d1f-4b1d-a559-362172d530b4 req-c06f2818-95f2-4489-8677-2759e934d97b service nova] Releasing lock "refresh_cache-79fc46e4-1245-49b9-a2ff-6ec857d15713" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:40:30 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:40:30 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:40:30 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:40:30 user nova-compute[72766]: DEBUG nova.compute.manager [req-b0bfc9c3-6903-43d9-87a8-3d5fac188329 req-96ac1c23-9afa-40fd-b247-fb6ca9c20c54 service nova] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Received event network-vif-plugged-5e98e3de-0b7e-4228-a692-bcfb144878d7 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:40:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-b0bfc9c3-6903-43d9-87a8-3d5fac188329 req-96ac1c23-9afa-40fd-b247-fb6ca9c20c54 service nova] Acquiring lock "79fc46e4-1245-49b9-a2ff-6ec857d15713-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:40:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-b0bfc9c3-6903-43d9-87a8-3d5fac188329 req-96ac1c23-9afa-40fd-b247-fb6ca9c20c54 service nova] Lock "79fc46e4-1245-49b9-a2ff-6ec857d15713-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:40:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-b0bfc9c3-6903-43d9-87a8-3d5fac188329 req-96ac1c23-9afa-40fd-b247-fb6ca9c20c54 service nova] Lock "79fc46e4-1245-49b9-a2ff-6ec857d15713-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:40:30 user nova-compute[72766]: DEBUG nova.compute.manager [req-b0bfc9c3-6903-43d9-87a8-3d5fac188329 req-96ac1c23-9afa-40fd-b247-fb6ca9c20c54 service nova] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] No waiting events found dispatching network-vif-plugged-5e98e3de-0b7e-4228-a692-bcfb144878d7 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:40:30 user nova-compute[72766]: WARNING nova.compute.manager [req-b0bfc9c3-6903-43d9-87a8-3d5fac188329 req-96ac1c23-9afa-40fd-b247-fb6ca9c20c54 service nova] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Received unexpected event network-vif-plugged-5e98e3de-0b7e-4228-a692-bcfb144878d7 for instance with vm_state building and task_state spawning.
Aug 14 23:40:30 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:40:30 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:40:30 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:40:32 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692056432.2400377, 79fc46e4-1245-49b9-a2ff-6ec857d15713 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:40:32 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] VM Resumed (Lifecycle Event)
Aug 14 23:40:32 user nova-compute[72766]: DEBUG nova.compute.manager [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:40:32 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 23:40:32 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Instance spawned successfully.
Aug 14 23:40:32 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 23:40:32 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:40:32 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:40:32 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:40:32 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:40:32 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:40:32 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:40:32 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:40:32 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:40:32 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:40:32 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692056432.2441282, 79fc46e4-1245-49b9-a2ff-6ec857d15713 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:40:32 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] VM Started (Lifecycle Event)
Aug 14 23:40:32 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:40:32 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:40:32 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:40:32 user nova-compute[72766]: INFO nova.compute.manager [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Took 5.63 seconds to spawn the instance on the hypervisor.
Aug 14 23:40:32 user nova-compute[72766]: DEBUG nova.compute.manager [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:40:32 user nova-compute[72766]: DEBUG nova.compute.manager [req-b2a8837c-587c-42f5-9fd4-d9dafc5e784e req-7ff9ab3d-48d4-4ce1-ba92-ca95724f7ed3 service nova] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Received event network-vif-plugged-5e98e3de-0b7e-4228-a692-bcfb144878d7 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:40:32 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-b2a8837c-587c-42f5-9fd4-d9dafc5e784e req-7ff9ab3d-48d4-4ce1-ba92-ca95724f7ed3 service nova] Acquiring lock "79fc46e4-1245-49b9-a2ff-6ec857d15713-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:40:32 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-b2a8837c-587c-42f5-9fd4-d9dafc5e784e req-7ff9ab3d-48d4-4ce1-ba92-ca95724f7ed3 service nova] Lock "79fc46e4-1245-49b9-a2ff-6ec857d15713-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:40:32 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-b2a8837c-587c-42f5-9fd4-d9dafc5e784e req-7ff9ab3d-48d4-4ce1-ba92-ca95724f7ed3 service nova] Lock "79fc46e4-1245-49b9-a2ff-6ec857d15713-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:40:32 user nova-compute[72766]: DEBUG nova.compute.manager [req-b2a8837c-587c-42f5-9fd4-d9dafc5e784e req-7ff9ab3d-48d4-4ce1-ba92-ca95724f7ed3 service nova] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] No waiting events found dispatching network-vif-plugged-5e98e3de-0b7e-4228-a692-bcfb144878d7 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:40:32 user nova-compute[72766]: WARNING nova.compute.manager [req-b2a8837c-587c-42f5-9fd4-d9dafc5e784e req-7ff9ab3d-48d4-4ce1-ba92-ca95724f7ed3 service nova] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Received unexpected event network-vif-plugged-5e98e3de-0b7e-4228-a692-bcfb144878d7 for instance with vm_state building and task_state spawning.
Aug 14 23:40:32 user nova-compute[72766]: INFO nova.compute.manager [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Took 6.22 seconds to build instance.
Aug 14 23:40:32 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-158873ee-9ae1-480b-b86c-3fa363a7ad71 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "79fc46e4-1245-49b9-a2ff-6ec857d15713" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.314s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:40:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:40:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:40:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:40:42 user nova-compute[72766]: INFO nova.compute.manager [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Rescuing
Aug 14 23:40:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquiring lock "refresh_cache-b9ede44b-eef5-473f-a279-8166a442a45d" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:40:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquired lock "refresh_cache-b9ede44b-eef5-473f-a279-8166a442a45d" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:40:42 user nova-compute[72766]: DEBUG nova.network.neutron [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:40:43 user nova-compute[72766]: DEBUG nova.network.neutron [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Updating instance_info_cache with network_info: [{"id": "02fed6c3-ea8a-4fd6-a404-29ea7c038c6a", "address": "fa:16:3e:52:c1:fe", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02fed6c3-ea", "ovs_interfaceid": "02fed6c3-ea8a-4fd6-a404-29ea7c038c6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:40:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Releasing lock "refresh_cache-b9ede44b-eef5-473f-a279-8166a442a45d" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:40:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:40:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:40:43 user nova-compute[72766]: DEBUG nova.compute.manager [req-8f904ee8-6afe-42cf-acbf-d7bd8fb2fe85 req-093a31da-ad36-4866-89db-6025b1b49199 service nova] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Received event network-vif-unplugged-02fed6c3-ea8a-4fd6-a404-29ea7c038c6a {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:40:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8f904ee8-6afe-42cf-acbf-d7bd8fb2fe85 req-093a31da-ad36-4866-89db-6025b1b49199 service nova] Acquiring lock "b9ede44b-eef5-473f-a279-8166a442a45d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:40:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8f904ee8-6afe-42cf-acbf-d7bd8fb2fe85 req-093a31da-ad36-4866-89db-6025b1b49199 service nova] Lock "b9ede44b-eef5-473f-a279-8166a442a45d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:40:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8f904ee8-6afe-42cf-acbf-d7bd8fb2fe85 req-093a31da-ad36-4866-89db-6025b1b49199 service nova] Lock "b9ede44b-eef5-473f-a279-8166a442a45d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:40:43 user nova-compute[72766]: DEBUG nova.compute.manager [req-8f904ee8-6afe-42cf-acbf-d7bd8fb2fe85 req-093a31da-ad36-4866-89db-6025b1b49199 service nova] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] No waiting events found dispatching network-vif-unplugged-02fed6c3-ea8a-4fd6-a404-29ea7c038c6a {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:40:43 user nova-compute[72766]: WARNING nova.compute.manager [req-8f904ee8-6afe-42cf-acbf-d7bd8fb2fe85 req-093a31da-ad36-4866-89db-6025b1b49199 service nova] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Received unexpected event network-vif-unplugged-02fed6c3-ea8a-4fd6-a404-29ea7c038c6a for instance with vm_state active and task_state rescuing.
Aug 14 23:40:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:40:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:40:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:40:43 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Instance destroyed successfully.
Aug 14 23:40:43 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Attempting rescue
Aug 14 23:40:43 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72766) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 23:40:43 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Instance directory exists: not creating {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 23:40:43 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Creating image(s)
Aug 14 23:40:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquiring lock "/opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:40:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "/opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:40:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "/opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:40:43 user nova-compute[72766]: DEBUG nova.objects.instance [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lazy-loading 'trusted_certs' on Instance uuid b9ede44b-eef5-473f-a279-8166a442a45d {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:40:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquiring lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:40:43 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:40:43 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:40:44 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.173s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:40:44 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:40:44 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue" returned: 0 in 0.054s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:40:44 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:40:44 user nova-compute[72766]: DEBUG nova.objects.instance [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lazy-loading 'migration_context' on Instance uuid b9ede44b-eef5-473f-a279-8166a442a45d {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:40:44 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 23:40:44 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Start _get_guest_xml network_info=[{"id": "02fed6c3-ea8a-4fd6-a404-29ea7c038c6a", "address": "fa:16:3e:52:c1:fe", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "vif_mac": "fa:16:3e:52:c1:fe"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02fed6c3-ea", "ovs_interfaceid": "02fed6c3-ea8a-4fd6-a404-29ea7c038c6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd2900d30-2c4c-4d57-9135-d45564c0c596', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:40:44 user nova-compute[72766]: DEBUG nova.objects.instance [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lazy-loading 'resources' on Instance uuid b9ede44b-eef5-473f-a279-8166a442a45d {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:40:44 user nova-compute[72766]: DEBUG nova.objects.instance [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lazy-loading 'numa_topology' on Instance uuid b9ede44b-eef5-473f-a279-8166a442a45d {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:40:44 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:40:44 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:40:44 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:40:44 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:40:44 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:40:44 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:40:44 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:40:44 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:40:44 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:40:44 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:40:44 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:40:44 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:40:44 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:40:44 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:40:44 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:40:44 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:40:44 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:40:44 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:40:44 user nova-compute[72766]: DEBUG nova.objects.instance [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lazy-loading 'vcpu_model' on Instance uuid b9ede44b-eef5-473f-a279-8166a442a45d {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:40:44 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:38:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-103213439',display_name='tempest-ServerRescueNegativeTestJSON-server-103213439',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-103213439',id=50,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:38:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eaadde665b704e4d882299b7f747d7a5',ramdisk_id='',reservation_id='r-2kiiyowb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1344834449',owner_user_name='tempest-ServerRescueNegativeTestJSON-1344834449-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:38:59Z,user_data=None,user_id='4a1c0e7bd2744a349ecfef160a6f54f5',uuid=b9ede44b-eef5-473f-a279-8166a442a45d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "02fed6c3-ea8a-4fd6-a404-29ea7c038c6a", "address": "fa:16:3e:52:c1:fe", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "vif_mac": "fa:16:3e:52:c1:fe"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02fed6c3-ea", "ovs_interfaceid": "02fed6c3-ea8a-4fd6-a404-29ea7c038c6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:40:44 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Converting VIF {"id": "02fed6c3-ea8a-4fd6-a404-29ea7c038c6a", "address": "fa:16:3e:52:c1:fe", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "vif_mac": "fa:16:3e:52:c1:fe"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02fed6c3-ea", "ovs_interfaceid": "02fed6c3-ea8a-4fd6-a404-29ea7c038c6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:40:44 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:c1:fe,bridge_name='br-int',has_traffic_filtering=True,id=02fed6c3-ea8a-4fd6-a404-29ea7c038c6a,network=Network(71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02fed6c3-ea') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:40:44 user nova-compute[72766]: DEBUG nova.objects.instance [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lazy-loading 'pci_devices' on Instance uuid b9ede44b-eef5-473f-a279-8166a442a45d {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:40:44 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:40:44 user nova-compute[72766]:   <uuid>b9ede44b-eef5-473f-a279-8166a442a45d</uuid>
Aug 14 23:40:44 user nova-compute[72766]:   <name>instance-00000032</name>
Aug 14 23:40:44 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:40:44 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:40:44 user nova-compute[72766]:   <metadata>
Aug 14 23:40:44 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:40:44 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:40:44 user nova-compute[72766]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-103213439</nova:name>
Aug 14 23:40:44 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:40:44</nova:creationTime>
Aug 14 23:40:44 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:40:44 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:40:44 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:40:44 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:40:44 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:40:44 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:40:44 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:40:44 user nova-compute[72766]:       <nova:owner>
Aug 14 23:40:44 user nova-compute[72766]:         <nova:user uuid="4a1c0e7bd2744a349ecfef160a6f54f5">tempest-ServerRescueNegativeTestJSON-1344834449-project-member</nova:user>
Aug 14 23:40:44 user nova-compute[72766]:         <nova:project uuid="eaadde665b704e4d882299b7f747d7a5">tempest-ServerRescueNegativeTestJSON-1344834449</nova:project>
Aug 14 23:40:44 user nova-compute[72766]:       </nova:owner>
Aug 14 23:40:44 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 23:40:44 user nova-compute[72766]:       <nova:ports>
Aug 14 23:40:44 user nova-compute[72766]:         <nova:port uuid="02fed6c3-ea8a-4fd6-a404-29ea7c038c6a">
Aug 14 23:40:44 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 14 23:40:44 user nova-compute[72766]:         </nova:port>
Aug 14 23:40:44 user nova-compute[72766]:       </nova:ports>
Aug 14 23:40:44 user nova-compute[72766]:     </nova:instance>
Aug 14 23:40:44 user nova-compute[72766]:   </metadata>
Aug 14 23:40:44 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:40:44 user nova-compute[72766]:     <system>
Aug 14 23:40:44 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:40:44 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:40:44 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:40:44 user nova-compute[72766]:       <entry name="serial">b9ede44b-eef5-473f-a279-8166a442a45d</entry>
Aug 14 23:40:44 user nova-compute[72766]:       <entry name="uuid">b9ede44b-eef5-473f-a279-8166a442a45d</entry>
Aug 14 23:40:44 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:40:44 user nova-compute[72766]:     </system>
Aug 14 23:40:44 user nova-compute[72766]:   </sysinfo>
Aug 14 23:40:44 user nova-compute[72766]:   <os>
Aug 14 23:40:44 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:40:44 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:40:44 user nova-compute[72766]:   </os>
Aug 14 23:40:44 user nova-compute[72766]:   <features>
Aug 14 23:40:44 user nova-compute[72766]:     <acpi/>
Aug 14 23:40:44 user nova-compute[72766]:     <apic/>
Aug 14 23:40:44 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:40:44 user nova-compute[72766]:   </features>
Aug 14 23:40:44 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:40:44 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:40:44 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:40:44 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:40:44 user nova-compute[72766]:   </clock>
Aug 14 23:40:44 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:40:44 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:40:44 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:40:44 user nova-compute[72766]:   </cpu>
Aug 14 23:40:44 user nova-compute[72766]:   <devices>
Aug 14 23:40:44 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 23:40:44 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 23:40:44 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue"/>
Aug 14 23:40:44 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:40:44 user nova-compute[72766]:     </disk>
Aug 14 23:40:44 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 23:40:44 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 23:40:44 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk"/>
Aug 14 23:40:44 user nova-compute[72766]:       <target dev="vdb" bus="virtio"/>
Aug 14 23:40:44 user nova-compute[72766]:     </disk>
Aug 14 23:40:44 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:40:44 user nova-compute[72766]:       <mac address="fa:16:3e:52:c1:fe"/>
Aug 14 23:40:44 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:40:44 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:40:44 user nova-compute[72766]:       <target dev="tap02fed6c3-ea"/>
Aug 14 23:40:44 user nova-compute[72766]:     </interface>
Aug 14 23:40:44 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:40:44 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/console.log" append="off"/>
Aug 14 23:40:44 user nova-compute[72766]:     </serial>
Aug 14 23:40:44 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:40:44 user nova-compute[72766]:     <video>
Aug 14 23:40:44 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:40:44 user nova-compute[72766]:     </video>
Aug 14 23:40:44 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:40:44 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:40:44 user nova-compute[72766]:     </rng>
Aug 14 23:40:44 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:40:44 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:40:44 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:40:44 user nova-compute[72766]:     </memballoon>
Aug 14 23:40:44 user nova-compute[72766]:   </devices>
Aug 14 23:40:44 user nova-compute[72766]: </domain>
Aug 14 23:40:44 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:40:44 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Instance destroyed successfully.
Aug 14 23:40:44 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:40:44 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:40:44 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] No VIF found with MAC fa:16:3e:52:c1:fe, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:40:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:40:45 user nova-compute[72766]: DEBUG nova.compute.manager [req-27960548-7fa3-457b-a116-a868ba27bd98 req-b72c3483-fa2c-4266-910c-b73bd106b9d8 service nova] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Received event network-vif-plugged-02fed6c3-ea8a-4fd6-a404-29ea7c038c6a {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:40:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-27960548-7fa3-457b-a116-a868ba27bd98 req-b72c3483-fa2c-4266-910c-b73bd106b9d8 service nova] Acquiring lock "b9ede44b-eef5-473f-a279-8166a442a45d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:40:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-27960548-7fa3-457b-a116-a868ba27bd98 req-b72c3483-fa2c-4266-910c-b73bd106b9d8 service nova] Lock "b9ede44b-eef5-473f-a279-8166a442a45d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:40:45 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-27960548-7fa3-457b-a116-a868ba27bd98 req-b72c3483-fa2c-4266-910c-b73bd106b9d8 service nova] Lock "b9ede44b-eef5-473f-a279-8166a442a45d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:40:45 user nova-compute[72766]: DEBUG nova.compute.manager [req-27960548-7fa3-457b-a116-a868ba27bd98 req-b72c3483-fa2c-4266-910c-b73bd106b9d8 service nova] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] No waiting events found dispatching network-vif-plugged-02fed6c3-ea8a-4fd6-a404-29ea7c038c6a {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:40:45 user nova-compute[72766]: WARNING nova.compute.manager [req-27960548-7fa3-457b-a116-a868ba27bd98 req-b72c3483-fa2c-4266-910c-b73bd106b9d8 service nova] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Received unexpected event network-vif-plugged-02fed6c3-ea8a-4fd6-a404-29ea7c038c6a for instance with vm_state active and task_state rescuing.
Aug 14 23:40:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:40:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:40:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:40:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:40:47 user nova-compute[72766]: DEBUG nova.compute.manager [req-ca8a1564-cc9e-4ed4-90e7-e1dd03bc432a req-6e9c9fea-1518-4d8e-a3f5-b501b9cbdf2b service nova] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Received event network-vif-plugged-02fed6c3-ea8a-4fd6-a404-29ea7c038c6a {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:40:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ca8a1564-cc9e-4ed4-90e7-e1dd03bc432a req-6e9c9fea-1518-4d8e-a3f5-b501b9cbdf2b service nova] Acquiring lock "b9ede44b-eef5-473f-a279-8166a442a45d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:40:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ca8a1564-cc9e-4ed4-90e7-e1dd03bc432a req-6e9c9fea-1518-4d8e-a3f5-b501b9cbdf2b service nova] Lock "b9ede44b-eef5-473f-a279-8166a442a45d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:40:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ca8a1564-cc9e-4ed4-90e7-e1dd03bc432a req-6e9c9fea-1518-4d8e-a3f5-b501b9cbdf2b service nova] Lock "b9ede44b-eef5-473f-a279-8166a442a45d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:40:47 user nova-compute[72766]: DEBUG nova.compute.manager [req-ca8a1564-cc9e-4ed4-90e7-e1dd03bc432a req-6e9c9fea-1518-4d8e-a3f5-b501b9cbdf2b service nova] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] No waiting events found dispatching network-vif-plugged-02fed6c3-ea8a-4fd6-a404-29ea7c038c6a {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:40:47 user nova-compute[72766]: WARNING nova.compute.manager [req-ca8a1564-cc9e-4ed4-90e7-e1dd03bc432a req-6e9c9fea-1518-4d8e-a3f5-b501b9cbdf2b service nova] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Received unexpected event network-vif-plugged-02fed6c3-ea8a-4fd6-a404-29ea7c038c6a for instance with vm_state active and task_state rescuing.
Aug 14 23:40:47 user nova-compute[72766]: DEBUG nova.compute.manager [req-ca8a1564-cc9e-4ed4-90e7-e1dd03bc432a req-6e9c9fea-1518-4d8e-a3f5-b501b9cbdf2b service nova] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Received event network-vif-plugged-02fed6c3-ea8a-4fd6-a404-29ea7c038c6a {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:40:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ca8a1564-cc9e-4ed4-90e7-e1dd03bc432a req-6e9c9fea-1518-4d8e-a3f5-b501b9cbdf2b service nova] Acquiring lock "b9ede44b-eef5-473f-a279-8166a442a45d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:40:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ca8a1564-cc9e-4ed4-90e7-e1dd03bc432a req-6e9c9fea-1518-4d8e-a3f5-b501b9cbdf2b service nova] Lock "b9ede44b-eef5-473f-a279-8166a442a45d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:40:47 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ca8a1564-cc9e-4ed4-90e7-e1dd03bc432a req-6e9c9fea-1518-4d8e-a3f5-b501b9cbdf2b service nova] Lock "b9ede44b-eef5-473f-a279-8166a442a45d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:40:47 user nova-compute[72766]: DEBUG nova.compute.manager [req-ca8a1564-cc9e-4ed4-90e7-e1dd03bc432a req-6e9c9fea-1518-4d8e-a3f5-b501b9cbdf2b service nova] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] No waiting events found dispatching network-vif-plugged-02fed6c3-ea8a-4fd6-a404-29ea7c038c6a {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:40:47 user nova-compute[72766]: WARNING nova.compute.manager [req-ca8a1564-cc9e-4ed4-90e7-e1dd03bc432a req-6e9c9fea-1518-4d8e-a3f5-b501b9cbdf2b service nova] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Received unexpected event network-vif-plugged-02fed6c3-ea8a-4fd6-a404-29ea7c038c6a for instance with vm_state active and task_state rescuing.
Aug 14 23:40:47 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Removed pending event for b9ede44b-eef5-473f-a279-8166a442a45d due to event {{(pid=72766) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 23:40:47 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692056447.7215083, b9ede44b-eef5-473f-a279-8166a442a45d => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:40:47 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] VM Resumed (Lifecycle Event)
Aug 14 23:40:47 user nova-compute[72766]: DEBUG nova.compute.manager [None req-ac4d7006-d7c2-4630-9919-dd9efa810c18 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:40:47 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:40:47 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:40:47 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 23:40:47 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692056447.7242815, b9ede44b-eef5-473f-a279-8166a442a45d => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:40:47 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] VM Started (Lifecycle Event)
Aug 14 23:40:47 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:40:47 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:40:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:40:49 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:40:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:40:53 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:40:53 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:40:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-b9ede44b-eef5-473f-a279-8166a442a45d" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:40:53 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-b9ede44b-eef5-473f-a279-8166a442a45d" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:40:53 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:40:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:40:54 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Updating instance_info_cache with network_info: [{"id": "02fed6c3-ea8a-4fd6-a404-29ea7c038c6a", "address": "fa:16:3e:52:c1:fe", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02fed6c3-ea", "ovs_interfaceid": "02fed6c3-ea8a-4fd6-a404-29ea7c038c6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:40:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-b9ede44b-eef5-473f-a279-8166a442a45d" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:40:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:40:54 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:40:54 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:40:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:40:55 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:40:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:40:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:40:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:40:55 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:40:55 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:40:55 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:40:55 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:40:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:40:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:40:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:40:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:40:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:40:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:40:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:40:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:40:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:40:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79fc46e4-1245-49b9-a2ff-6ec857d15713/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:40:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79fc46e4-1245-49b9-a2ff-6ec857d15713/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:40:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79fc46e4-1245-49b9-a2ff-6ec857d15713/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:40:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79fc46e4-1245-49b9-a2ff-6ec857d15713/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:40:57 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:40:57 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:40:57 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=8455MB free_disk=25.21234893798828GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:40:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:40:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:40:57 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 2262995c-232a-4bfd-b8f4-c83b24c12f62 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:40:57 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance b9ede44b-eef5-473f-a279-8166a442a45d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:40:57 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 79fc46e4-1245-49b9-a2ff-6ec857d15713 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:40:57 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:40:57 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:40:57 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:40:57 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:40:57 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:40:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.246s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:40:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:40:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:40:59 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:41:02 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:41:03 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:41:03 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:41:03 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:41:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:41:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:41:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:41:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:41:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:41:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:41:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:41:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:41:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:41:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:41:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:41:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:41:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:41:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:41:50 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:41:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:41:54 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:41:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:41:54 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Rebuilding the list of instances to heal {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 23:41:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-2262995c-232a-4bfd-b8f4-c83b24c12f62" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:41:54 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-2262995c-232a-4bfd-b8f4-c83b24c12f62" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:41:54 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:41:54 user nova-compute[72766]: DEBUG nova.objects.instance [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lazy-loading 'info_cache' on Instance uuid 2262995c-232a-4bfd-b8f4-c83b24c12f62 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:41:55 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Updating instance_info_cache with network_info: [{"id": "69550d14-e1fb-4c2e-9526-19cae208fd08", "address": "fa:16:3e:bd:82:2f", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69550d14-e1", "ovs_interfaceid": "69550d14-e1fb-4c2e-9526-19cae208fd08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:41:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-2262995c-232a-4bfd-b8f4-c83b24c12f62" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:41:55 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:41:56 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:41:56 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:41:56 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:41:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:41:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:41:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:41:56 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:41:56 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:41:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:41:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:41:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:41:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:41:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:41:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:41:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:41:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:41:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:41:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:41:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:41:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79fc46e4-1245-49b9-a2ff-6ec857d15713/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:41:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79fc46e4-1245-49b9-a2ff-6ec857d15713/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:41:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79fc46e4-1245-49b9-a2ff-6ec857d15713/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:41:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79fc46e4-1245-49b9-a2ff-6ec857d15713/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:41:58 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:41:58 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:41:58 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=8569MB free_disk=25.211284637451172GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:41:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:41:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:41:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:41:58 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 2262995c-232a-4bfd-b8f4-c83b24c12f62 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:41:58 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance b9ede44b-eef5-473f-a279-8166a442a45d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:41:58 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 79fc46e4-1245-49b9-a2ff-6ec857d15713 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:41:58 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:41:58 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:41:58 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Refreshing inventories for resource provider 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 23:41:59 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Updating ProviderTree inventory for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 23:41:59 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Updating inventory in ProviderTree for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 23:41:59 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Refreshing aggregate associations for resource provider 45c8ff08-bf31-4ab6-8452-2e293102f899, aggregates: None {{(pid=72766) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 23:41:59 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Refreshing trait associations for resource provider 45c8ff08-bf31-4ab6-8452-2e293102f899, traits: COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=72766) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 23:41:59 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:41:59 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:41:59 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:41:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.520s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:42:00 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:42:00 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:42:03 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:42:03 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:42:03 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:42:03 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Triggering sync for uuid 2262995c-232a-4bfd-b8f4-c83b24c12f62 {{(pid=72766) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 23:42:03 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Triggering sync for uuid b9ede44b-eef5-473f-a279-8166a442a45d {{(pid=72766) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 23:42:03 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Triggering sync for uuid 79fc46e4-1245-49b9-a2ff-6ec857d15713 {{(pid=72766) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 23:42:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "2262995c-232a-4bfd-b8f4-c83b24c12f62" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:42:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:42:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "b9ede44b-eef5-473f-a279-8166a442a45d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:42:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "b9ede44b-eef5-473f-a279-8166a442a45d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:42:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "79fc46e4-1245-49b9-a2ff-6ec857d15713" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:42:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "79fc46e4-1245-49b9-a2ff-6ec857d15713" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:42:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:42:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:42:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "b9ede44b-eef5-473f-a279-8166a442a45d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:42:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "79fc46e4-1245-49b9-a2ff-6ec857d15713" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:42:04 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:42:04 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:42:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:42:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:42:17 user nova-compute[72766]: DEBUG nova.compute.manager [req-86e7df67-c9a0-488f-82be-bc4102a4d391 req-ad0450c3-556d-435a-9e5b-0f3daa4ed67f service nova] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Received event network-changed-5e98e3de-0b7e-4228-a692-bcfb144878d7 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:42:17 user nova-compute[72766]: DEBUG nova.compute.manager [req-86e7df67-c9a0-488f-82be-bc4102a4d391 req-ad0450c3-556d-435a-9e5b-0f3daa4ed67f service nova] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Refreshing instance network info cache due to event network-changed-5e98e3de-0b7e-4228-a692-bcfb144878d7. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:42:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-86e7df67-c9a0-488f-82be-bc4102a4d391 req-ad0450c3-556d-435a-9e5b-0f3daa4ed67f service nova] Acquiring lock "refresh_cache-79fc46e4-1245-49b9-a2ff-6ec857d15713" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:42:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-86e7df67-c9a0-488f-82be-bc4102a4d391 req-ad0450c3-556d-435a-9e5b-0f3daa4ed67f service nova] Acquired lock "refresh_cache-79fc46e4-1245-49b9-a2ff-6ec857d15713" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:42:17 user nova-compute[72766]: DEBUG nova.network.neutron [req-86e7df67-c9a0-488f-82be-bc4102a4d391 req-ad0450c3-556d-435a-9e5b-0f3daa4ed67f service nova] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Refreshing network info cache for port 5e98e3de-0b7e-4228-a692-bcfb144878d7 {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:42:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Acquiring lock "79fc46e4-1245-49b9-a2ff-6ec857d15713" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:42:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "79fc46e4-1245-49b9-a2ff-6ec857d15713" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:42:17 user nova-compute[72766]: DEBUG nova.objects.instance [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lazy-loading 'flavor' on Instance uuid 79fc46e4-1245-49b9-a2ff-6ec857d15713 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:42:17 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Ignoring supplied device name: /dev/vdb
Aug 14 23:42:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "79fc46e4-1245-49b9-a2ff-6ec857d15713" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:42:18 user nova-compute[72766]: DEBUG nova.network.neutron [req-86e7df67-c9a0-488f-82be-bc4102a4d391 req-ad0450c3-556d-435a-9e5b-0f3daa4ed67f service nova] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Updated VIF entry in instance network info cache for port 5e98e3de-0b7e-4228-a692-bcfb144878d7. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:42:18 user nova-compute[72766]: DEBUG nova.network.neutron [req-86e7df67-c9a0-488f-82be-bc4102a4d391 req-ad0450c3-556d-435a-9e5b-0f3daa4ed67f service nova] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Updating instance_info_cache with network_info: [{"id": "5e98e3de-0b7e-4228-a692-bcfb144878d7", "address": "fa:16:3e:f8:43:b5", "network": {"id": "ac53cc42-a36b-4e59-a831-e240513cd6da", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-912624616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30bfb5a00552451195ed2aa91d218c8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e98e3de-0b", "ovs_interfaceid": "5e98e3de-0b7e-4228-a692-bcfb144878d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:42:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Acquiring lock "79fc46e4-1245-49b9-a2ff-6ec857d15713" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:42:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "79fc46e4-1245-49b9-a2ff-6ec857d15713" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:42:18 user nova-compute[72766]: INFO nova.compute.manager [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Attaching volume cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a to /dev/vdb
Aug 14 23:42:18 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-86e7df67-c9a0-488f-82be-bc4102a4d391 req-ad0450c3-556d-435a-9e5b-0f3daa4ed67f service nova] Releasing lock "refresh_cache-79fc46e4-1245-49b9-a2ff-6ec857d15713" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:42:18 user nova-compute[72766]: DEBUG os_brick.utils [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:42:18 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:42:18 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:42:18 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4190840-bd4f-4d15-bbe0-58f500120458]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:42:18 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:42:18 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:42:18 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e859c8-e8e9-494c-b0f6-6d79e1668b71]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:42:18 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:42:18 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:42:18 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[36618017-e4cb-4973-b6a3-02de88e6ee45]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:42:18 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0dd66a-04b0-4211-8c08-07d6b8aed08f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:42:18 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:42:18 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:42:18 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 23:42:18 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:42:18 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:42:18 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 23:42:18 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4777230-3577-4716-8764-9d1ff57c9d28]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:42:18 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 23:42:18 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 23:42:18 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 23:42:18 user nova-compute[72766]: DEBUG os_brick.utils [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] <== get_connector_properties: return (255ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:42:18 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Updating existing volume attachment record: 897640e4-e4c4-4638-8a62-3503523b41a6 {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 23:42:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:42:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:42:23 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:42:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:42:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:42:25 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:42:25 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Cleaning up deleted instances {{(pid=72766) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 23:42:25 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] There are 0 instances to clean {{(pid=72766) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 23:42:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HMJsoLvF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:42:32 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:42:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:42:32 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:42:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:42:32 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 23:42:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[344f3a9e-ea63-4f8c-979b-8cdc5712b67b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 23:42:32 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[942379a4-4bc2-4560-9189-a158bc7ac97d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a] added
Aug 14 23:42:32 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d865d97-104e-4bb9-b47c-46a858f71e4e]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf0db58-5ac3-4304-aff8-f03ad1cdeb96]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HMJsoLvF {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HMJsoLvF" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[672621b0-0988-4098-b88d-9aa435b3bd66]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HMJsoLvF'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fc7248-8273-4881-8214-a056ffb11053]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a19381-fb84-4050-9f24-2a566382b43c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 23:42:32 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 23:42:32 user nova-compute[72766]:  {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:42:32 user nova-compute[72766]: WARNING os_brick.initiator.connectors.iscsi [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 23:42:32 user nova-compute[72766]: 
Aug 14 23:42:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2483bae-1a27-4c89-991b-6a7d4c9f8cb7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a, portal: 172.16.0.220,3260]
Aug 14 23:42:32 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a, portal: 172.16.0.220,3260] successful.
Aug 14 23:42:32 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce318fe1-8ec7-409a-a9e0-320de883dadd]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb12ac3-cc40-4dbd-9548-3f005553038c]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a (non-flash)
Aug 14 23:42:32 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a (non-flash)
Aug 14 23:42:32 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72766) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[032b22ca-2fb1-4caf-8a37-0d7c9027e2c8]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:42:32 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: None {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:42:33 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:42:33 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HMJsoLvF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 23:42:33 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:42:33 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '23839353264666438', 'path': '/dev/sdb'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:42:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839353264666438', 'path': '/dev/sdb'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 23:42:33 user nova-compute[72766]: DEBUG nova.objects.instance [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lazy-loading 'flavor' on Instance uuid 79fc46e4-1245-49b9-a2ff-6ec857d15713 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:42:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 23:42:33 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:42:33 user nova-compute[72766]:   <source dev="/dev/sdb"/>
Aug 14 23:42:33 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:42:33 user nova-compute[72766]:   <serial>cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a</serial>
Aug 14 23:42:33 user nova-compute[72766]: </disk>
Aug 14 23:42:33 user nova-compute[72766]:  {{(pid=72766) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 23:42:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:42:34 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:42:34 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:42:34 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] No VIF found with MAC fa:16:3e:f8:43:b5, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:42:34 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-bd86df5f-e3ea-4996-a1fa-20ead86b881d tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "79fc46e4-1245-49b9-a2ff-6ec857d15713" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.092s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:42:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:42:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:42:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:42:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:42:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:42:50 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:42:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:42:55 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:42:55 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:42:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-b9ede44b-eef5-473f-a279-8166a442a45d" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:42:55 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-b9ede44b-eef5-473f-a279-8166a442a45d" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:42:55 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:42:56 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Updating instance_info_cache with network_info: [{"id": "02fed6c3-ea8a-4fd6-a404-29ea7c038c6a", "address": "fa:16:3e:52:c1:fe", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02fed6c3-ea", "ovs_interfaceid": "02fed6c3-ea8a-4fd6-a404-29ea7c038c6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:42:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-b9ede44b-eef5-473f-a279-8166a442a45d" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:42:56 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:42:56 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:42:57 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:42:57 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:42:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:42:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:42:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:42:57 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:42:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:42:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:42:57 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:42:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:42:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:42:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:42:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:42:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:42:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:42:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:42:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:42:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:42:58 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79fc46e4-1245-49b9-a2ff-6ec857d15713/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:42:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:42:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79fc46e4-1245-49b9-a2ff-6ec857d15713/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:42:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79fc46e4-1245-49b9-a2ff-6ec857d15713/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:42:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79fc46e4-1245-49b9-a2ff-6ec857d15713/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:42:59 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:42:59 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:42:59 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:42:59 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=8572MB free_disk=25.21013641357422GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:42:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:42:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:42:59 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 2262995c-232a-4bfd-b8f4-c83b24c12f62 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:42:59 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance b9ede44b-eef5-473f-a279-8166a442a45d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:42:59 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 79fc46e4-1245-49b9-a2ff-6ec857d15713 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:42:59 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:42:59 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:42:59 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:42:59 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:42:59 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:42:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.224s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:43:00 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:43:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:43:04 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:43:04 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:43:04 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f44cc9bc-a08d-4951-a274-2989dde9c519 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Acquiring lock "79fc46e4-1245-49b9-a2ff-6ec857d15713" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f44cc9bc-a08d-4951-a274-2989dde9c519 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "79fc46e4-1245-49b9-a2ff-6ec857d15713" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:43:06 user nova-compute[72766]: INFO nova.compute.manager [None req-f44cc9bc-a08d-4951-a274-2989dde9c519 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Detaching volume cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a
Aug 14 23:43:06 user nova-compute[72766]: INFO nova.virt.block_device [None req-f44cc9bc-a08d-4951-a274-2989dde9c519 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Attempting to driver detach volume cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a from mountpoint /dev/vdb
Aug 14 23:43:06 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f44cc9bc-a08d-4951-a274-2989dde9c519 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Attempting to detach device vdb from instance 79fc46e4-1245-49b9-a2ff-6ec857d15713 from the persistent domain config. {{(pid=72766) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-f44cc9bc-a08d-4951-a274-2989dde9c519 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 23:43:06 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:43:06 user nova-compute[72766]:   <source dev="/dev/sdb"/>
Aug 14 23:43:06 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:43:06 user nova-compute[72766]:   <serial>cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a</serial>
Aug 14 23:43:06 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 23:43:06 user nova-compute[72766]: </disk>
Aug 14 23:43:06 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 23:43:06 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-f44cc9bc-a08d-4951-a274-2989dde9c519 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Successfully detached device vdb from instance 79fc46e4-1245-49b9-a2ff-6ec857d15713 from the persistent domain config.
Aug 14 23:43:06 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f44cc9bc-a08d-4951-a274-2989dde9c519 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 79fc46e4-1245-49b9-a2ff-6ec857d15713 from the live domain config. {{(pid=72766) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-f44cc9bc-a08d-4951-a274-2989dde9c519 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 23:43:06 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:43:06 user nova-compute[72766]:   <source dev="/dev/sdb"/>
Aug 14 23:43:06 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:43:06 user nova-compute[72766]:   <serial>cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a</serial>
Aug 14 23:43:06 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 23:43:06 user nova-compute[72766]: </disk>
Aug 14 23:43:06 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-db718eef-1df6-4f29-822f-6ba145bd4f84 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Acquiring lock "79fc46e4-1245-49b9-a2ff-6ec857d15713" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Received event <DeviceRemovedEvent: 1692056586.7058265, 79fc46e4-1245-49b9-a2ff-6ec857d15713 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72766) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f44cc9bc-a08d-4951-a274-2989dde9c519 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 79fc46e4-1245-49b9-a2ff-6ec857d15713 {{(pid=72766) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 23:43:06 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-f44cc9bc-a08d-4951-a274-2989dde9c519 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Successfully detached device vdb from instance 79fc46e4-1245-49b9-a2ff-6ec857d15713 from the live domain config.
Aug 14 23:43:06 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f44cc9bc-a08d-4951-a274-2989dde9c519 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44cc9bc-a08d-4951-a274-2989dde9c519 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HMJsoLvF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:43:06 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-f44cc9bc-a08d-4951-a274-2989dde9c519 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:43:06 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-f44cc9bc-a08d-4951-a274-2989dde9c519 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-f44cc9bc-a08d-4951-a274-2989dde9c519 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44cc9bc-a08d-4951-a274-2989dde9c519 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34be3e3-dbbb-42cc-8648-19bdc15dd213]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e8b2b8-5e27-437d-9423-1870358f1798]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44cc9bc-a08d-4951-a274-2989dde9c519 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a (non-flash)
Aug 14 23:43:06 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44cc9bc-a08d-4951-a274-2989dde9c519 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a (non-flash)
Aug 14 23:43:06 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44cc9bc-a08d-4951-a274-2989dde9c519 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff1542cfd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a'): ({'sdb'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-f44cc9bc-a08d-4951-a274-2989dde9c519 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Removing single pathed devices sdb {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60f72d4-8cf3-4d74-91be-9ea1d1b2c757]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5dce01-1972-49b9-8d9e-b03d7371d612]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-f44cc9bc-a08d-4951-a274-2989dde9c519 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Flushing IO for device /dev/sdb {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[de654205-aef2-433b-840b-a32510ac4562]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-f44cc9bc-a08d-4951-a274-2989dde9c519 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b328f758-d16f-42cd-905d-facc6fbd41b9]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-f44cc9bc-a08d-4951-a274-2989dde9c519 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-f44cc9bc-a08d-4951-a274-2989dde9c519 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] SCSI volumes sdb have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44cc9bc-a08d-4951-a274-2989dde9c519 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[47771bae-5752-4933-844c-843694174a8e]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44cc9bc-a08d-4951-a274-2989dde9c519 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2cf0ce-7b5a-482f-aad2-b0ce7b6cb330]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44cc9bc-a08d-4951-a274-2989dde9c519 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a, portal: 172.16.0.220,3260]
Aug 14 23:43:06 user nova-compute[72766]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a, portal: 172.16.0.220,3260] successful.
Aug 14 23:43:06 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[1045ea13-14a7-4664-9298-61804575f4a4]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44cc9bc-a08d-4951-a274-2989dde9c519 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-f44cc9bc-a08d-4951-a274-2989dde9c519 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.254s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-f44cc9bc-a08d-4951-a274-2989dde9c519 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] <== disconnect_volume: return (256ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:43:06 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f44cc9bc-a08d-4951-a274-2989dde9c519 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:43:07 user nova-compute[72766]: DEBUG nova.objects.instance [None req-f44cc9bc-a08d-4951-a274-2989dde9c519 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lazy-loading 'flavor' on Instance uuid 79fc46e4-1245-49b9-a2ff-6ec857d15713 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:43:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f44cc9bc-a08d-4951-a274-2989dde9c519 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "79fc46e4-1245-49b9-a2ff-6ec857d15713" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.695s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:43:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-db718eef-1df6-4f29-822f-6ba145bd4f84 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "79fc46e4-1245-49b9-a2ff-6ec857d15713" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.532s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:43:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-db718eef-1df6-4f29-822f-6ba145bd4f84 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Acquiring lock "79fc46e4-1245-49b9-a2ff-6ec857d15713-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:43:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-db718eef-1df6-4f29-822f-6ba145bd4f84 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "79fc46e4-1245-49b9-a2ff-6ec857d15713-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:43:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-db718eef-1df6-4f29-822f-6ba145bd4f84 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "79fc46e4-1245-49b9-a2ff-6ec857d15713-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:43:07 user nova-compute[72766]: INFO nova.compute.manager [None req-db718eef-1df6-4f29-822f-6ba145bd4f84 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Terminating instance
Aug 14 23:43:07 user nova-compute[72766]: DEBUG nova.compute.manager [None req-db718eef-1df6-4f29-822f-6ba145bd4f84 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:43:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:43:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:43:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:43:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:43:08 user nova-compute[72766]: DEBUG nova.compute.manager [req-9c6a8f5a-1398-4f68-8792-d79fe5c7d3d0 req-b6d917ab-d78e-48ce-a584-5983151f1f89 service nova] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Received event network-vif-unplugged-5e98e3de-0b7e-4228-a692-bcfb144878d7 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:43:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9c6a8f5a-1398-4f68-8792-d79fe5c7d3d0 req-b6d917ab-d78e-48ce-a584-5983151f1f89 service nova] Acquiring lock "79fc46e4-1245-49b9-a2ff-6ec857d15713-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:43:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9c6a8f5a-1398-4f68-8792-d79fe5c7d3d0 req-b6d917ab-d78e-48ce-a584-5983151f1f89 service nova] Lock "79fc46e4-1245-49b9-a2ff-6ec857d15713-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:43:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9c6a8f5a-1398-4f68-8792-d79fe5c7d3d0 req-b6d917ab-d78e-48ce-a584-5983151f1f89 service nova] Lock "79fc46e4-1245-49b9-a2ff-6ec857d15713-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:43:08 user nova-compute[72766]: DEBUG nova.compute.manager [req-9c6a8f5a-1398-4f68-8792-d79fe5c7d3d0 req-b6d917ab-d78e-48ce-a584-5983151f1f89 service nova] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] No waiting events found dispatching network-vif-unplugged-5e98e3de-0b7e-4228-a692-bcfb144878d7 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:43:08 user nova-compute[72766]: DEBUG nova.compute.manager [req-9c6a8f5a-1398-4f68-8792-d79fe5c7d3d0 req-b6d917ab-d78e-48ce-a584-5983151f1f89 service nova] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Received event network-vif-unplugged-5e98e3de-0b7e-4228-a692-bcfb144878d7 for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:43:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:43:08 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Instance destroyed successfully.
Aug 14 23:43:08 user nova-compute[72766]: DEBUG nova.objects.instance [None req-db718eef-1df6-4f29-822f-6ba145bd4f84 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lazy-loading 'resources' on Instance uuid 79fc46e4-1245-49b9-a2ff-6ec857d15713 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:43:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-db718eef-1df6-4f29-822f-6ba145bd4f84 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-831006203',display_name='tempest-VolumesSnapshotTestJSON-instance-831006203',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-831006203',id=51,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZQdHMWMWjcdNtFRfFaP7IM66AW+1p2xApeIdxOb1uJVXf9LRgOgKXISzZacOWr1Qu50HiRmAksOq5eJ88cWRwG5u0bcmevP7wDTxJTKFhePg97T0D7jZAAr+XN43zVjw==',key_name='tempest-keypair-669452243',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:40:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='30bfb5a00552451195ed2aa91d218c8f',ramdisk_id='',reservation_id='r-sw0ama90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1614321126',owner_user_name='tempest-VolumesSnapshotTestJSON-1614321126-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:40:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dffd02cd8106437e8a9e4ab035bd4201',uuid=79fc46e4-1245-49b9-a2ff-6ec857d15713,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e98e3de-0b7e-4228-a692-bcfb144878d7", "address": "fa:16:3e:f8:43:b5", "network": {"id": "ac53cc42-a36b-4e59-a831-e240513cd6da", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-912624616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30bfb5a00552451195ed2aa91d218c8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e98e3de-0b", "ovs_interfaceid": "5e98e3de-0b7e-4228-a692-bcfb144878d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:43:08 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-db718eef-1df6-4f29-822f-6ba145bd4f84 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Converting VIF {"id": "5e98e3de-0b7e-4228-a692-bcfb144878d7", "address": "fa:16:3e:f8:43:b5", "network": {"id": "ac53cc42-a36b-4e59-a831-e240513cd6da", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-912624616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30bfb5a00552451195ed2aa91d218c8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e98e3de-0b", "ovs_interfaceid": "5e98e3de-0b7e-4228-a692-bcfb144878d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:43:08 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-db718eef-1df6-4f29-822f-6ba145bd4f84 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:43:b5,bridge_name='br-int',has_traffic_filtering=True,id=5e98e3de-0b7e-4228-a692-bcfb144878d7,network=Network(ac53cc42-a36b-4e59-a831-e240513cd6da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e98e3de-0b') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:43:08 user nova-compute[72766]: DEBUG os_vif [None req-db718eef-1df6-4f29-822f-6ba145bd4f84 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:43:b5,bridge_name='br-int',has_traffic_filtering=True,id=5e98e3de-0b7e-4228-a692-bcfb144878d7,network=Network(ac53cc42-a36b-4e59-a831-e240513cd6da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e98e3de-0b') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:43:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:43:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e98e3de-0b, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:43:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:43:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:43:08 user nova-compute[72766]: INFO os_vif [None req-db718eef-1df6-4f29-822f-6ba145bd4f84 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:43:b5,bridge_name='br-int',has_traffic_filtering=True,id=5e98e3de-0b7e-4228-a692-bcfb144878d7,network=Network(ac53cc42-a36b-4e59-a831-e240513cd6da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e98e3de-0b')
Aug 14 23:43:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db718eef-1df6-4f29-822f-6ba145bd4f84 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:43:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-db718eef-1df6-4f29-822f-6ba145bd4f84 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HMJsoLvF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:43:08 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-db718eef-1df6-4f29-822f-6ba145bd4f84 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:43:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-db718eef-1df6-4f29-822f-6ba145bd4f84 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:43:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-db718eef-1df6-4f29-822f-6ba145bd4f84 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:43:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-db718eef-1df6-4f29-822f-6ba145bd4f84 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cef00f6e-0465-4a9b-a0a6-b59fcfc7ec6a', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:43:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:43:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 21 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:43:08 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[16db180b-25e6-4c50-99ad-3b5748f1fe64]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:43:08 user nova-compute[72766]: WARNING os_brick.initiator.connectors.iscsi [None req-db718eef-1df6-4f29-822f-6ba145bd4f84 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Couldn't find iSCSI nodes because iscsiadm err: iscsiadm: No records found
Aug 14 23:43:08 user nova-compute[72766]: 
Aug 14 23:43:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:43:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:43:08 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46d1765-e5ff-4062-ac6a-f75f4ccbc8b8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:43:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-db718eef-1df6-4f29-822f-6ba145bd4f84 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 23:43:08 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:43:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-db718eef-1df6-4f29-822f-6ba145bd4f84 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 23:43:08 user nova-compute[72766]:  {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:43:08 user nova-compute[72766]: WARNING os_brick.initiator.connectors.iscsi [None req-db718eef-1df6-4f29-822f-6ba145bd4f84 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 23:43:08 user nova-compute[72766]: 
Aug 14 23:43:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-db718eef-1df6-4f29-822f-6ba145bd4f84 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff1545e2440>, {}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:43:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-db718eef-1df6-4f29-822f-6ba145bd4f84 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Disconnecting from: [] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:43:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-db718eef-1df6-4f29-822f-6ba145bd4f84 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.043s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:43:08 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-db718eef-1df6-4f29-822f-6ba145bd4f84 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] <== disconnect_volume: return (44ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:43:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db718eef-1df6-4f29-822f-6ba145bd4f84 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:43:08 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-db718eef-1df6-4f29-822f-6ba145bd4f84 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Deleting instance files /opt/stack/data/nova/instances/79fc46e4-1245-49b9-a2ff-6ec857d15713_del
Aug 14 23:43:08 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-db718eef-1df6-4f29-822f-6ba145bd4f84 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Deletion of /opt/stack/data/nova/instances/79fc46e4-1245-49b9-a2ff-6ec857d15713_del complete
Aug 14 23:43:08 user nova-compute[72766]: INFO nova.compute.manager [None req-db718eef-1df6-4f29-822f-6ba145bd4f84 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 14 23:43:08 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-db718eef-1df6-4f29-822f-6ba145bd4f84 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:43:08 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:43:08 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:43:09 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:43:09 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Took 1.03 seconds to deallocate network for instance.
Aug 14 23:43:09 user nova-compute[72766]: DEBUG nova.compute.manager [req-d5ee99f5-dcf5-40f6-916b-17e474caf9da req-8272f386-3e5c-418e-bcb5-84065d6b7161 service nova] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Received event network-vif-deleted-5e98e3de-0b7e-4228-a692-bcfb144878d7 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:43:09 user nova-compute[72766]: WARNING nova.volume.cinder [None req-db718eef-1df6-4f29-822f-6ba145bd4f84 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Attachment 897640e4-e4c4-4638-8a62-3503523b41a6 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 897640e4-e4c4-4638-8a62-3503523b41a6. (HTTP 404) (Request-ID: req-ca23c057-bb56-4f44-9de2-461c14b012a2)
Aug 14 23:43:09 user nova-compute[72766]: INFO nova.compute.manager [None req-db718eef-1df6-4f29-822f-6ba145bd4f84 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Took 0.02 seconds to detach 1 volumes for instance.
Aug 14 23:43:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-db718eef-1df6-4f29-822f-6ba145bd4f84 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:43:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-db718eef-1df6-4f29-822f-6ba145bd4f84 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:43:09 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-db718eef-1df6-4f29-822f-6ba145bd4f84 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:43:09 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-db718eef-1df6-4f29-822f-6ba145bd4f84 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:43:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-db718eef-1df6-4f29-822f-6ba145bd4f84 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.170s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:43:10 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-db718eef-1df6-4f29-822f-6ba145bd4f84 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Deleted allocations for instance 79fc46e4-1245-49b9-a2ff-6ec857d15713
Aug 14 23:43:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-db718eef-1df6-4f29-822f-6ba145bd4f84 tempest-VolumesSnapshotTestJSON-1614321126 tempest-VolumesSnapshotTestJSON-1614321126-project-member] Lock "79fc46e4-1245-49b9-a2ff-6ec857d15713" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.296s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:43:10 user nova-compute[72766]: DEBUG nova.compute.manager [req-10f2f9be-cd65-42a9-9472-c0cb1d60e6b8 req-7e5b2891-5ec1-49da-85d4-1ef0862a35bf service nova] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Received event network-vif-plugged-5e98e3de-0b7e-4228-a692-bcfb144878d7 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:43:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-10f2f9be-cd65-42a9-9472-c0cb1d60e6b8 req-7e5b2891-5ec1-49da-85d4-1ef0862a35bf service nova] Acquiring lock "79fc46e4-1245-49b9-a2ff-6ec857d15713-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:43:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-10f2f9be-cd65-42a9-9472-c0cb1d60e6b8 req-7e5b2891-5ec1-49da-85d4-1ef0862a35bf service nova] Lock "79fc46e4-1245-49b9-a2ff-6ec857d15713-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:43:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-10f2f9be-cd65-42a9-9472-c0cb1d60e6b8 req-7e5b2891-5ec1-49da-85d4-1ef0862a35bf service nova] Lock "79fc46e4-1245-49b9-a2ff-6ec857d15713-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:43:10 user nova-compute[72766]: DEBUG nova.compute.manager [req-10f2f9be-cd65-42a9-9472-c0cb1d60e6b8 req-7e5b2891-5ec1-49da-85d4-1ef0862a35bf service nova] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] No waiting events found dispatching network-vif-plugged-5e98e3de-0b7e-4228-a692-bcfb144878d7 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:43:10 user nova-compute[72766]: WARNING nova.compute.manager [req-10f2f9be-cd65-42a9-9472-c0cb1d60e6b8 req-7e5b2891-5ec1-49da-85d4-1ef0862a35bf service nova] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Received unexpected event network-vif-plugged-5e98e3de-0b7e-4228-a692-bcfb144878d7 for instance with vm_state deleted and task_state None.
Aug 14 23:43:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:43:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:43:23 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692056588.557336, 79fc46e4-1245-49b9-a2ff-6ec857d15713 => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:43:23 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] VM Stopped (Lifecycle Event)
Aug 14 23:43:23 user nova-compute[72766]: DEBUG nova.compute.manager [None req-32020fa7-25f5-46b7-a49c-f129e641513f None None] [instance: 79fc46e4-1245-49b9-a2ff-6ec857d15713] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:43:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:43:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:43:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:43:37 user nova-compute[72766]: INFO nova.compute.manager [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Rescuing
Aug 14 23:43:37 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquiring lock "refresh_cache-2262995c-232a-4bfd-b8f4-c83b24c12f62" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:43:37 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquired lock "refresh_cache-2262995c-232a-4bfd-b8f4-c83b24c12f62" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:43:37 user nova-compute[72766]: DEBUG nova.network.neutron [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:43:37 user nova-compute[72766]: DEBUG nova.network.neutron [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Updating instance_info_cache with network_info: [{"id": "69550d14-e1fb-4c2e-9526-19cae208fd08", "address": "fa:16:3e:bd:82:2f", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69550d14-e1", "ovs_interfaceid": "69550d14-e1fb-4c2e-9526-19cae208fd08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:43:37 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Releasing lock "refresh_cache-2262995c-232a-4bfd-b8f4-c83b24c12f62" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG nova.compute.manager [req-4ab97754-4ce7-43b3-a851-d74a646809f1 req-56baf646-971f-4673-8d12-687f81adb89d service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Received event network-vif-unplugged-69550d14-e1fb-4c2e-9526-19cae208fd08 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-4ab97754-4ce7-43b3-a851-d74a646809f1 req-56baf646-971f-4673-8d12-687f81adb89d service nova] Acquiring lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-4ab97754-4ce7-43b3-a851-d74a646809f1 req-56baf646-971f-4673-8d12-687f81adb89d service nova] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-4ab97754-4ce7-43b3-a851-d74a646809f1 req-56baf646-971f-4673-8d12-687f81adb89d service nova] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG nova.compute.manager [req-4ab97754-4ce7-43b3-a851-d74a646809f1 req-56baf646-971f-4673-8d12-687f81adb89d service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] No waiting events found dispatching network-vif-unplugged-69550d14-e1fb-4c2e-9526-19cae208fd08 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:43:38 user nova-compute[72766]: WARNING nova.compute.manager [req-4ab97754-4ce7-43b3-a851-d74a646809f1 req-56baf646-971f-4673-8d12-687f81adb89d service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Received unexpected event network-vif-unplugged-69550d14-e1fb-4c2e-9526-19cae208fd08 for instance with vm_state active and task_state rescuing.
Aug 14 23:43:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:43:38 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Instance destroyed successfully.
Aug 14 23:43:38 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Attempting rescue
Aug 14 23:43:38 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72766) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Instance directory exists: not creating {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 23:43:38 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Creating image(s)
Aug 14 23:43:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquiring lock "/opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "/opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "/opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG nova.objects.instance [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2262995c-232a-4bfd-b8f4-c83b24c12f62 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquiring lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.176s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk.rescue {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk.rescue" returned: 0 in 0.055s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG nova.objects.instance [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lazy-loading 'migration_context' on Instance uuid 2262995c-232a-4bfd-b8f4-c83b24c12f62 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Start _get_guest_xml network_info=[{"id": "69550d14-e1fb-4c2e-9526-19cae208fd08", "address": "fa:16:3e:bd:82:2f", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "vif_mac": "fa:16:3e:bd:82:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69550d14-e1", "ovs_interfaceid": "69550d14-e1fb-4c2e-9526-19cae208fd08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd2900d30-2c4c-4d57-9135-d45564c0c596', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG nova.objects.instance [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lazy-loading 'resources' on Instance uuid 2262995c-232a-4bfd-b8f4-c83b24c12f62 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG nova.objects.instance [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lazy-loading 'numa_topology' on Instance uuid 2262995c-232a-4bfd-b8f4-c83b24c12f62 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:43:38 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:43:38 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:43:38 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG nova.objects.instance [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2262995c-232a-4bfd-b8f4-c83b24c12f62 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:38:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-987629422',display_name='tempest-ServerRescueNegativeTestJSON-server-987629422',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-987629422',id=49,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:38:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eaadde665b704e4d882299b7f747d7a5',ramdisk_id='',reservation_id='r-e060wqz6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1344834449',owner_user_name='tempest-ServerRescueNegativeTestJSON-1344834449-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:38:59Z,user_data=None,user_id='4a1c0e7bd2744a349ecfef160a6f54f5',uuid=2262995c-232a-4bfd-b8f4-c83b24c12f62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69550d14-e1fb-4c2e-9526-19cae208fd08", "address": "fa:16:3e:bd:82:2f", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "vif_mac": "fa:16:3e:bd:82:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69550d14-e1", "ovs_interfaceid": "69550d14-e1fb-4c2e-9526-19cae208fd08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Converting VIF {"id": "69550d14-e1fb-4c2e-9526-19cae208fd08", "address": "fa:16:3e:bd:82:2f", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "vif_mac": "fa:16:3e:bd:82:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69550d14-e1", "ovs_interfaceid": "69550d14-e1fb-4c2e-9526-19cae208fd08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:82:2f,bridge_name='br-int',has_traffic_filtering=True,id=69550d14-e1fb-4c2e-9526-19cae208fd08,network=Network(71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69550d14-e1') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG nova.objects.instance [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lazy-loading 'pci_devices' on Instance uuid 2262995c-232a-4bfd-b8f4-c83b24c12f62 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:43:38 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:43:38 user nova-compute[72766]:   <uuid>2262995c-232a-4bfd-b8f4-c83b24c12f62</uuid>
Aug 14 23:43:38 user nova-compute[72766]:   <name>instance-00000031</name>
Aug 14 23:43:38 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:43:38 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:43:38 user nova-compute[72766]:   <metadata>
Aug 14 23:43:38 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:43:38 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:43:38 user nova-compute[72766]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-987629422</nova:name>
Aug 14 23:43:38 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:43:38</nova:creationTime>
Aug 14 23:43:38 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:43:38 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:43:38 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:43:38 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:43:38 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:43:38 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:43:38 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:43:38 user nova-compute[72766]:       <nova:owner>
Aug 14 23:43:38 user nova-compute[72766]:         <nova:user uuid="4a1c0e7bd2744a349ecfef160a6f54f5">tempest-ServerRescueNegativeTestJSON-1344834449-project-member</nova:user>
Aug 14 23:43:38 user nova-compute[72766]:         <nova:project uuid="eaadde665b704e4d882299b7f747d7a5">tempest-ServerRescueNegativeTestJSON-1344834449</nova:project>
Aug 14 23:43:38 user nova-compute[72766]:       </nova:owner>
Aug 14 23:43:38 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 23:43:38 user nova-compute[72766]:       <nova:ports>
Aug 14 23:43:38 user nova-compute[72766]:         <nova:port uuid="69550d14-e1fb-4c2e-9526-19cae208fd08">
Aug 14 23:43:38 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 23:43:38 user nova-compute[72766]:         </nova:port>
Aug 14 23:43:38 user nova-compute[72766]:       </nova:ports>
Aug 14 23:43:38 user nova-compute[72766]:     </nova:instance>
Aug 14 23:43:38 user nova-compute[72766]:   </metadata>
Aug 14 23:43:38 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:43:38 user nova-compute[72766]:     <system>
Aug 14 23:43:38 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:43:38 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:43:38 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:43:38 user nova-compute[72766]:       <entry name="serial">2262995c-232a-4bfd-b8f4-c83b24c12f62</entry>
Aug 14 23:43:38 user nova-compute[72766]:       <entry name="uuid">2262995c-232a-4bfd-b8f4-c83b24c12f62</entry>
Aug 14 23:43:38 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:43:38 user nova-compute[72766]:     </system>
Aug 14 23:43:38 user nova-compute[72766]:   </sysinfo>
Aug 14 23:43:38 user nova-compute[72766]:   <os>
Aug 14 23:43:38 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:43:38 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:43:38 user nova-compute[72766]:   </os>
Aug 14 23:43:38 user nova-compute[72766]:   <features>
Aug 14 23:43:38 user nova-compute[72766]:     <acpi/>
Aug 14 23:43:38 user nova-compute[72766]:     <apic/>
Aug 14 23:43:38 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:43:38 user nova-compute[72766]:   </features>
Aug 14 23:43:38 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:43:38 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:43:38 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:43:38 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:43:38 user nova-compute[72766]:   </clock>
Aug 14 23:43:38 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:43:38 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:43:38 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:43:38 user nova-compute[72766]:   </cpu>
Aug 14 23:43:38 user nova-compute[72766]:   <devices>
Aug 14 23:43:38 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 23:43:38 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 23:43:38 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk.rescue"/>
Aug 14 23:43:38 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:43:38 user nova-compute[72766]:     </disk>
Aug 14 23:43:38 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 23:43:38 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 23:43:38 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk"/>
Aug 14 23:43:38 user nova-compute[72766]:       <target dev="vdb" bus="virtio"/>
Aug 14 23:43:38 user nova-compute[72766]:     </disk>
Aug 14 23:43:38 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:43:38 user nova-compute[72766]:       <mac address="fa:16:3e:bd:82:2f"/>
Aug 14 23:43:38 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:43:38 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:43:38 user nova-compute[72766]:       <target dev="tap69550d14-e1"/>
Aug 14 23:43:38 user nova-compute[72766]:     </interface>
Aug 14 23:43:38 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:43:38 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/console.log" append="off"/>
Aug 14 23:43:38 user nova-compute[72766]:     </serial>
Aug 14 23:43:38 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:43:38 user nova-compute[72766]:     <video>
Aug 14 23:43:38 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:43:38 user nova-compute[72766]:     </video>
Aug 14 23:43:38 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:43:38 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:43:38 user nova-compute[72766]:     </rng>
Aug 14 23:43:38 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:43:38 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:43:38 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:43:38 user nova-compute[72766]:     </memballoon>
Aug 14 23:43:38 user nova-compute[72766]:   </devices>
Aug 14 23:43:38 user nova-compute[72766]: </domain>
Aug 14 23:43:38 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:43:38 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Instance destroyed successfully.
Aug 14 23:43:39 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:43:39 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:43:39 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] No VIF found with MAC fa:16:3e:bd:82:2f, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:43:40 user nova-compute[72766]: DEBUG nova.compute.manager [req-339dd27a-870b-40fb-8f36-b243ab739853 req-720624da-1b58-4523-8bef-36c988e688df service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Received event network-vif-plugged-69550d14-e1fb-4c2e-9526-19cae208fd08 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:43:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-339dd27a-870b-40fb-8f36-b243ab739853 req-720624da-1b58-4523-8bef-36c988e688df service nova] Acquiring lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:43:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-339dd27a-870b-40fb-8f36-b243ab739853 req-720624da-1b58-4523-8bef-36c988e688df service nova] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:43:40 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-339dd27a-870b-40fb-8f36-b243ab739853 req-720624da-1b58-4523-8bef-36c988e688df service nova] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:43:40 user nova-compute[72766]: DEBUG nova.compute.manager [req-339dd27a-870b-40fb-8f36-b243ab739853 req-720624da-1b58-4523-8bef-36c988e688df service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] No waiting events found dispatching network-vif-plugged-69550d14-e1fb-4c2e-9526-19cae208fd08 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:43:40 user nova-compute[72766]: WARNING nova.compute.manager [req-339dd27a-870b-40fb-8f36-b243ab739853 req-720624da-1b58-4523-8bef-36c988e688df service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Received unexpected event network-vif-plugged-69550d14-e1fb-4c2e-9526-19cae208fd08 for instance with vm_state active and task_state rescuing.
Aug 14 23:43:40 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:43:40 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:43:40 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:43:40 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:43:42 user nova-compute[72766]: DEBUG nova.compute.manager [req-0f4cb877-8a36-4370-9806-60e9eaed8df6 req-4205d4f2-faa5-4b04-a2a6-a94809c5f88c service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Received event network-vif-plugged-69550d14-e1fb-4c2e-9526-19cae208fd08 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:43:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0f4cb877-8a36-4370-9806-60e9eaed8df6 req-4205d4f2-faa5-4b04-a2a6-a94809c5f88c service nova] Acquiring lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:43:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0f4cb877-8a36-4370-9806-60e9eaed8df6 req-4205d4f2-faa5-4b04-a2a6-a94809c5f88c service nova] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:43:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0f4cb877-8a36-4370-9806-60e9eaed8df6 req-4205d4f2-faa5-4b04-a2a6-a94809c5f88c service nova] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:43:42 user nova-compute[72766]: DEBUG nova.compute.manager [req-0f4cb877-8a36-4370-9806-60e9eaed8df6 req-4205d4f2-faa5-4b04-a2a6-a94809c5f88c service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] No waiting events found dispatching network-vif-plugged-69550d14-e1fb-4c2e-9526-19cae208fd08 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:43:42 user nova-compute[72766]: WARNING nova.compute.manager [req-0f4cb877-8a36-4370-9806-60e9eaed8df6 req-4205d4f2-faa5-4b04-a2a6-a94809c5f88c service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Received unexpected event network-vif-plugged-69550d14-e1fb-4c2e-9526-19cae208fd08 for instance with vm_state active and task_state rescuing.
Aug 14 23:43:42 user nova-compute[72766]: DEBUG nova.compute.manager [req-0f4cb877-8a36-4370-9806-60e9eaed8df6 req-4205d4f2-faa5-4b04-a2a6-a94809c5f88c service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Received event network-vif-plugged-69550d14-e1fb-4c2e-9526-19cae208fd08 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:43:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0f4cb877-8a36-4370-9806-60e9eaed8df6 req-4205d4f2-faa5-4b04-a2a6-a94809c5f88c service nova] Acquiring lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:43:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0f4cb877-8a36-4370-9806-60e9eaed8df6 req-4205d4f2-faa5-4b04-a2a6-a94809c5f88c service nova] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:43:42 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-0f4cb877-8a36-4370-9806-60e9eaed8df6 req-4205d4f2-faa5-4b04-a2a6-a94809c5f88c service nova] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:43:42 user nova-compute[72766]: DEBUG nova.compute.manager [req-0f4cb877-8a36-4370-9806-60e9eaed8df6 req-4205d4f2-faa5-4b04-a2a6-a94809c5f88c service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] No waiting events found dispatching network-vif-plugged-69550d14-e1fb-4c2e-9526-19cae208fd08 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:43:42 user nova-compute[72766]: WARNING nova.compute.manager [req-0f4cb877-8a36-4370-9806-60e9eaed8df6 req-4205d4f2-faa5-4b04-a2a6-a94809c5f88c service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Received unexpected event network-vif-plugged-69550d14-e1fb-4c2e-9526-19cae208fd08 for instance with vm_state active and task_state rescuing.
Aug 14 23:43:42 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Removed pending event for 2262995c-232a-4bfd-b8f4-c83b24c12f62 due to event {{(pid=72766) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 23:43:42 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692056622.400153, 2262995c-232a-4bfd-b8f4-c83b24c12f62 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:43:42 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] VM Resumed (Lifecycle Event)
Aug 14 23:43:42 user nova-compute[72766]: DEBUG nova.compute.manager [None req-0c4ff08c-bff2-45a8-a33d-306f0691fcb5 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:43:42 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:43:42 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:43:42 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 23:43:42 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692056622.4011273, 2262995c-232a-4bfd-b8f4-c83b24c12f62 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:43:42 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] VM Started (Lifecycle Event)
Aug 14 23:43:42 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:43:42 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:43:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:43:44 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:43:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:43:52 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:43:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:43:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:43:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:43:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:43:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:43:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:43:56 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:43:56 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:43:56 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Didn't find any instances for network info cache update. {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 23:43:57 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:43:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:43:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:43:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:43:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:43:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:43:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:43:59 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:43:59 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:43:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:43:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:43:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:43:59 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:43:59 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:43:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:44:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:44:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:44:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:44:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:44:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:44:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:44:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:44:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:44:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:44:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:44:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:44:00 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:44:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:44:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:44:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:44:01 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:44:01 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:44:01 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=8567MB free_disk=25.236011505126953GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:44:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:44:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:44:01 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 2262995c-232a-4bfd-b8f4-c83b24c12f62 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:44:01 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance b9ede44b-eef5-473f-a279-8166a442a45d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:44:01 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:44:01 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:44:01 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:44:01 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:44:02 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:44:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.266s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:44:03 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:44:03 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:44:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:44:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:44:05 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:44:06 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:44:06 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:44:06 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:44:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:44:09 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:44:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:44:14 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:44:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:44:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:44:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:44:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:44:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:44:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:44:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:44:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:44:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:44:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:44:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:44:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:44:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:44:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:44:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:44:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:44:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:44:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:44:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:44:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:44:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:44:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:44:53 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:44:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:44:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:44:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:44:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:44:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:44:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:44:56 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:44:56 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:44:56 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Rebuilding the list of instances to heal {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 23:44:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-2262995c-232a-4bfd-b8f4-c83b24c12f62" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:44:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-2262995c-232a-4bfd-b8f4-c83b24c12f62" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:44:56 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:44:56 user nova-compute[72766]: DEBUG nova.objects.instance [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lazy-loading 'info_cache' on Instance uuid 2262995c-232a-4bfd-b8f4-c83b24c12f62 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:44:57 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Updating instance_info_cache with network_info: [{"id": "69550d14-e1fb-4c2e-9526-19cae208fd08", "address": "fa:16:3e:bd:82:2f", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69550d14-e1", "ovs_interfaceid": "69550d14-e1fb-4c2e-9526-19cae208fd08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:44:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-2262995c-232a-4bfd-b8f4-c83b24c12f62" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:44:57 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:44:57 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:44:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:44:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:44:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:44:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:44:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:44:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:45:01 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:45:01 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:45:01 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:45:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:45:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:45:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:45:01 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:45:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:45:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:45:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:45:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:45:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:45:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:45:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:45:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:45:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:45:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:45:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:45:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:45:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:45:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:45:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:45:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:45:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:45:03 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:45:03 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:45:03 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=8665MB free_disk=25.22646713256836GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:45:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:45:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:45:03 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 2262995c-232a-4bfd-b8f4-c83b24c12f62 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:45:03 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance b9ede44b-eef5-473f-a279-8166a442a45d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:45:03 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:45:03 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:45:03 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:45:03 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:45:03 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:45:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.240s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:45:06 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:45:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:45:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:45:08 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:45:08 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:45:08 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:45:08 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:45:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:45:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:45:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:45:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:45:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:45:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:45:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:45:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:45:28 user nova-compute[72766]: INFO nova.compute.manager [None req-f818d802-4d9f-4910-8c52-6ecd51bf14a3 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Unrescuing
Aug 14 23:45:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f818d802-4d9f-4910-8c52-6ecd51bf14a3 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquiring lock "refresh_cache-2262995c-232a-4bfd-b8f4-c83b24c12f62" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:45:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f818d802-4d9f-4910-8c52-6ecd51bf14a3 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquired lock "refresh_cache-2262995c-232a-4bfd-b8f4-c83b24c12f62" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:45:28 user nova-compute[72766]: DEBUG nova.network.neutron [None req-f818d802-4d9f-4910-8c52-6ecd51bf14a3 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:45:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:45:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:45:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:45:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:45:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:45:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:45:28 user nova-compute[72766]: DEBUG nova.network.neutron [None req-f818d802-4d9f-4910-8c52-6ecd51bf14a3 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Updating instance_info_cache with network_info: [{"id": "69550d14-e1fb-4c2e-9526-19cae208fd08", "address": "fa:16:3e:bd:82:2f", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69550d14-e1", "ovs_interfaceid": "69550d14-e1fb-4c2e-9526-19cae208fd08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:45:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-f818d802-4d9f-4910-8c52-6ecd51bf14a3 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Releasing lock "refresh_cache-2262995c-232a-4bfd-b8f4-c83b24c12f62" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:45:28 user nova-compute[72766]: DEBUG nova.objects.instance [None req-f818d802-4d9f-4910-8c52-6ecd51bf14a3 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lazy-loading 'flavor' on Instance uuid 2262995c-232a-4bfd-b8f4-c83b24c12f62 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:45:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:45:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:45:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:45:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:45:29 user nova-compute[72766]: DEBUG nova.compute.manager [req-764f8d36-4ecd-418b-927f-5d1a83c90aa7 req-b4be3783-0ba9-4fa1-9f0e-9515a66bb4b4 service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Received event network-vif-unplugged-69550d14-e1fb-4c2e-9526-19cae208fd08 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:45:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-764f8d36-4ecd-418b-927f-5d1a83c90aa7 req-b4be3783-0ba9-4fa1-9f0e-9515a66bb4b4 service nova] Acquiring lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:45:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-764f8d36-4ecd-418b-927f-5d1a83c90aa7 req-b4be3783-0ba9-4fa1-9f0e-9515a66bb4b4 service nova] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:45:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-764f8d36-4ecd-418b-927f-5d1a83c90aa7 req-b4be3783-0ba9-4fa1-9f0e-9515a66bb4b4 service nova] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:45:29 user nova-compute[72766]: DEBUG nova.compute.manager [req-764f8d36-4ecd-418b-927f-5d1a83c90aa7 req-b4be3783-0ba9-4fa1-9f0e-9515a66bb4b4 service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] No waiting events found dispatching network-vif-unplugged-69550d14-e1fb-4c2e-9526-19cae208fd08 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:45:29 user nova-compute[72766]: WARNING nova.compute.manager [req-764f8d36-4ecd-418b-927f-5d1a83c90aa7 req-b4be3783-0ba9-4fa1-9f0e-9515a66bb4b4 service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Received unexpected event network-vif-unplugged-69550d14-e1fb-4c2e-9526-19cae208fd08 for instance with vm_state rescued and task_state unrescuing.
Aug 14 23:45:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:45:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:45:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:45:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:45:29 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Instance destroyed successfully.
Aug 14 23:45:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:45:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:45:30 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:45:30 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:45:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:45:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:45:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:45:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:45:31 user nova-compute[72766]: DEBUG nova.compute.manager [req-711d254c-18ba-49c7-a6f7-f8ca53cd64ed req-be6ad8ee-4e22-4e03-b91e-bce58e48b0da service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Received event network-vif-plugged-69550d14-e1fb-4c2e-9526-19cae208fd08 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:45:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-711d254c-18ba-49c7-a6f7-f8ca53cd64ed req-be6ad8ee-4e22-4e03-b91e-bce58e48b0da service nova] Acquiring lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:45:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-711d254c-18ba-49c7-a6f7-f8ca53cd64ed req-be6ad8ee-4e22-4e03-b91e-bce58e48b0da service nova] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:45:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-711d254c-18ba-49c7-a6f7-f8ca53cd64ed req-be6ad8ee-4e22-4e03-b91e-bce58e48b0da service nova] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:45:31 user nova-compute[72766]: DEBUG nova.compute.manager [req-711d254c-18ba-49c7-a6f7-f8ca53cd64ed req-be6ad8ee-4e22-4e03-b91e-bce58e48b0da service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] No waiting events found dispatching network-vif-plugged-69550d14-e1fb-4c2e-9526-19cae208fd08 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:45:31 user nova-compute[72766]: WARNING nova.compute.manager [req-711d254c-18ba-49c7-a6f7-f8ca53cd64ed req-be6ad8ee-4e22-4e03-b91e-bce58e48b0da service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Received unexpected event network-vif-plugged-69550d14-e1fb-4c2e-9526-19cae208fd08 for instance with vm_state rescued and task_state unrescuing.
Aug 14 23:45:31 user nova-compute[72766]: DEBUG nova.compute.manager [req-711d254c-18ba-49c7-a6f7-f8ca53cd64ed req-be6ad8ee-4e22-4e03-b91e-bce58e48b0da service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Received event network-vif-plugged-69550d14-e1fb-4c2e-9526-19cae208fd08 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:45:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-711d254c-18ba-49c7-a6f7-f8ca53cd64ed req-be6ad8ee-4e22-4e03-b91e-bce58e48b0da service nova] Acquiring lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:45:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-711d254c-18ba-49c7-a6f7-f8ca53cd64ed req-be6ad8ee-4e22-4e03-b91e-bce58e48b0da service nova] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:45:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-711d254c-18ba-49c7-a6f7-f8ca53cd64ed req-be6ad8ee-4e22-4e03-b91e-bce58e48b0da service nova] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:45:31 user nova-compute[72766]: DEBUG nova.compute.manager [req-711d254c-18ba-49c7-a6f7-f8ca53cd64ed req-be6ad8ee-4e22-4e03-b91e-bce58e48b0da service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] No waiting events found dispatching network-vif-plugged-69550d14-e1fb-4c2e-9526-19cae208fd08 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:45:31 user nova-compute[72766]: WARNING nova.compute.manager [req-711d254c-18ba-49c7-a6f7-f8ca53cd64ed req-be6ad8ee-4e22-4e03-b91e-bce58e48b0da service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Received unexpected event network-vif-plugged-69550d14-e1fb-4c2e-9526-19cae208fd08 for instance with vm_state rescued and task_state unrescuing.
Aug 14 23:45:31 user nova-compute[72766]: DEBUG nova.compute.manager [req-711d254c-18ba-49c7-a6f7-f8ca53cd64ed req-be6ad8ee-4e22-4e03-b91e-bce58e48b0da service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Received event network-vif-plugged-69550d14-e1fb-4c2e-9526-19cae208fd08 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:45:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-711d254c-18ba-49c7-a6f7-f8ca53cd64ed req-be6ad8ee-4e22-4e03-b91e-bce58e48b0da service nova] Acquiring lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:45:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-711d254c-18ba-49c7-a6f7-f8ca53cd64ed req-be6ad8ee-4e22-4e03-b91e-bce58e48b0da service nova] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:45:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-711d254c-18ba-49c7-a6f7-f8ca53cd64ed req-be6ad8ee-4e22-4e03-b91e-bce58e48b0da service nova] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:45:31 user nova-compute[72766]: DEBUG nova.compute.manager [req-711d254c-18ba-49c7-a6f7-f8ca53cd64ed req-be6ad8ee-4e22-4e03-b91e-bce58e48b0da service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] No waiting events found dispatching network-vif-plugged-69550d14-e1fb-4c2e-9526-19cae208fd08 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:45:31 user nova-compute[72766]: WARNING nova.compute.manager [req-711d254c-18ba-49c7-a6f7-f8ca53cd64ed req-be6ad8ee-4e22-4e03-b91e-bce58e48b0da service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Received unexpected event network-vif-plugged-69550d14-e1fb-4c2e-9526-19cae208fd08 for instance with vm_state rescued and task_state unrescuing.
Aug 14 23:45:31 user nova-compute[72766]: DEBUG nova.compute.manager [req-711d254c-18ba-49c7-a6f7-f8ca53cd64ed req-be6ad8ee-4e22-4e03-b91e-bce58e48b0da service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Received event network-vif-unplugged-69550d14-e1fb-4c2e-9526-19cae208fd08 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:45:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-711d254c-18ba-49c7-a6f7-f8ca53cd64ed req-be6ad8ee-4e22-4e03-b91e-bce58e48b0da service nova] Acquiring lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:45:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-711d254c-18ba-49c7-a6f7-f8ca53cd64ed req-be6ad8ee-4e22-4e03-b91e-bce58e48b0da service nova] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:45:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-711d254c-18ba-49c7-a6f7-f8ca53cd64ed req-be6ad8ee-4e22-4e03-b91e-bce58e48b0da service nova] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:45:31 user nova-compute[72766]: DEBUG nova.compute.manager [req-711d254c-18ba-49c7-a6f7-f8ca53cd64ed req-be6ad8ee-4e22-4e03-b91e-bce58e48b0da service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] No waiting events found dispatching network-vif-unplugged-69550d14-e1fb-4c2e-9526-19cae208fd08 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:45:31 user nova-compute[72766]: WARNING nova.compute.manager [req-711d254c-18ba-49c7-a6f7-f8ca53cd64ed req-be6ad8ee-4e22-4e03-b91e-bce58e48b0da service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Received unexpected event network-vif-unplugged-69550d14-e1fb-4c2e-9526-19cae208fd08 for instance with vm_state rescued and task_state unrescuing.
Aug 14 23:45:31 user nova-compute[72766]: DEBUG nova.compute.manager [req-711d254c-18ba-49c7-a6f7-f8ca53cd64ed req-be6ad8ee-4e22-4e03-b91e-bce58e48b0da service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Received event network-vif-plugged-69550d14-e1fb-4c2e-9526-19cae208fd08 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:45:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-711d254c-18ba-49c7-a6f7-f8ca53cd64ed req-be6ad8ee-4e22-4e03-b91e-bce58e48b0da service nova] Acquiring lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:45:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-711d254c-18ba-49c7-a6f7-f8ca53cd64ed req-be6ad8ee-4e22-4e03-b91e-bce58e48b0da service nova] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:45:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-711d254c-18ba-49c7-a6f7-f8ca53cd64ed req-be6ad8ee-4e22-4e03-b91e-bce58e48b0da service nova] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:45:31 user nova-compute[72766]: DEBUG nova.compute.manager [req-711d254c-18ba-49c7-a6f7-f8ca53cd64ed req-be6ad8ee-4e22-4e03-b91e-bce58e48b0da service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] No waiting events found dispatching network-vif-plugged-69550d14-e1fb-4c2e-9526-19cae208fd08 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:45:31 user nova-compute[72766]: WARNING nova.compute.manager [req-711d254c-18ba-49c7-a6f7-f8ca53cd64ed req-be6ad8ee-4e22-4e03-b91e-bce58e48b0da service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Received unexpected event network-vif-plugged-69550d14-e1fb-4c2e-9526-19cae208fd08 for instance with vm_state rescued and task_state unrescuing.
Aug 14 23:45:31 user nova-compute[72766]: DEBUG nova.compute.manager [req-711d254c-18ba-49c7-a6f7-f8ca53cd64ed req-be6ad8ee-4e22-4e03-b91e-bce58e48b0da service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Received event network-vif-plugged-69550d14-e1fb-4c2e-9526-19cae208fd08 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:45:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-711d254c-18ba-49c7-a6f7-f8ca53cd64ed req-be6ad8ee-4e22-4e03-b91e-bce58e48b0da service nova] Acquiring lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:45:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-711d254c-18ba-49c7-a6f7-f8ca53cd64ed req-be6ad8ee-4e22-4e03-b91e-bce58e48b0da service nova] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:45:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-711d254c-18ba-49c7-a6f7-f8ca53cd64ed req-be6ad8ee-4e22-4e03-b91e-bce58e48b0da service nova] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:45:31 user nova-compute[72766]: DEBUG nova.compute.manager [req-711d254c-18ba-49c7-a6f7-f8ca53cd64ed req-be6ad8ee-4e22-4e03-b91e-bce58e48b0da service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] No waiting events found dispatching network-vif-plugged-69550d14-e1fb-4c2e-9526-19cae208fd08 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:45:31 user nova-compute[72766]: WARNING nova.compute.manager [req-711d254c-18ba-49c7-a6f7-f8ca53cd64ed req-be6ad8ee-4e22-4e03-b91e-bce58e48b0da service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Received unexpected event network-vif-plugged-69550d14-e1fb-4c2e-9526-19cae208fd08 for instance with vm_state rescued and task_state unrescuing.
Aug 14 23:45:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Removed pending event for 2262995c-232a-4bfd-b8f4-c83b24c12f62 due to event {{(pid=72766) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 23:45:33 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692056733.160686, 2262995c-232a-4bfd-b8f4-c83b24c12f62 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:45:33 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] VM Resumed (Lifecycle Event)
Aug 14 23:45:33 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f818d802-4d9f-4910-8c52-6ecd51bf14a3 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:45:33 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:45:33 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:45:33 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 14 23:45:33 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692056733.1622136, 2262995c-232a-4bfd-b8f4-c83b24c12f62 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:45:33 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] VM Started (Lifecycle Event)
Aug 14 23:45:33 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:45:33 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:45:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-68092eca-eee1-45be-937f-ed26f9740e62 req-9712b234-eb6c-4bed-b70f-eac8ece3fcd6 service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Received event network-vif-plugged-69550d14-e1fb-4c2e-9526-19cae208fd08 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:45:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-68092eca-eee1-45be-937f-ed26f9740e62 req-9712b234-eb6c-4bed-b70f-eac8ece3fcd6 service nova] Acquiring lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:45:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-68092eca-eee1-45be-937f-ed26f9740e62 req-9712b234-eb6c-4bed-b70f-eac8ece3fcd6 service nova] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:45:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-68092eca-eee1-45be-937f-ed26f9740e62 req-9712b234-eb6c-4bed-b70f-eac8ece3fcd6 service nova] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:45:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-68092eca-eee1-45be-937f-ed26f9740e62 req-9712b234-eb6c-4bed-b70f-eac8ece3fcd6 service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] No waiting events found dispatching network-vif-plugged-69550d14-e1fb-4c2e-9526-19cae208fd08 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:45:33 user nova-compute[72766]: WARNING nova.compute.manager [req-68092eca-eee1-45be-937f-ed26f9740e62 req-9712b234-eb6c-4bed-b70f-eac8ece3fcd6 service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Received unexpected event network-vif-plugged-69550d14-e1fb-4c2e-9526-19cae208fd08 for instance with vm_state active and task_state None.
Aug 14 23:45:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:45:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:45:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:45:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:45:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:45:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:45:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:45:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:45:55 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:45:58 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:45:58 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:45:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:45:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-b9ede44b-eef5-473f-a279-8166a442a45d" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:45:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-b9ede44b-eef5-473f-a279-8166a442a45d" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:45:58 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:45:59 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Updating instance_info_cache with network_info: [{"id": "02fed6c3-ea8a-4fd6-a404-29ea7c038c6a", "address": "fa:16:3e:52:c1:fe", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02fed6c3-ea", "ovs_interfaceid": "02fed6c3-ea8a-4fd6-a404-29ea7c038c6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:45:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-b9ede44b-eef5-473f-a279-8166a442a45d" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:45:59 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:45:59 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:45:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:46:01 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:46:01 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:46:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:46:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:46:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:46:01 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:46:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:46:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:46:01 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:46:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:46:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:46:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:46:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:46:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:46:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:46:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:46:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:46:02 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:46:03 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:46:03 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:46:03 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=8656MB free_disk=25.224910736083984GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:46:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:46:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:46:03 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 2262995c-232a-4bfd-b8f4-c83b24c12f62 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:46:03 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance b9ede44b-eef5-473f-a279-8166a442a45d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:46:03 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:46:03 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:46:03 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:46:03 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:46:03 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:46:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.232s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:46:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:46:04 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:46:04 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:46:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:46:07 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:46:08 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:46:08 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:46:08 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:46:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:46:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:46:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:46:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:46:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:46:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:46:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:46:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:46:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:46:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:46:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:46:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:46:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:46:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:46:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:46:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:46:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:46:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:46:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:46:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:46:56 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:46:58 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:46:58 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:46:58 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Rebuilding the list of instances to heal {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 23:46:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:46:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-2262995c-232a-4bfd-b8f4-c83b24c12f62" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:46:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-2262995c-232a-4bfd-b8f4-c83b24c12f62" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:46:59 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:46:59 user nova-compute[72766]: DEBUG nova.objects.instance [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lazy-loading 'info_cache' on Instance uuid 2262995c-232a-4bfd-b8f4-c83b24c12f62 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:46:59 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Updating instance_info_cache with network_info: [{"id": "69550d14-e1fb-4c2e-9526-19cae208fd08", "address": "fa:16:3e:bd:82:2f", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69550d14-e1", "ovs_interfaceid": "69550d14-e1fb-4c2e-9526-19cae208fd08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:46:59 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-2262995c-232a-4bfd-b8f4-c83b24c12f62" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:46:59 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:46:59 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:47:02 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:47:03 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:47:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:47:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:47:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:47:03 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:47:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:47:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:47:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:47:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:47:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:47:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:47:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:47:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:47:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:47:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:47:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:47:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:47:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:47:05 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:47:05 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:47:05 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=8717MB free_disk=25.224285125732422GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:47:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:47:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.003s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:47:05 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 2262995c-232a-4bfd-b8f4-c83b24c12f62 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:47:05 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance b9ede44b-eef5-473f-a279-8166a442a45d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:47:05 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:47:05 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:47:05 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Refreshing inventories for resource provider 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 23:47:05 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Updating ProviderTree inventory for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 23:47:05 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Updating inventory in ProviderTree for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 23:47:05 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Refreshing aggregate associations for resource provider 45c8ff08-bf31-4ab6-8452-2e293102f899, aggregates: None {{(pid=72766) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 23:47:05 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Refreshing trait associations for resource provider 45c8ff08-bf31-4ab6-8452-2e293102f899, traits: COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=72766) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 23:47:05 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:47:05 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:47:05 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:47:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.600s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:47:06 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:47:08 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:47:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:47:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:47:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:47:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:47:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:47:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:47:09 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:47:10 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:47:10 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:47:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:47:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:47:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:47:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:47:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquiring lock "486c626d-404d-463d-afa2-2310f1bb3797" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:47:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "486c626d-404d-463d-afa2-2310f1bb3797" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:47:25 user nova-compute[72766]: DEBUG nova.compute.manager [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Starting instance... {{(pid=72766) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 23:47:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:47:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:47:25 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72766) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 23:47:25 user nova-compute[72766]: INFO nova.compute.claims [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Claim successful on node user
Aug 14 23:47:25 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:47:25 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:47:25 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.251s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:47:25 user nova-compute[72766]: DEBUG nova.compute.manager [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Start building networks asynchronously for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 23:47:25 user nova-compute[72766]: DEBUG nova.compute.manager [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Allocating IP information in the background. {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 23:47:25 user nova-compute[72766]: DEBUG nova.network.neutron [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] allocate_for_instance() {{(pid=72766) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 23:47:25 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 23:47:26 user nova-compute[72766]: DEBUG nova.compute.manager [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Start building block device mappings for instance. {{(pid=72766) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 23:47:26 user nova-compute[72766]: DEBUG nova.policy [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a1c0e7bd2744a349ecfef160a6f54f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaadde665b704e4d882299b7f747d7a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72766) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 23:47:26 user nova-compute[72766]: DEBUG nova.compute.manager [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Start spawning the instance on the hypervisor. {{(pid=72766) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 23:47:26 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Creating instance directory {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 23:47:26 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Creating image(s)
Aug 14 23:47:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquiring lock "/opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:47:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "/opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:47:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "/opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:47:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:47:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.178s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:47:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquiring lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:47:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:47:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:47:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.188s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:47:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/disk 1073741824 {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:47:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/disk 1073741824" returned: 0 in 0.050s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:47:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:47:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:47:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.190s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:47:26 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Checking if we can resize image /opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/disk. size=1073741824 {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 23:47:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:47:26 user nova-compute[72766]: DEBUG nova.network.neutron [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Successfully created port: 25aa8515-5f80-4dac-a843-3d38eea9ce0b {{(pid=72766) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 23:47:26 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:47:26 user nova-compute[72766]: DEBUG nova.virt.disk.api [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Cannot resize image /opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/disk to a smaller size. {{(pid=72766) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 23:47:26 user nova-compute[72766]: DEBUG nova.objects.instance [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lazy-loading 'migration_context' on Instance uuid 486c626d-404d-463d-afa2-2310f1bb3797 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:47:26 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 23:47:26 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Ensure instance console log exists: /opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/console.log {{(pid=72766) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 23:47:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:47:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:47:26 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:47:27 user nova-compute[72766]: DEBUG nova.network.neutron [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Successfully updated port: 25aa8515-5f80-4dac-a843-3d38eea9ce0b {{(pid=72766) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 23:47:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquiring lock "refresh_cache-486c626d-404d-463d-afa2-2310f1bb3797" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:47:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquired lock "refresh_cache-486c626d-404d-463d-afa2-2310f1bb3797" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:47:27 user nova-compute[72766]: DEBUG nova.network.neutron [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:47:27 user nova-compute[72766]: DEBUG nova.compute.manager [req-77871804-4cee-4452-962f-9651939f10ea req-47bfb94b-6fcc-4165-9b09-8a01df845a2a service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Received event network-changed-25aa8515-5f80-4dac-a843-3d38eea9ce0b {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:47:27 user nova-compute[72766]: DEBUG nova.compute.manager [req-77871804-4cee-4452-962f-9651939f10ea req-47bfb94b-6fcc-4165-9b09-8a01df845a2a service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Refreshing instance network info cache due to event network-changed-25aa8515-5f80-4dac-a843-3d38eea9ce0b. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:47:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-77871804-4cee-4452-962f-9651939f10ea req-47bfb94b-6fcc-4165-9b09-8a01df845a2a service nova] Acquiring lock "refresh_cache-486c626d-404d-463d-afa2-2310f1bb3797" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:47:27 user nova-compute[72766]: DEBUG nova.network.neutron [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Instance cache missing network info. {{(pid=72766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 23:47:27 user nova-compute[72766]: DEBUG nova.network.neutron [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Updating instance_info_cache with network_info: [{"id": "25aa8515-5f80-4dac-a843-3d38eea9ce0b", "address": "fa:16:3e:e0:3b:bf", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25aa8515-5f", "ovs_interfaceid": "25aa8515-5f80-4dac-a843-3d38eea9ce0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:47:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Releasing lock "refresh_cache-486c626d-404d-463d-afa2-2310f1bb3797" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:47:27 user nova-compute[72766]: DEBUG nova.compute.manager [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Instance network_info: |[{"id": "25aa8515-5f80-4dac-a843-3d38eea9ce0b", "address": "fa:16:3e:e0:3b:bf", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25aa8515-5f", "ovs_interfaceid": "25aa8515-5f80-4dac-a843-3d38eea9ce0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72766) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 23:47:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-77871804-4cee-4452-962f-9651939f10ea req-47bfb94b-6fcc-4165-9b09-8a01df845a2a service nova] Acquired lock "refresh_cache-486c626d-404d-463d-afa2-2310f1bb3797" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:47:27 user nova-compute[72766]: DEBUG nova.network.neutron [req-77871804-4cee-4452-962f-9651939f10ea req-47bfb94b-6fcc-4165-9b09-8a01df845a2a service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Refreshing network info cache for port 25aa8515-5f80-4dac-a843-3d38eea9ce0b {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:47:27 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Start _get_guest_xml network_info=[{"id": "25aa8515-5f80-4dac-a843-3d38eea9ce0b", "address": "fa:16:3e:e0:3b:bf", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25aa8515-5f", "ovs_interfaceid": "25aa8515-5f80-4dac-a843-3d38eea9ce0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'd2900d30-2c4c-4d57-9135-d45564c0c596'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:47:27 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:47:27 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:47:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:47:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:47:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:47:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:47:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:47:28 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:47:28 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:47:28 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:47:28 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:47:28 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:47:28 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:47:28 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:47:28 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:47:28 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:47:28 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:47:28 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:47:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:47:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-34373646',display_name='tempest-ServerRescueNegativeTestJSON-server-34373646',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-34373646',id=52,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOq8eR1EAGbJYgvw63CEOWBxTiSB3neI/CoA3G3TNCfoiBNFE3xidnhdFiVuQ5LEsbDo4ydyigXAzeB+0yT0qNLQXwNNNo6AayJCUJspvkI2X9vZT/42kRcVQ/X8ZYvv0A==',key_name='tempest-keypair-591484672',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eaadde665b704e4d882299b7f747d7a5',ramdisk_id='',reservation_id='r-rjnagpzg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1344834449',owner_user_name='tempest-ServerRescueNegativeTestJSON-1344834449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:47:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a1c0e7bd2744a349ecfef160a6f54f5',uuid=486c626d-404d-463d-afa2-2310f1bb3797,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25aa8515-5f80-4dac-a843-3d38eea9ce0b", "address": "fa:16:3e:e0:3b:bf", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25aa8515-5f", "ovs_interfaceid": "25aa8515-5f80-4dac-a843-3d38eea9ce0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:47:28 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Converting VIF {"id": "25aa8515-5f80-4dac-a843-3d38eea9ce0b", "address": "fa:16:3e:e0:3b:bf", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25aa8515-5f", "ovs_interfaceid": "25aa8515-5f80-4dac-a843-3d38eea9ce0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:47:28 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:3b:bf,bridge_name='br-int',has_traffic_filtering=True,id=25aa8515-5f80-4dac-a843-3d38eea9ce0b,network=Network(71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25aa8515-5f') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:47:28 user nova-compute[72766]: DEBUG nova.objects.instance [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lazy-loading 'pci_devices' on Instance uuid 486c626d-404d-463d-afa2-2310f1bb3797 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:47:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:47:28 user nova-compute[72766]:   <uuid>486c626d-404d-463d-afa2-2310f1bb3797</uuid>
Aug 14 23:47:28 user nova-compute[72766]:   <name>instance-00000034</name>
Aug 14 23:47:28 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:47:28 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:47:28 user nova-compute[72766]:   <metadata>
Aug 14 23:47:28 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:47:28 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:47:28 user nova-compute[72766]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-34373646</nova:name>
Aug 14 23:47:28 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:47:27</nova:creationTime>
Aug 14 23:47:28 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:47:28 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:47:28 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:47:28 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:47:28 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:47:28 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:47:28 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:47:28 user nova-compute[72766]:       <nova:owner>
Aug 14 23:47:28 user nova-compute[72766]:         <nova:user uuid="4a1c0e7bd2744a349ecfef160a6f54f5">tempest-ServerRescueNegativeTestJSON-1344834449-project-member</nova:user>
Aug 14 23:47:28 user nova-compute[72766]:         <nova:project uuid="eaadde665b704e4d882299b7f747d7a5">tempest-ServerRescueNegativeTestJSON-1344834449</nova:project>
Aug 14 23:47:28 user nova-compute[72766]:       </nova:owner>
Aug 14 23:47:28 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 23:47:28 user nova-compute[72766]:       <nova:ports>
Aug 14 23:47:28 user nova-compute[72766]:         <nova:port uuid="25aa8515-5f80-4dac-a843-3d38eea9ce0b">
Aug 14 23:47:28 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 23:47:28 user nova-compute[72766]:         </nova:port>
Aug 14 23:47:28 user nova-compute[72766]:       </nova:ports>
Aug 14 23:47:28 user nova-compute[72766]:     </nova:instance>
Aug 14 23:47:28 user nova-compute[72766]:   </metadata>
Aug 14 23:47:28 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:47:28 user nova-compute[72766]:     <system>
Aug 14 23:47:28 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:47:28 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:47:28 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:47:28 user nova-compute[72766]:       <entry name="serial">486c626d-404d-463d-afa2-2310f1bb3797</entry>
Aug 14 23:47:28 user nova-compute[72766]:       <entry name="uuid">486c626d-404d-463d-afa2-2310f1bb3797</entry>
Aug 14 23:47:28 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:47:28 user nova-compute[72766]:     </system>
Aug 14 23:47:28 user nova-compute[72766]:   </sysinfo>
Aug 14 23:47:28 user nova-compute[72766]:   <os>
Aug 14 23:47:28 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:47:28 user nova-compute[72766]:     <boot dev="hd"/>
Aug 14 23:47:28 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:47:28 user nova-compute[72766]:   </os>
Aug 14 23:47:28 user nova-compute[72766]:   <features>
Aug 14 23:47:28 user nova-compute[72766]:     <acpi/>
Aug 14 23:47:28 user nova-compute[72766]:     <apic/>
Aug 14 23:47:28 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:47:28 user nova-compute[72766]:   </features>
Aug 14 23:47:28 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:47:28 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:47:28 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:47:28 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:47:28 user nova-compute[72766]:   </clock>
Aug 14 23:47:28 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:47:28 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:47:28 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:47:28 user nova-compute[72766]:   </cpu>
Aug 14 23:47:28 user nova-compute[72766]:   <devices>
Aug 14 23:47:28 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 23:47:28 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 23:47:28 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/disk"/>
Aug 14 23:47:28 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:47:28 user nova-compute[72766]:     </disk>
Aug 14 23:47:28 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:47:28 user nova-compute[72766]:       <mac address="fa:16:3e:e0:3b:bf"/>
Aug 14 23:47:28 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:47:28 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:47:28 user nova-compute[72766]:       <target dev="tap25aa8515-5f"/>
Aug 14 23:47:28 user nova-compute[72766]:     </interface>
Aug 14 23:47:28 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:47:28 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/console.log" append="off"/>
Aug 14 23:47:28 user nova-compute[72766]:     </serial>
Aug 14 23:47:28 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:47:28 user nova-compute[72766]:     <video>
Aug 14 23:47:28 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:47:28 user nova-compute[72766]:     </video>
Aug 14 23:47:28 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:47:28 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:47:28 user nova-compute[72766]:     </rng>
Aug 14 23:47:28 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:47:28 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:47:28 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:47:28 user nova-compute[72766]:     </memballoon>
Aug 14 23:47:28 user nova-compute[72766]:   </devices>
Aug 14 23:47:28 user nova-compute[72766]: </domain>
Aug 14 23:47:28 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:47:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:47:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-34373646',display_name='tempest-ServerRescueNegativeTestJSON-server-34373646',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-34373646',id=52,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOq8eR1EAGbJYgvw63CEOWBxTiSB3neI/CoA3G3TNCfoiBNFE3xidnhdFiVuQ5LEsbDo4ydyigXAzeB+0yT0qNLQXwNNNo6AayJCUJspvkI2X9vZT/42kRcVQ/X8ZYvv0A==',key_name='tempest-keypair-591484672',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eaadde665b704e4d882299b7f747d7a5',ramdisk_id='',reservation_id='r-rjnagpzg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1344834449',owner_user_name='tempest-ServerRescueNegativeTestJSON-1344834449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:47:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a1c0e7bd2744a349ecfef160a6f54f5',uuid=486c626d-404d-463d-afa2-2310f1bb3797,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25aa8515-5f80-4dac-a843-3d38eea9ce0b", "address": "fa:16:3e:e0:3b:bf", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25aa8515-5f", "ovs_interfaceid": "25aa8515-5f80-4dac-a843-3d38eea9ce0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 23:47:28 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Converting VIF {"id": "25aa8515-5f80-4dac-a843-3d38eea9ce0b", "address": "fa:16:3e:e0:3b:bf", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25aa8515-5f", "ovs_interfaceid": "25aa8515-5f80-4dac-a843-3d38eea9ce0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:47:28 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:3b:bf,bridge_name='br-int',has_traffic_filtering=True,id=25aa8515-5f80-4dac-a843-3d38eea9ce0b,network=Network(71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25aa8515-5f') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:47:28 user nova-compute[72766]: DEBUG os_vif [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:3b:bf,bridge_name='br-int',has_traffic_filtering=True,id=25aa8515-5f80-4dac-a843-3d38eea9ce0b,network=Network(71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25aa8515-5f') {{(pid=72766) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 23:47:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:47:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:47:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 23:47:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:47:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25aa8515-5f, may_exist=True, interface_attrs={}) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:47:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap25aa8515-5f, col_values=(('external_ids', {'iface-id': '25aa8515-5f80-4dac-a843-3d38eea9ce0b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:3b:bf', 'vm-uuid': '486c626d-404d-463d-afa2-2310f1bb3797'}),), if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:47:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:47:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:47:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:47:28 user nova-compute[72766]: INFO os_vif [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:3b:bf,bridge_name='br-int',has_traffic_filtering=True,id=25aa8515-5f80-4dac-a843-3d38eea9ce0b,network=Network(71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25aa8515-5f')
Aug 14 23:47:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:47:28 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] No VIF found with MAC fa:16:3e:e0:3b:bf, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:47:29 user nova-compute[72766]: DEBUG nova.network.neutron [req-77871804-4cee-4452-962f-9651939f10ea req-47bfb94b-6fcc-4165-9b09-8a01df845a2a service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Updated VIF entry in instance network info cache for port 25aa8515-5f80-4dac-a843-3d38eea9ce0b. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:47:29 user nova-compute[72766]: DEBUG nova.network.neutron [req-77871804-4cee-4452-962f-9651939f10ea req-47bfb94b-6fcc-4165-9b09-8a01df845a2a service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Updating instance_info_cache with network_info: [{"id": "25aa8515-5f80-4dac-a843-3d38eea9ce0b", "address": "fa:16:3e:e0:3b:bf", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25aa8515-5f", "ovs_interfaceid": "25aa8515-5f80-4dac-a843-3d38eea9ce0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:47:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-77871804-4cee-4452-962f-9651939f10ea req-47bfb94b-6fcc-4165-9b09-8a01df845a2a service nova] Releasing lock "refresh_cache-486c626d-404d-463d-afa2-2310f1bb3797" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:47:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:47:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:47:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:47:29 user nova-compute[72766]: DEBUG nova.compute.manager [req-7232bd67-230a-4f1d-8dc4-5e534f1ef46a req-6eb019ea-dc96-477e-97cc-361d8326beba service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Received event network-vif-plugged-25aa8515-5f80-4dac-a843-3d38eea9ce0b {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:47:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7232bd67-230a-4f1d-8dc4-5e534f1ef46a req-6eb019ea-dc96-477e-97cc-361d8326beba service nova] Acquiring lock "486c626d-404d-463d-afa2-2310f1bb3797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:47:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7232bd67-230a-4f1d-8dc4-5e534f1ef46a req-6eb019ea-dc96-477e-97cc-361d8326beba service nova] Lock "486c626d-404d-463d-afa2-2310f1bb3797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:47:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-7232bd67-230a-4f1d-8dc4-5e534f1ef46a req-6eb019ea-dc96-477e-97cc-361d8326beba service nova] Lock "486c626d-404d-463d-afa2-2310f1bb3797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:47:29 user nova-compute[72766]: DEBUG nova.compute.manager [req-7232bd67-230a-4f1d-8dc4-5e534f1ef46a req-6eb019ea-dc96-477e-97cc-361d8326beba service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] No waiting events found dispatching network-vif-plugged-25aa8515-5f80-4dac-a843-3d38eea9ce0b {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:47:29 user nova-compute[72766]: WARNING nova.compute.manager [req-7232bd67-230a-4f1d-8dc4-5e534f1ef46a req-6eb019ea-dc96-477e-97cc-361d8326beba service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Received unexpected event network-vif-plugged-25aa8515-5f80-4dac-a843-3d38eea9ce0b for instance with vm_state building and task_state spawning.
Aug 14 23:47:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:47:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:47:31 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692056851.7535117, 486c626d-404d-463d-afa2-2310f1bb3797 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:47:31 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] VM Resumed (Lifecycle Event)
Aug 14 23:47:31 user nova-compute[72766]: DEBUG nova.compute.manager [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Instance event wait completed in 0 seconds for  {{(pid=72766) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 23:47:31 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Guest created on hypervisor {{(pid=72766) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 23:47:31 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Instance spawned successfully.
Aug 14 23:47:31 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 23:47:31 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:47:31 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:47:31 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Found default for hw_cdrom_bus of ide {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:47:31 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Found default for hw_disk_bus of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:47:31 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Found default for hw_input_bus of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:47:31 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Found default for hw_pointer_model of None {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:47:31 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Found default for hw_video_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:47:31 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Found default for hw_vif_model of virtio {{(pid=72766) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 23:47:31 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:47:31 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692056851.7548702, 486c626d-404d-463d-afa2-2310f1bb3797 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:47:31 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] VM Started (Lifecycle Event)
Aug 14 23:47:31 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:47:31 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:47:31 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 23:47:31 user nova-compute[72766]: INFO nova.compute.manager [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Took 5.73 seconds to spawn the instance on the hypervisor.
Aug 14 23:47:31 user nova-compute[72766]: DEBUG nova.compute.manager [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:47:31 user nova-compute[72766]: INFO nova.compute.manager [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Took 6.30 seconds to build instance.
Aug 14 23:47:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-6be51196-633e-481c-94a5-6c632cfb3ec1 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "486c626d-404d-463d-afa2-2310f1bb3797" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.389s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:47:31 user nova-compute[72766]: DEBUG nova.compute.manager [req-3c2f5486-586d-41c5-80e8-4998daf9e394 req-095608b5-c969-4308-bb68-a8ae9e4cfa07 service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Received event network-vif-plugged-25aa8515-5f80-4dac-a843-3d38eea9ce0b {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:47:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-3c2f5486-586d-41c5-80e8-4998daf9e394 req-095608b5-c969-4308-bb68-a8ae9e4cfa07 service nova] Acquiring lock "486c626d-404d-463d-afa2-2310f1bb3797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:47:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-3c2f5486-586d-41c5-80e8-4998daf9e394 req-095608b5-c969-4308-bb68-a8ae9e4cfa07 service nova] Lock "486c626d-404d-463d-afa2-2310f1bb3797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:47:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-3c2f5486-586d-41c5-80e8-4998daf9e394 req-095608b5-c969-4308-bb68-a8ae9e4cfa07 service nova] Lock "486c626d-404d-463d-afa2-2310f1bb3797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:47:31 user nova-compute[72766]: DEBUG nova.compute.manager [req-3c2f5486-586d-41c5-80e8-4998daf9e394 req-095608b5-c969-4308-bb68-a8ae9e4cfa07 service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] No waiting events found dispatching network-vif-plugged-25aa8515-5f80-4dac-a843-3d38eea9ce0b {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:47:31 user nova-compute[72766]: WARNING nova.compute.manager [req-3c2f5486-586d-41c5-80e8-4998daf9e394 req-095608b5-c969-4308-bb68-a8ae9e4cfa07 service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Received unexpected event network-vif-plugged-25aa8515-5f80-4dac-a843-3d38eea9ce0b for instance with vm_state building and task_state spawning.
Aug 14 23:47:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:47:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:47:35 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:47:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:47:39 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:47:39 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Cleaning up deleted instances {{(pid=72766) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 23:47:39 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] There are 0 instances to clean {{(pid=72766) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 23:47:39 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:47:39 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72766) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 23:47:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:47:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:47:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:47:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:47:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:47:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:47:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:47:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:47:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:47:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:47:56 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:47:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:47:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:48:00 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:48:00 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:48:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-b9ede44b-eef5-473f-a279-8166a442a45d" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:48:00 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-b9ede44b-eef5-473f-a279-8166a442a45d" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:48:00 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:48:01 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Updating instance_info_cache with network_info: [{"id": "02fed6c3-ea8a-4fd6-a404-29ea7c038c6a", "address": "fa:16:3e:52:c1:fe", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02fed6c3-ea", "ovs_interfaceid": "02fed6c3-ea8a-4fd6-a404-29ea7c038c6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:48:01 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-b9ede44b-eef5-473f-a279-8166a442a45d" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:48:01 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:48:01 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:48:02 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:48:02 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:48:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:48:03 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:48:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:48:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:48:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:48:03 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:48:03 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:48:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:48:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:48:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:48:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:48:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:48:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:48:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:48:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:48:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:48:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:48:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:48:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:48:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:48:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:48:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:48:05 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:48:05 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:48:05 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=8583MB free_disk=25.194576263427734GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:48:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:48:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:48:05 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 2262995c-232a-4bfd-b8f4-c83b24c12f62 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:48:05 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance b9ede44b-eef5-473f-a279-8166a442a45d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:48:05 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 486c626d-404d-463d-afa2-2310f1bb3797 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:48:05 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:48:05 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:48:06 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:48:06 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:48:06 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:48:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.325s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:48:07 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:48:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:48:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:48:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:48:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:48:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:48:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:48:08 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:48:10 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:48:10 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:48:11 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:48:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:48:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:48:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:48:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:48:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:48:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:48:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:48:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:48:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:48:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:48:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:48:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:48:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:48:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:48:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:48:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:48:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:48:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:48:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:48:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:48:58 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:49:02 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:49:02 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:49:02 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Rebuilding the list of instances to heal {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 23:49:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-2262995c-232a-4bfd-b8f4-c83b24c12f62" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:49:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-2262995c-232a-4bfd-b8f4-c83b24c12f62" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:49:02 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:49:02 user nova-compute[72766]: DEBUG nova.objects.instance [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lazy-loading 'info_cache' on Instance uuid 2262995c-232a-4bfd-b8f4-c83b24c12f62 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:49:03 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Updating instance_info_cache with network_info: [{"id": "69550d14-e1fb-4c2e-9526-19cae208fd08", "address": "fa:16:3e:bd:82:2f", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69550d14-e1", "ovs_interfaceid": "69550d14-e1fb-4c2e-9526-19cae208fd08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:49:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-2262995c-232a-4bfd-b8f4-c83b24c12f62" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:49:03 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:49:03 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:49:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:49:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:49:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:49:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:49:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:49:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:49:03 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:49:04 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:49:04 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:49:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:49:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:49:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:49:04 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:49:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:49:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:49:04 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:49:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:49:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:49:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:49:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:49:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:49:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:49:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:49:05 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:49:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:49:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:49:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:49:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:49:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:49:06 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:49:06 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:49:06 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=8637MB free_disk=25.194015502929688GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:49:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:49:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:49:06 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 2262995c-232a-4bfd-b8f4-c83b24c12f62 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:49:06 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance b9ede44b-eef5-473f-a279-8166a442a45d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:49:06 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 486c626d-404d-463d-afa2-2310f1bb3797 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:49:06 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:49:06 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:49:07 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:49:07 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:49:07 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:49:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.234s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:49:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:49:13 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:49:13 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:49:13 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:49:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:49:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:49:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:49:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:49:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:49:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:49:13 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:49:16 user nova-compute[72766]: DEBUG nova.compute.manager [req-8d7c9647-82f9-4a4e-9dc1-f63222964eb4 req-ae7eb5f6-07f9-46d5-9e2a-47fb2bd0f150 service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Received event network-changed-25aa8515-5f80-4dac-a843-3d38eea9ce0b {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:49:16 user nova-compute[72766]: DEBUG nova.compute.manager [req-8d7c9647-82f9-4a4e-9dc1-f63222964eb4 req-ae7eb5f6-07f9-46d5-9e2a-47fb2bd0f150 service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Refreshing instance network info cache due to event network-changed-25aa8515-5f80-4dac-a843-3d38eea9ce0b. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:49:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8d7c9647-82f9-4a4e-9dc1-f63222964eb4 req-ae7eb5f6-07f9-46d5-9e2a-47fb2bd0f150 service nova] Acquiring lock "refresh_cache-486c626d-404d-463d-afa2-2310f1bb3797" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:49:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8d7c9647-82f9-4a4e-9dc1-f63222964eb4 req-ae7eb5f6-07f9-46d5-9e2a-47fb2bd0f150 service nova] Acquired lock "refresh_cache-486c626d-404d-463d-afa2-2310f1bb3797" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:49:16 user nova-compute[72766]: DEBUG nova.network.neutron [req-8d7c9647-82f9-4a4e-9dc1-f63222964eb4 req-ae7eb5f6-07f9-46d5-9e2a-47fb2bd0f150 service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Refreshing network info cache for port 25aa8515-5f80-4dac-a843-3d38eea9ce0b {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:49:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquiring lock "486c626d-404d-463d-afa2-2310f1bb3797" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:49:16 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "486c626d-404d-463d-afa2-2310f1bb3797" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:49:17 user nova-compute[72766]: DEBUG nova.objects.instance [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lazy-loading 'flavor' on Instance uuid 486c626d-404d-463d-afa2-2310f1bb3797 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:49:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "486c626d-404d-463d-afa2-2310f1bb3797" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:49:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquiring lock "486c626d-404d-463d-afa2-2310f1bb3797" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:49:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "486c626d-404d-463d-afa2-2310f1bb3797" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:49:17 user nova-compute[72766]: INFO nova.compute.manager [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Attaching volume 61edf1a3-86eb-4d20-8ac3-6e09e17df403 to /dev/vdb
Aug 14 23:49:17 user nova-compute[72766]: DEBUG os_brick.utils [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:49:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:49:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:49:17 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c27902-30ae-4b36-9afc-70314694c058]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f42c5c2949ce\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:49:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:49:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:49:17 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad32b05-f7e4-4b22-abd8-f0b35e945630]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:49:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:49:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:49:17 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fac4b2-0bdd-4a35-a5f9-6a9859a7f1ed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:49:17 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a7d0de-3f25-4147-8716-8a27d95d5a32]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:49:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Running cmd (subprocess): nvme version {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:49:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] 'nvme version' failed. Not Retrying. {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:49:17 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.nvmeof [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] nvme not present on system {{(pid=72766) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 23:49:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:49:17 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 23:49:17 user nova-compute[72766]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 23:49:17 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[49899a0c-c7fe-4af2-b6b6-c9d897eeb3bc]: (4, '') {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:49:17 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72766) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 23:49:17 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 23:49:17 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.lightos [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] LIGHTOS: no hostnqn found. {{(pid=72766) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 23:49:17 user nova-compute[72766]: DEBUG os_brick.utils [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f42c5c2949ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:49:17 user nova-compute[72766]: DEBUG nova.virt.block_device [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Updating existing volume attachment record: 6cafaee1-eb1f-4600-9a63-4bb506a7bcce {{(pid=72766) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 23:49:17 user nova-compute[72766]: DEBUG nova.network.neutron [req-8d7c9647-82f9-4a4e-9dc1-f63222964eb4 req-ae7eb5f6-07f9-46d5-9e2a-47fb2bd0f150 service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Updated VIF entry in instance network info cache for port 25aa8515-5f80-4dac-a843-3d38eea9ce0b. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:49:17 user nova-compute[72766]: DEBUG nova.network.neutron [req-8d7c9647-82f9-4a4e-9dc1-f63222964eb4 req-ae7eb5f6-07f9-46d5-9e2a-47fb2bd0f150 service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Updating instance_info_cache with network_info: [{"id": "25aa8515-5f80-4dac-a843-3d38eea9ce0b", "address": "fa:16:3e:e0:3b:bf", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25aa8515-5f", "ovs_interfaceid": "25aa8515-5f80-4dac-a843-3d38eea9ce0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:49:17 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-8d7c9647-82f9-4a4e-9dc1-f63222964eb4 req-ae7eb5f6-07f9-46d5-9e2a-47fb2bd0f150 service nova] Releasing lock "refresh_cache-486c626d-404d-463d-afa2-2310f1bb3797" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:49:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:49:19 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:49:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:49:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Calling os-brick to attach iSCSI Volume {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dGjOTruk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:49:25 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:49:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:49:25 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:49:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:49:25 user nova-compute[72766]: INFO os_brick.initiator.connectors.iscsi [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 23:49:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403 -p 172.16.0.220:3260 {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[440525d1-9d05-4cc5-b07e-eb802c04b053]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 23:49:25 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403 -p 172.16.0.220:3260 --interface default --op new {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[80857585-c7e7-4d56-872d-a03b90082484]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403] added\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403] added
Aug 14 23:49:25 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba081c0-a08f-4c86-b572-fa26158c649d]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69c5ff9-ac7d-4365-876d-141d00c82056]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dGjOTruk {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dGjOTruk" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[801c94a3-0e50-45d6-ab1e-c030806103d1]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dGjOTruk'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[26cbea53-f74b-47a8-bcdb-374c1828c334]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[642c0a3a-879c-403b-a272-84a298fb6a27]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 23:49:25 user nova-compute[72766]:  {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 23:49:25 user nova-compute[72766]:  {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:49:25 user nova-compute[72766]: WARNING os_brick.initiator.connectors.iscsi [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 23:49:25 user nova-compute[72766]: 
Aug 14 23:49:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403 -p 172.16.0.220:3260 --login {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1dc52a-ba51-49f8-b7d0-253895ee75ba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403, portal: 172.16.0.220,3260]
Aug 14 23:49:25 user nova-compute[72766]: Login to [iface: default, target: iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403, portal: 172.16.0.220,3260] successful.
Aug 14 23:49:25 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a679973-4b84-4965-b052-0165a2e8f89d]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e6cee1-49ff-491a-a276-6cc19773025f]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403 (non-flash)
Aug 14 23:49:25 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403 (non-flash)
Aug 14 23:49:25 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Connected to 172.16.0.220:3260 {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=72766) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72766) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b70a1dd-e02e-44b3-8dc5-ada4a275f632]: (4, ('- - 0', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:49:25 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: None {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:49:26 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72766) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 23:49:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dGjOTruk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72766) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 23:49:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:49:26 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26664636338623032', 'path': '/dev/sdb'} {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:49:26 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664636338623032', 'path': '/dev/sdb'} {{(pid=72766) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 23:49:26 user nova-compute[72766]: DEBUG nova.objects.instance [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lazy-loading 'flavor' on Instance uuid 486c626d-404d-463d-afa2-2310f1bb3797 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:49:27 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 23:49:27 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:49:27 user nova-compute[72766]:   <source dev="/dev/sdb"/>
Aug 14 23:49:27 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:49:27 user nova-compute[72766]:   <serial>61edf1a3-86eb-4d20-8ac3-6e09e17df403</serial>
Aug 14 23:49:27 user nova-compute[72766]: </disk>
Aug 14 23:49:27 user nova-compute[72766]:  {{(pid=72766) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 23:49:27 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:49:27 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:49:27 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] No VIF found with MAC fa:16:3e:e0:3b:bf, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:49:27 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-96cf2d9f-3017-4ec5-bbcc-3bf6fee7ff1f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "486c626d-404d-463d-afa2-2310f1bb3797" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.623s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:49:28 user nova-compute[72766]: INFO nova.compute.manager [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Rescuing
Aug 14 23:49:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquiring lock "refresh_cache-486c626d-404d-463d-afa2-2310f1bb3797" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:49:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquired lock "refresh_cache-486c626d-404d-463d-afa2-2310f1bb3797" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:49:28 user nova-compute[72766]: DEBUG nova.network.neutron [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:49:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:49:28 user nova-compute[72766]: DEBUG nova.network.neutron [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Updating instance_info_cache with network_info: [{"id": "25aa8515-5f80-4dac-a843-3d38eea9ce0b", "address": "fa:16:3e:e0:3b:bf", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25aa8515-5f", "ovs_interfaceid": "25aa8515-5f80-4dac-a843-3d38eea9ce0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:49:28 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Releasing lock "refresh_cache-486c626d-404d-463d-afa2-2310f1bb3797" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:49:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:49:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:49:29 user nova-compute[72766]: DEBUG nova.compute.manager [req-3811f323-bac9-4ead-967d-f6d95ebd11bf req-811623ea-2b2c-4680-9481-dffc87902ee3 service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Received event network-vif-unplugged-25aa8515-5f80-4dac-a843-3d38eea9ce0b {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:49:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-3811f323-bac9-4ead-967d-f6d95ebd11bf req-811623ea-2b2c-4680-9481-dffc87902ee3 service nova] Acquiring lock "486c626d-404d-463d-afa2-2310f1bb3797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:49:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-3811f323-bac9-4ead-967d-f6d95ebd11bf req-811623ea-2b2c-4680-9481-dffc87902ee3 service nova] Lock "486c626d-404d-463d-afa2-2310f1bb3797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:49:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-3811f323-bac9-4ead-967d-f6d95ebd11bf req-811623ea-2b2c-4680-9481-dffc87902ee3 service nova] Lock "486c626d-404d-463d-afa2-2310f1bb3797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:49:29 user nova-compute[72766]: DEBUG nova.compute.manager [req-3811f323-bac9-4ead-967d-f6d95ebd11bf req-811623ea-2b2c-4680-9481-dffc87902ee3 service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] No waiting events found dispatching network-vif-unplugged-25aa8515-5f80-4dac-a843-3d38eea9ce0b {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:49:29 user nova-compute[72766]: WARNING nova.compute.manager [req-3811f323-bac9-4ead-967d-f6d95ebd11bf req-811623ea-2b2c-4680-9481-dffc87902ee3 service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Received unexpected event network-vif-unplugged-25aa8515-5f80-4dac-a843-3d38eea9ce0b for instance with vm_state active and task_state rescuing.
Aug 14 23:49:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:49:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:49:29 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:49:29 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Instance destroyed successfully.
Aug 14 23:49:29 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Attempting rescue
Aug 14 23:49:29 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72766) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 23:49:29 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Instance directory exists: not creating {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 23:49:29 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Creating image(s)
Aug 14 23:49:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquiring lock "/opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:49:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "/opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:49:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "/opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:49:29 user nova-compute[72766]: DEBUG nova.objects.instance [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lazy-loading 'trusted_certs' on Instance uuid 486c626d-404d-463d-afa2-2310f1bb3797 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:49:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquiring lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:49:29 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:49:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:49:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb --force-share --output=json" returned: 0 in 0.186s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:49:29 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/disk.rescue {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:49:30 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/19fc4d0991c501e6fc30087a0d9c389d8266c5eb,backing_fmt=raw /opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/disk.rescue" returned: 0 in 0.076s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:49:30 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "19fc4d0991c501e6fc30087a0d9c389d8266c5eb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:49:30 user nova-compute[72766]: DEBUG nova.objects.instance [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lazy-loading 'migration_context' on Instance uuid 486c626d-404d-463d-afa2-2310f1bb3797 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:49:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Created local disks {{(pid=72766) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 23:49:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Start _get_guest_xml network_info=[{"id": "25aa8515-5f80-4dac-a843-3d38eea9ce0b", "address": "fa:16:3e:e0:3b:bf", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "vif_mac": "fa:16:3e:e0:3b:bf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25aa8515-5f", "ovs_interfaceid": "25aa8515-5f80-4dac-a843-3d38eea9ce0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd2900d30-2c4c-4d57-9135-d45564c0c596', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 23:49:30 user nova-compute[72766]: DEBUG nova.objects.instance [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lazy-loading 'resources' on Instance uuid 486c626d-404d-463d-afa2-2310f1bb3797 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:49:30 user nova-compute[72766]: DEBUG nova.objects.instance [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lazy-loading 'numa_topology' on Instance uuid 486c626d-404d-463d-afa2-2310f1bb3797 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:49:30 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:49:30 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:49:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 23:49:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] CPU controller missing on host. {{(pid=72766) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 23:49:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 23:49:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] CPU controller found on host. {{(pid=72766) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 23:49:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72766) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 23:49:30 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T22:51:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T22:51:38Z,direct_url=<?>,disk_format='qcow2',id=d2900d30-2c4c-4d57-9135-d45564c0c596,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='de1de6bb5c864b4182031c597206cc71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T22:51:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 23:49:30 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Flavor limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 23:49:30 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Image limits 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 23:49:30 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Flavor pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 23:49:30 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Image pref 0:0:0 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 23:49:30 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 23:49:30 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 23:49:30 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 23:49:30 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Got 1 possible topologies {{(pid=72766) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 23:49:30 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 23:49:30 user nova-compute[72766]: DEBUG nova.virt.hardware [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72766) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 23:49:30 user nova-compute[72766]: DEBUG nova.objects.instance [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lazy-loading 'vcpu_model' on Instance uuid 486c626d-404d-463d-afa2-2310f1bb3797 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:49:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:47:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-34373646',display_name='tempest-ServerRescueNegativeTestJSON-server-34373646',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-34373646',id=52,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOq8eR1EAGbJYgvw63CEOWBxTiSB3neI/CoA3G3TNCfoiBNFE3xidnhdFiVuQ5LEsbDo4ydyigXAzeB+0yT0qNLQXwNNNo6AayJCUJspvkI2X9vZT/42kRcVQ/X8ZYvv0A==',key_name='tempest-keypair-591484672',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:47:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eaadde665b704e4d882299b7f747d7a5',ramdisk_id='',reservation_id='r-rjnagpzg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1344834449',owner_user_name='tempest-ServerRescueNegativeTestJSON-1344834449-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T23:47:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a1c0e7bd2744a349ecfef160a6f54f5',uuid=486c626d-404d-463d-afa2-2310f1bb3797,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25aa8515-5f80-4dac-a843-3d38eea9ce0b", "address": "fa:16:3e:e0:3b:bf", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "vif_mac": "fa:16:3e:e0:3b:bf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25aa8515-5f", "ovs_interfaceid": "25aa8515-5f80-4dac-a843-3d38eea9ce0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72766) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 23:49:30 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Converting VIF {"id": "25aa8515-5f80-4dac-a843-3d38eea9ce0b", "address": "fa:16:3e:e0:3b:bf", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "vif_mac": "fa:16:3e:e0:3b:bf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25aa8515-5f", "ovs_interfaceid": "25aa8515-5f80-4dac-a843-3d38eea9ce0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:49:30 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:3b:bf,bridge_name='br-int',has_traffic_filtering=True,id=25aa8515-5f80-4dac-a843-3d38eea9ce0b,network=Network(71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25aa8515-5f') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:49:30 user nova-compute[72766]: DEBUG nova.objects.instance [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lazy-loading 'pci_devices' on Instance uuid 486c626d-404d-463d-afa2-2310f1bb3797 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:49:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] End _get_guest_xml xml=<domain type="kvm">
Aug 14 23:49:30 user nova-compute[72766]:   <uuid>486c626d-404d-463d-afa2-2310f1bb3797</uuid>
Aug 14 23:49:30 user nova-compute[72766]:   <name>instance-00000034</name>
Aug 14 23:49:30 user nova-compute[72766]:   <memory>524288</memory>
Aug 14 23:49:30 user nova-compute[72766]:   <vcpu>1</vcpu>
Aug 14 23:49:30 user nova-compute[72766]:   <metadata>
Aug 14 23:49:30 user nova-compute[72766]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 23:49:30 user nova-compute[72766]:       <nova:package version="0.0.0"/>
Aug 14 23:49:30 user nova-compute[72766]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-34373646</nova:name>
Aug 14 23:49:30 user nova-compute[72766]:       <nova:creationTime>2023-08-14 23:49:30</nova:creationTime>
Aug 14 23:49:30 user nova-compute[72766]:       <nova:flavor name="m1.tiny">
Aug 14 23:49:30 user nova-compute[72766]:         <nova:memory>512</nova:memory>
Aug 14 23:49:30 user nova-compute[72766]:         <nova:disk>1</nova:disk>
Aug 14 23:49:30 user nova-compute[72766]:         <nova:swap>0</nova:swap>
Aug 14 23:49:30 user nova-compute[72766]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 23:49:30 user nova-compute[72766]:         <nova:vcpus>1</nova:vcpus>
Aug 14 23:49:30 user nova-compute[72766]:       </nova:flavor>
Aug 14 23:49:30 user nova-compute[72766]:       <nova:owner>
Aug 14 23:49:30 user nova-compute[72766]:         <nova:user uuid="4a1c0e7bd2744a349ecfef160a6f54f5">tempest-ServerRescueNegativeTestJSON-1344834449-project-member</nova:user>
Aug 14 23:49:30 user nova-compute[72766]:         <nova:project uuid="eaadde665b704e4d882299b7f747d7a5">tempest-ServerRescueNegativeTestJSON-1344834449</nova:project>
Aug 14 23:49:30 user nova-compute[72766]:       </nova:owner>
Aug 14 23:49:30 user nova-compute[72766]:       <nova:root type="image" uuid="d2900d30-2c4c-4d57-9135-d45564c0c596"/>
Aug 14 23:49:30 user nova-compute[72766]:       <nova:ports>
Aug 14 23:49:30 user nova-compute[72766]:         <nova:port uuid="25aa8515-5f80-4dac-a843-3d38eea9ce0b">
Aug 14 23:49:30 user nova-compute[72766]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 23:49:30 user nova-compute[72766]:         </nova:port>
Aug 14 23:49:30 user nova-compute[72766]:       </nova:ports>
Aug 14 23:49:30 user nova-compute[72766]:     </nova:instance>
Aug 14 23:49:30 user nova-compute[72766]:   </metadata>
Aug 14 23:49:30 user nova-compute[72766]:   <sysinfo type="smbios">
Aug 14 23:49:30 user nova-compute[72766]:     <system>
Aug 14 23:49:30 user nova-compute[72766]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 23:49:30 user nova-compute[72766]:       <entry name="product">OpenStack Nova</entry>
Aug 14 23:49:30 user nova-compute[72766]:       <entry name="version">0.0.0</entry>
Aug 14 23:49:30 user nova-compute[72766]:       <entry name="serial">486c626d-404d-463d-afa2-2310f1bb3797</entry>
Aug 14 23:49:30 user nova-compute[72766]:       <entry name="uuid">486c626d-404d-463d-afa2-2310f1bb3797</entry>
Aug 14 23:49:30 user nova-compute[72766]:       <entry name="family">Virtual Machine</entry>
Aug 14 23:49:30 user nova-compute[72766]:     </system>
Aug 14 23:49:30 user nova-compute[72766]:   </sysinfo>
Aug 14 23:49:30 user nova-compute[72766]:   <os>
Aug 14 23:49:30 user nova-compute[72766]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 23:49:30 user nova-compute[72766]:     <smbios mode="sysinfo"/>
Aug 14 23:49:30 user nova-compute[72766]:   </os>
Aug 14 23:49:30 user nova-compute[72766]:   <features>
Aug 14 23:49:30 user nova-compute[72766]:     <acpi/>
Aug 14 23:49:30 user nova-compute[72766]:     <apic/>
Aug 14 23:49:30 user nova-compute[72766]:     <vmcoreinfo/>
Aug 14 23:49:30 user nova-compute[72766]:   </features>
Aug 14 23:49:30 user nova-compute[72766]:   <clock offset="utc">
Aug 14 23:49:30 user nova-compute[72766]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 23:49:30 user nova-compute[72766]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 23:49:30 user nova-compute[72766]:     <timer name="hpet" present="no"/>
Aug 14 23:49:30 user nova-compute[72766]:   </clock>
Aug 14 23:49:30 user nova-compute[72766]:   <cpu mode="custom" match="exact">
Aug 14 23:49:30 user nova-compute[72766]:     <model>Nehalem</model>
Aug 14 23:49:30 user nova-compute[72766]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 23:49:30 user nova-compute[72766]:   </cpu>
Aug 14 23:49:30 user nova-compute[72766]:   <devices>
Aug 14 23:49:30 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 23:49:30 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 23:49:30 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/disk.rescue"/>
Aug 14 23:49:30 user nova-compute[72766]:       <target dev="vda" bus="virtio"/>
Aug 14 23:49:30 user nova-compute[72766]:     </disk>
Aug 14 23:49:30 user nova-compute[72766]:     <disk type="file" device="disk">
Aug 14 23:49:30 user nova-compute[72766]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 23:49:30 user nova-compute[72766]:       <source file="/opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/disk"/>
Aug 14 23:49:30 user nova-compute[72766]:       <target dev="vdb" bus="virtio"/>
Aug 14 23:49:30 user nova-compute[72766]:     </disk>
Aug 14 23:49:30 user nova-compute[72766]:     <interface type="ethernet">
Aug 14 23:49:30 user nova-compute[72766]:       <mac address="fa:16:3e:e0:3b:bf"/>
Aug 14 23:49:30 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:49:30 user nova-compute[72766]:       <mtu size="1442"/>
Aug 14 23:49:30 user nova-compute[72766]:       <target dev="tap25aa8515-5f"/>
Aug 14 23:49:30 user nova-compute[72766]:     </interface>
Aug 14 23:49:30 user nova-compute[72766]:     <serial type="pty">
Aug 14 23:49:30 user nova-compute[72766]:       <log file="/opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/console.log" append="off"/>
Aug 14 23:49:30 user nova-compute[72766]:     </serial>
Aug 14 23:49:30 user nova-compute[72766]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 23:49:30 user nova-compute[72766]:     <video>
Aug 14 23:49:30 user nova-compute[72766]:       <model type="virtio"/>
Aug 14 23:49:30 user nova-compute[72766]:     </video>
Aug 14 23:49:30 user nova-compute[72766]:     <rng model="virtio">
Aug 14 23:49:30 user nova-compute[72766]:       <backend model="random">/dev/urandom</backend>
Aug 14 23:49:30 user nova-compute[72766]:     </rng>
Aug 14 23:49:30 user nova-compute[72766]:     <controller type="usb" index="0" model="none"/>
Aug 14 23:49:30 user nova-compute[72766]:     <memballoon model="virtio">
Aug 14 23:49:30 user nova-compute[72766]:       <stats period="10"/>
Aug 14 23:49:30 user nova-compute[72766]:     </memballoon>
Aug 14 23:49:30 user nova-compute[72766]:   </devices>
Aug 14 23:49:30 user nova-compute[72766]: </domain>
Aug 14 23:49:30 user nova-compute[72766]:  {{(pid=72766) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 23:49:30 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Instance destroyed successfully.
Aug 14 23:49:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] No BDM found with device name vda, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:49:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72766) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 23:49:30 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] No VIF found with MAC fa:16:3e:e0:3b:bf, not building metadata {{(pid=72766) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 23:49:31 user nova-compute[72766]: DEBUG nova.compute.manager [req-06447992-8ee5-4457-9edb-5d7fb2668ae6 req-13968618-6f48-4815-a8e2-e85fbecfe33e service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Received event network-vif-plugged-25aa8515-5f80-4dac-a843-3d38eea9ce0b {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:49:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-06447992-8ee5-4457-9edb-5d7fb2668ae6 req-13968618-6f48-4815-a8e2-e85fbecfe33e service nova] Acquiring lock "486c626d-404d-463d-afa2-2310f1bb3797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:49:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-06447992-8ee5-4457-9edb-5d7fb2668ae6 req-13968618-6f48-4815-a8e2-e85fbecfe33e service nova] Lock "486c626d-404d-463d-afa2-2310f1bb3797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:49:31 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-06447992-8ee5-4457-9edb-5d7fb2668ae6 req-13968618-6f48-4815-a8e2-e85fbecfe33e service nova] Lock "486c626d-404d-463d-afa2-2310f1bb3797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:49:31 user nova-compute[72766]: DEBUG nova.compute.manager [req-06447992-8ee5-4457-9edb-5d7fb2668ae6 req-13968618-6f48-4815-a8e2-e85fbecfe33e service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] No waiting events found dispatching network-vif-plugged-25aa8515-5f80-4dac-a843-3d38eea9ce0b {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:49:31 user nova-compute[72766]: WARNING nova.compute.manager [req-06447992-8ee5-4457-9edb-5d7fb2668ae6 req-13968618-6f48-4815-a8e2-e85fbecfe33e service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Received unexpected event network-vif-plugged-25aa8515-5f80-4dac-a843-3d38eea9ce0b for instance with vm_state active and task_state rescuing.
Aug 14 23:49:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:49:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:49:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:49:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:49:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:49:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-06b3c772-48ef-492c-93d6-c6e915a09fac req-f80f3371-ba1e-410b-8aba-bd122dbd9247 service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Received event network-vif-plugged-25aa8515-5f80-4dac-a843-3d38eea9ce0b {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:49:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-06b3c772-48ef-492c-93d6-c6e915a09fac req-f80f3371-ba1e-410b-8aba-bd122dbd9247 service nova] Acquiring lock "486c626d-404d-463d-afa2-2310f1bb3797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:49:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-06b3c772-48ef-492c-93d6-c6e915a09fac req-f80f3371-ba1e-410b-8aba-bd122dbd9247 service nova] Lock "486c626d-404d-463d-afa2-2310f1bb3797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:49:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-06b3c772-48ef-492c-93d6-c6e915a09fac req-f80f3371-ba1e-410b-8aba-bd122dbd9247 service nova] Lock "486c626d-404d-463d-afa2-2310f1bb3797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:49:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-06b3c772-48ef-492c-93d6-c6e915a09fac req-f80f3371-ba1e-410b-8aba-bd122dbd9247 service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] No waiting events found dispatching network-vif-plugged-25aa8515-5f80-4dac-a843-3d38eea9ce0b {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:49:33 user nova-compute[72766]: WARNING nova.compute.manager [req-06b3c772-48ef-492c-93d6-c6e915a09fac req-f80f3371-ba1e-410b-8aba-bd122dbd9247 service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Received unexpected event network-vif-plugged-25aa8515-5f80-4dac-a843-3d38eea9ce0b for instance with vm_state active and task_state rescuing.
Aug 14 23:49:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-06b3c772-48ef-492c-93d6-c6e915a09fac req-f80f3371-ba1e-410b-8aba-bd122dbd9247 service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Received event network-vif-plugged-25aa8515-5f80-4dac-a843-3d38eea9ce0b {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:49:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-06b3c772-48ef-492c-93d6-c6e915a09fac req-f80f3371-ba1e-410b-8aba-bd122dbd9247 service nova] Acquiring lock "486c626d-404d-463d-afa2-2310f1bb3797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:49:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-06b3c772-48ef-492c-93d6-c6e915a09fac req-f80f3371-ba1e-410b-8aba-bd122dbd9247 service nova] Lock "486c626d-404d-463d-afa2-2310f1bb3797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:49:33 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-06b3c772-48ef-492c-93d6-c6e915a09fac req-f80f3371-ba1e-410b-8aba-bd122dbd9247 service nova] Lock "486c626d-404d-463d-afa2-2310f1bb3797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:49:33 user nova-compute[72766]: DEBUG nova.compute.manager [req-06b3c772-48ef-492c-93d6-c6e915a09fac req-f80f3371-ba1e-410b-8aba-bd122dbd9247 service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] No waiting events found dispatching network-vif-plugged-25aa8515-5f80-4dac-a843-3d38eea9ce0b {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:49:33 user nova-compute[72766]: WARNING nova.compute.manager [req-06b3c772-48ef-492c-93d6-c6e915a09fac req-f80f3371-ba1e-410b-8aba-bd122dbd9247 service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Received unexpected event network-vif-plugged-25aa8515-5f80-4dac-a843-3d38eea9ce0b for instance with vm_state active and task_state rescuing.
Aug 14 23:49:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:49:33 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Removed pending event for 486c626d-404d-463d-afa2-2310f1bb3797 due to event {{(pid=72766) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 23:49:33 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692056973.8008666, 486c626d-404d-463d-afa2-2310f1bb3797 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:49:33 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] VM Resumed (Lifecycle Event)
Aug 14 23:49:33 user nova-compute[72766]: DEBUG nova.compute.manager [None req-b319afb4-5f53-4b40-a4b5-46cbd40bb48b tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:49:33 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:49:33 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:49:33 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 23:49:33 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692056973.8020554, 486c626d-404d-463d-afa2-2310f1bb3797 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:49:33 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] VM Started (Lifecycle Event)
Aug 14 23:49:33 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:49:33 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:49:34 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:49:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:49:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:49:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:49:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:49:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:49:54 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:49:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:49:59 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:49:59 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:50:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:50:03 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:50:03 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:50:03 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:50:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-b9ede44b-eef5-473f-a279-8166a442a45d" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:50:03 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-b9ede44b-eef5-473f-a279-8166a442a45d" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:50:03 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:50:04 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Updating instance_info_cache with network_info: [{"id": "02fed6c3-ea8a-4fd6-a404-29ea7c038c6a", "address": "fa:16:3e:52:c1:fe", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02fed6c3-ea", "ovs_interfaceid": "02fed6c3-ea8a-4fd6-a404-29ea7c038c6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:50:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-b9ede44b-eef5-473f-a279-8166a442a45d" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:50:04 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:50:04 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:50:04 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:50:04 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:50:05 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:50:06 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:50:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:50:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:50:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:50:06 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:50:06 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:50:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:50:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:50:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:50:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:50:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:50:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:50:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:50:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:50:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:50:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:50:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:50:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:50:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:50:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:50:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:50:08 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/disk (vdb) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:50:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:50:08 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:50:08 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:50:08 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=8578MB free_disk=25.192020416259766GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:50:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:50:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:50:08 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 2262995c-232a-4bfd-b8f4-c83b24c12f62 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:50:08 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance b9ede44b-eef5-473f-a279-8166a442a45d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:50:08 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 486c626d-404d-463d-afa2-2310f1bb3797 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:50:08 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:50:08 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:50:09 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:50:09 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:50:09 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:50:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.384s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:50:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:50:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:50:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:50:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:50:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:50:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:50:14 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:50:14 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:50:14 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:50:14 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:50:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:50:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:50:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:50:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:50:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:50:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:50:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:50:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:50:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:50:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:50:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:50:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:50:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:50:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:50:59 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:51:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:51:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:51:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:51:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:51:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:51:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:51:04 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:51:04 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:51:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-486c626d-404d-463d-afa2-2310f1bb3797" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:51:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-486c626d-404d-463d-afa2-2310f1bb3797" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:51:04 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:51:05 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Updating instance_info_cache with network_info: [{"id": "25aa8515-5f80-4dac-a843-3d38eea9ce0b", "address": "fa:16:3e:e0:3b:bf", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25aa8515-5f", "ovs_interfaceid": "25aa8515-5f80-4dac-a843-3d38eea9ce0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:51:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-486c626d-404d-463d-afa2-2310f1bb3797" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:51:05 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:51:05 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:51:05 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:51:07 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:51:07 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:51:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:51:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:51:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:51:07 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:51:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:51:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:51:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:51:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:51:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:51:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:51:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:51:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:51:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:51:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:51:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:51:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:51:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:51:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:51:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:51:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:51:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:51:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/disk (vdb) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:51:09 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:51:09 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:51:09 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=8647MB free_disk=25.19143295288086GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:51:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:51:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:51:09 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 2262995c-232a-4bfd-b8f4-c83b24c12f62 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:51:09 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance b9ede44b-eef5-473f-a279-8166a442a45d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:51:09 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 486c626d-404d-463d-afa2-2310f1bb3797 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:51:09 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:51:09 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:51:10 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:51:10 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:51:10 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:51:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.261s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:51:12 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:51:13 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:51:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:51:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:51:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:51:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:51:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:51:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:51:14 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:51:14 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:51:14 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:51:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:51:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:51:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:51:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:51:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:51:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:51:19 user nova-compute[72766]: INFO nova.compute.manager [None req-8018f914-2211-417b-bcb0-ee9874f8157f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Unrescuing
Aug 14 23:51:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-8018f914-2211-417b-bcb0-ee9874f8157f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquiring lock "refresh_cache-486c626d-404d-463d-afa2-2310f1bb3797" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:51:19 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-8018f914-2211-417b-bcb0-ee9874f8157f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquired lock "refresh_cache-486c626d-404d-463d-afa2-2310f1bb3797" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:51:19 user nova-compute[72766]: DEBUG nova.network.neutron [None req-8018f914-2211-417b-bcb0-ee9874f8157f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Building network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 23:51:20 user nova-compute[72766]: DEBUG nova.network.neutron [None req-8018f914-2211-417b-bcb0-ee9874f8157f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Updating instance_info_cache with network_info: [{"id": "25aa8515-5f80-4dac-a843-3d38eea9ce0b", "address": "fa:16:3e:e0:3b:bf", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25aa8515-5f", "ovs_interfaceid": "25aa8515-5f80-4dac-a843-3d38eea9ce0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:51:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-8018f914-2211-417b-bcb0-ee9874f8157f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Releasing lock "refresh_cache-486c626d-404d-463d-afa2-2310f1bb3797" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:51:20 user nova-compute[72766]: DEBUG nova.objects.instance [None req-8018f914-2211-417b-bcb0-ee9874f8157f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lazy-loading 'flavor' on Instance uuid 486c626d-404d-463d-afa2-2310f1bb3797 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:51:20 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:51:20 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:51:20 user nova-compute[72766]: DEBUG nova.compute.manager [req-4ef01226-6f8c-440e-b3a0-237889f138bc req-82d9d59a-6f10-43cc-aeea-1a7bbe89c2ee service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Received event network-vif-unplugged-25aa8515-5f80-4dac-a843-3d38eea9ce0b {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:51:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-4ef01226-6f8c-440e-b3a0-237889f138bc req-82d9d59a-6f10-43cc-aeea-1a7bbe89c2ee service nova] Acquiring lock "486c626d-404d-463d-afa2-2310f1bb3797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:51:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-4ef01226-6f8c-440e-b3a0-237889f138bc req-82d9d59a-6f10-43cc-aeea-1a7bbe89c2ee service nova] Lock "486c626d-404d-463d-afa2-2310f1bb3797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:51:20 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-4ef01226-6f8c-440e-b3a0-237889f138bc req-82d9d59a-6f10-43cc-aeea-1a7bbe89c2ee service nova] Lock "486c626d-404d-463d-afa2-2310f1bb3797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:51:20 user nova-compute[72766]: DEBUG nova.compute.manager [req-4ef01226-6f8c-440e-b3a0-237889f138bc req-82d9d59a-6f10-43cc-aeea-1a7bbe89c2ee service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] No waiting events found dispatching network-vif-unplugged-25aa8515-5f80-4dac-a843-3d38eea9ce0b {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:51:20 user nova-compute[72766]: WARNING nova.compute.manager [req-4ef01226-6f8c-440e-b3a0-237889f138bc req-82d9d59a-6f10-43cc-aeea-1a7bbe89c2ee service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Received unexpected event network-vif-unplugged-25aa8515-5f80-4dac-a843-3d38eea9ce0b for instance with vm_state rescued and task_state unrescuing.
Aug 14 23:51:20 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:51:20 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:51:20 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:51:20 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Instance destroyed successfully.
Aug 14 23:51:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:51:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:51:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:51:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:51:22 user nova-compute[72766]: DEBUG nova.compute.manager [req-3539ba7d-de81-4148-977c-f6c4f1953e11 req-a34943a3-97ce-4123-a957-a325b59a71fc service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Received event network-vif-plugged-25aa8515-5f80-4dac-a843-3d38eea9ce0b {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:51:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-3539ba7d-de81-4148-977c-f6c4f1953e11 req-a34943a3-97ce-4123-a957-a325b59a71fc service nova] Acquiring lock "486c626d-404d-463d-afa2-2310f1bb3797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:51:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-3539ba7d-de81-4148-977c-f6c4f1953e11 req-a34943a3-97ce-4123-a957-a325b59a71fc service nova] Lock "486c626d-404d-463d-afa2-2310f1bb3797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:51:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-3539ba7d-de81-4148-977c-f6c4f1953e11 req-a34943a3-97ce-4123-a957-a325b59a71fc service nova] Lock "486c626d-404d-463d-afa2-2310f1bb3797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:51:22 user nova-compute[72766]: DEBUG nova.compute.manager [req-3539ba7d-de81-4148-977c-f6c4f1953e11 req-a34943a3-97ce-4123-a957-a325b59a71fc service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] No waiting events found dispatching network-vif-plugged-25aa8515-5f80-4dac-a843-3d38eea9ce0b {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:51:22 user nova-compute[72766]: WARNING nova.compute.manager [req-3539ba7d-de81-4148-977c-f6c4f1953e11 req-a34943a3-97ce-4123-a957-a325b59a71fc service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Received unexpected event network-vif-plugged-25aa8515-5f80-4dac-a843-3d38eea9ce0b for instance with vm_state rescued and task_state unrescuing.
Aug 14 23:51:22 user nova-compute[72766]: DEBUG nova.compute.manager [req-3539ba7d-de81-4148-977c-f6c4f1953e11 req-a34943a3-97ce-4123-a957-a325b59a71fc service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Received event network-vif-plugged-25aa8515-5f80-4dac-a843-3d38eea9ce0b {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:51:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-3539ba7d-de81-4148-977c-f6c4f1953e11 req-a34943a3-97ce-4123-a957-a325b59a71fc service nova] Acquiring lock "486c626d-404d-463d-afa2-2310f1bb3797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:51:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-3539ba7d-de81-4148-977c-f6c4f1953e11 req-a34943a3-97ce-4123-a957-a325b59a71fc service nova] Lock "486c626d-404d-463d-afa2-2310f1bb3797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:51:22 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-3539ba7d-de81-4148-977c-f6c4f1953e11 req-a34943a3-97ce-4123-a957-a325b59a71fc service nova] Lock "486c626d-404d-463d-afa2-2310f1bb3797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:51:22 user nova-compute[72766]: DEBUG nova.compute.manager [req-3539ba7d-de81-4148-977c-f6c4f1953e11 req-a34943a3-97ce-4123-a957-a325b59a71fc service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] No waiting events found dispatching network-vif-plugged-25aa8515-5f80-4dac-a843-3d38eea9ce0b {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:51:22 user nova-compute[72766]: WARNING nova.compute.manager [req-3539ba7d-de81-4148-977c-f6c4f1953e11 req-a34943a3-97ce-4123-a957-a325b59a71fc service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Received unexpected event network-vif-plugged-25aa8515-5f80-4dac-a843-3d38eea9ce0b for instance with vm_state rescued and task_state unrescuing.
Aug 14 23:51:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:51:24 user nova-compute[72766]: DEBUG nova.compute.manager [None req-8018f914-2211-417b-bcb0-ee9874f8157f tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:51:24 user nova-compute[72766]: DEBUG nova.virt.libvirt.host [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Removed pending event for 486c626d-404d-463d-afa2-2310f1bb3797 due to event {{(pid=72766) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 23:51:24 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692057084.3431313, 486c626d-404d-463d-afa2-2310f1bb3797 => Resumed> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:51:24 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] VM Resumed (Lifecycle Event)
Aug 14 23:51:24 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:51:24 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:51:24 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 14 23:51:24 user nova-compute[72766]: DEBUG nova.virt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Emitting event <LifecycleEvent: 1692057084.3436534, 486c626d-404d-463d-afa2-2310f1bb3797 => Started> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:51:24 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] VM Started (Lifecycle Event)
Aug 14 23:51:24 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:51:24 user nova-compute[72766]: DEBUG nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72766) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 23:51:24 user nova-compute[72766]: INFO nova.compute.manager [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 14 23:51:24 user nova-compute[72766]: DEBUG nova.compute.manager [req-534f4342-1f9c-49e7-9a74-49dffca56352 req-19278bd6-42f4-4588-8d2f-c931afd8d451 service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Received event network-vif-plugged-25aa8515-5f80-4dac-a843-3d38eea9ce0b {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:51:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-534f4342-1f9c-49e7-9a74-49dffca56352 req-19278bd6-42f4-4588-8d2f-c931afd8d451 service nova] Acquiring lock "486c626d-404d-463d-afa2-2310f1bb3797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:51:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-534f4342-1f9c-49e7-9a74-49dffca56352 req-19278bd6-42f4-4588-8d2f-c931afd8d451 service nova] Lock "486c626d-404d-463d-afa2-2310f1bb3797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:51:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-534f4342-1f9c-49e7-9a74-49dffca56352 req-19278bd6-42f4-4588-8d2f-c931afd8d451 service nova] Lock "486c626d-404d-463d-afa2-2310f1bb3797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:51:24 user nova-compute[72766]: DEBUG nova.compute.manager [req-534f4342-1f9c-49e7-9a74-49dffca56352 req-19278bd6-42f4-4588-8d2f-c931afd8d451 service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] No waiting events found dispatching network-vif-plugged-25aa8515-5f80-4dac-a843-3d38eea9ce0b {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:51:24 user nova-compute[72766]: WARNING nova.compute.manager [req-534f4342-1f9c-49e7-9a74-49dffca56352 req-19278bd6-42f4-4588-8d2f-c931afd8d451 service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Received unexpected event network-vif-plugged-25aa8515-5f80-4dac-a843-3d38eea9ce0b for instance with vm_state active and task_state None.
Aug 14 23:51:24 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:51:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:51:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:51:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:51:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:51:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:51:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:51:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:51:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:51:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:51:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:51:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:51:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:51:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:51:40 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:51:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:51:45 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:51:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:51:50 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:51:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:51:55 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:51:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:51:59 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:52:02 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:52:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:52:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:52:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:52:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:52:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:52:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:52:05 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:52:05 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:52:05 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Rebuilding the list of instances to heal {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 23:52:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-2262995c-232a-4bfd-b8f4-c83b24c12f62" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:52:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-2262995c-232a-4bfd-b8f4-c83b24c12f62" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:52:05 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:52:05 user nova-compute[72766]: DEBUG nova.objects.instance [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lazy-loading 'info_cache' on Instance uuid 2262995c-232a-4bfd-b8f4-c83b24c12f62 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:52:06 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Updating instance_info_cache with network_info: [{"id": "69550d14-e1fb-4c2e-9526-19cae208fd08", "address": "fa:16:3e:bd:82:2f", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69550d14-e1", "ovs_interfaceid": "69550d14-e1fb-4c2e-9526-19cae208fd08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:52:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-2262995c-232a-4bfd-b8f4-c83b24c12f62" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:52:06 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:52:06 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:52:07 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:52:07 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:52:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:52:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:52:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:52:07 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:52:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:52:07 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:52:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:52:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:52:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:52:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:52:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:52:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:52:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:52:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:52:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:52:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:52:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:52:08 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:52:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:52:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:52:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:52:09 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:52:09 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:52:09 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:52:09 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=8585MB free_disk=25.190231323242188GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:52:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:52:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:52:09 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 2262995c-232a-4bfd-b8f4-c83b24c12f62 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:52:09 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance b9ede44b-eef5-473f-a279-8166a442a45d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:52:09 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 486c626d-404d-463d-afa2-2310f1bb3797 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:52:09 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:52:09 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:52:09 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Refreshing inventories for resource provider 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 23:52:09 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Updating ProviderTree inventory for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 23:52:09 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Updating inventory in ProviderTree for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 23:52:09 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Refreshing aggregate associations for resource provider 45c8ff08-bf31-4ab6-8452-2e293102f899, aggregates: None {{(pid=72766) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 23:52:09 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Refreshing trait associations for resource provider 45c8ff08-bf31-4ab6-8452-2e293102f899, traits: COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=72766) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 23:52:10 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:52:10 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:52:10 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:52:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.361s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:52:11 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:52:11 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:52:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:52:14 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:52:15 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:52:16 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:52:16 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:52:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:52:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:52:24 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:52:24 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Triggering sync for uuid 2262995c-232a-4bfd-b8f4-c83b24c12f62 {{(pid=72766) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 23:52:24 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Triggering sync for uuid b9ede44b-eef5-473f-a279-8166a442a45d {{(pid=72766) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 23:52:24 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Triggering sync for uuid 486c626d-404d-463d-afa2-2310f1bb3797 {{(pid=72766) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 23:52:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "2262995c-232a-4bfd-b8f4-c83b24c12f62" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:52:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:52:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "b9ede44b-eef5-473f-a279-8166a442a45d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:52:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "b9ede44b-eef5-473f-a279-8166a442a45d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:52:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "486c626d-404d-463d-afa2-2310f1bb3797" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:52:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "486c626d-404d-463d-afa2-2310f1bb3797" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:52:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:52:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "b9ede44b-eef5-473f-a279-8166a442a45d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:52:24 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "486c626d-404d-463d-afa2-2310f1bb3797" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:52:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:52:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:52:36 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:52:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:52:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:52:46 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:52:46 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Cleaning up deleted instances {{(pid=72766) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 23:52:46 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] There are 0 instances to clean {{(pid=72766) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 23:52:46 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:52:46 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72766) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 23:52:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:52:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:52:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:53:01 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:53:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:53:06 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:53:06 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:53:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-b9ede44b-eef5-473f-a279-8166a442a45d" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:53:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-b9ede44b-eef5-473f-a279-8166a442a45d" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:53:06 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:53:07 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Updating instance_info_cache with network_info: [{"id": "02fed6c3-ea8a-4fd6-a404-29ea7c038c6a", "address": "fa:16:3e:52:c1:fe", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02fed6c3-ea", "ovs_interfaceid": "02fed6c3-ea8a-4fd6-a404-29ea7c038c6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:53:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-b9ede44b-eef5-473f-a279-8166a442a45d" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:53:07 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:53:08 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:53:08 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:53:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:53:09 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:53:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:53:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:53:09 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:53:09 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:53:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:53:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:53:09 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:53:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:53:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:53:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:53:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:53:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:53:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:53:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:53:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:53:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:53:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:53:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:53:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:53:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:53:11 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72766) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 23:53:11 user nova-compute[72766]: DEBUG nova.compute.manager [req-ddba483e-13c8-4be8-8d86-8bd5838a83c3 req-1dac86f6-b1be-4ff4-abca-de620bda2133 service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Received event network-changed-25aa8515-5f80-4dac-a843-3d38eea9ce0b {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:53:11 user nova-compute[72766]: DEBUG nova.compute.manager [req-ddba483e-13c8-4be8-8d86-8bd5838a83c3 req-1dac86f6-b1be-4ff4-abca-de620bda2133 service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Refreshing instance network info cache due to event network-changed-25aa8515-5f80-4dac-a843-3d38eea9ce0b. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:53:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ddba483e-13c8-4be8-8d86-8bd5838a83c3 req-1dac86f6-b1be-4ff4-abca-de620bda2133 service nova] Acquiring lock "refresh_cache-486c626d-404d-463d-afa2-2310f1bb3797" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:53:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ddba483e-13c8-4be8-8d86-8bd5838a83c3 req-1dac86f6-b1be-4ff4-abca-de620bda2133 service nova] Acquired lock "refresh_cache-486c626d-404d-463d-afa2-2310f1bb3797" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:53:11 user nova-compute[72766]: DEBUG nova.network.neutron [req-ddba483e-13c8-4be8-8d86-8bd5838a83c3 req-1dac86f6-b1be-4ff4-abca-de620bda2133 service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Refreshing network info cache for port 25aa8515-5f80-4dac-a843-3d38eea9ce0b {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:53:11 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:53:11 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:53:11 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=8643MB free_disk=25.18966293334961GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:53:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:53:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:53:11 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 2262995c-232a-4bfd-b8f4-c83b24c12f62 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:53:11 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance b9ede44b-eef5-473f-a279-8166a442a45d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:53:11 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 486c626d-404d-463d-afa2-2310f1bb3797 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:53:11 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:53:11 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:53:11 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:53:11 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:53:11 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:53:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.221s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b224f4e2-97c6-420a-8636-06ced33536f4 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquiring lock "486c626d-404d-463d-afa2-2310f1bb3797" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b224f4e2-97c6-420a-8636-06ced33536f4 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "486c626d-404d-463d-afa2-2310f1bb3797" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:53:12 user nova-compute[72766]: INFO nova.compute.manager [None req-b224f4e2-97c6-420a-8636-06ced33536f4 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Detaching volume 61edf1a3-86eb-4d20-8ac3-6e09e17df403
Aug 14 23:53:12 user nova-compute[72766]: INFO nova.virt.block_device [None req-b224f4e2-97c6-420a-8636-06ced33536f4 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Attempting to driver detach volume 61edf1a3-86eb-4d20-8ac3-6e09e17df403 from mountpoint /dev/vdb
Aug 14 23:53:12 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-b224f4e2-97c6-420a-8636-06ced33536f4 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Attempting to detach device vdb from instance 486c626d-404d-463d-afa2-2310f1bb3797 from the persistent domain config. {{(pid=72766) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-b224f4e2-97c6-420a-8636-06ced33536f4 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 23:53:12 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:53:12 user nova-compute[72766]:   <source dev="/dev/sdb"/>
Aug 14 23:53:12 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:53:12 user nova-compute[72766]:   <serial>61edf1a3-86eb-4d20-8ac3-6e09e17df403</serial>
Aug 14 23:53:12 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 23:53:12 user nova-compute[72766]: </disk>
Aug 14 23:53:12 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 23:53:12 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-b224f4e2-97c6-420a-8636-06ced33536f4 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Successfully detached device vdb from instance 486c626d-404d-463d-afa2-2310f1bb3797 from the persistent domain config.
Aug 14 23:53:12 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-b224f4e2-97c6-420a-8636-06ced33536f4 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 486c626d-404d-463d-afa2-2310f1bb3797 from the live domain config. {{(pid=72766) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG nova.virt.libvirt.guest [None req-b224f4e2-97c6-420a-8636-06ced33536f4 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 23:53:12 user nova-compute[72766]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 23:53:12 user nova-compute[72766]:   <source dev="/dev/sdb"/>
Aug 14 23:53:12 user nova-compute[72766]:   <target dev="vdb" bus="virtio"/>
Aug 14 23:53:12 user nova-compute[72766]:   <serial>61edf1a3-86eb-4d20-8ac3-6e09e17df403</serial>
Aug 14 23:53:12 user nova-compute[72766]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 23:53:12 user nova-compute[72766]: </disk>
Aug 14 23:53:12 user nova-compute[72766]:  {{(pid=72766) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG nova.network.neutron [req-ddba483e-13c8-4be8-8d86-8bd5838a83c3 req-1dac86f6-b1be-4ff4-abca-de620bda2133 service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Updated VIF entry in instance network info cache for port 25aa8515-5f80-4dac-a843-3d38eea9ce0b. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG nova.network.neutron [req-ddba483e-13c8-4be8-8d86-8bd5838a83c3 req-1dac86f6-b1be-4ff4-abca-de620bda2133 service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Updating instance_info_cache with network_info: [{"id": "25aa8515-5f80-4dac-a843-3d38eea9ce0b", "address": "fa:16:3e:e0:3b:bf", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25aa8515-5f", "ovs_interfaceid": "25aa8515-5f80-4dac-a843-3d38eea9ce0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-ddba483e-13c8-4be8-8d86-8bd5838a83c3 req-1dac86f6-b1be-4ff4-abca-de620bda2133 service nova] Releasing lock "refresh_cache-486c626d-404d-463d-afa2-2310f1bb3797" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-f9355153-5eb6-4633-bd50-292cfb3e3291 None None] Received event <DeviceRemovedEvent: 1692057192.6096742, 486c626d-404d-463d-afa2-2310f1bb3797 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72766) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG nova.virt.libvirt.driver [None req-b224f4e2-97c6-420a-8636-06ced33536f4 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 486c626d-404d-463d-afa2-2310f1bb3797 {{(pid=72766) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 23:53:12 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-b224f4e2-97c6-420a-8636-06ced33536f4 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Successfully detached device vdb from instance 486c626d-404d-463d-afa2-2310f1bb3797 from the live domain config.
Aug 14 23:53:12 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b224f4e2-97c6-420a-8636-06ced33536f4 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] calling os-brick to detach iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b224f4e2-97c6-420a-8636-06ced33536f4 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff16c2ee6e0>, {'target_iqns': ['iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dGjOTruk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 23:53:12 user nova-compute[72766]: WARNING os_brick.initiator.connectors.base [None req-b224f4e2-97c6-420a-8636-06ced33536f4 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 23:53:12 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-b224f4e2-97c6-420a-8636-06ced33536f4 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-b224f4e2-97c6-420a-8636-06ced33536f4 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b224f4e2-97c6-420a-8636-06ced33536f4 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403', 0)] {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[074a34b4-72bb-45d9-bb5f-cf1f169317e9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e57a529-5e68-42e9-b38e-f382ad7d038a]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403 (non-flash)\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b224f4e2-97c6-420a-8636-06ced33536f4 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403 (non-flash)
Aug 14 23:53:12 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b224f4e2-97c6-420a-8636-06ced33536f4 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403 (non-flash)
Aug 14 23:53:12 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b224f4e2-97c6-420a-8636-06ced33536f4 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff1544c45e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403'): ({'sdb'}, set())}) {{(pid=72766) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b224f4e2-97c6-420a-8636-06ced33536f4 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Removing single pathed devices sdb {{(pid=72766) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[9deb9b34-cbcb-4ed2-9028-a6a860be38b8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ffcf57-154b-4ace-9a83-6e79788fab9d]: (4, ('ok\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b224f4e2-97c6-420a-8636-06ced33536f4 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Flushing IO for device /dev/sdb {{(pid=72766) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cb5913-571e-47ad-ba49-b172c42c2ed8]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b224f4e2-97c6-420a-8636-06ced33536f4 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72766) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[582192d4-e66d-40ec-b692-8991eebc5963]: (4, ('1', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b224f4e2-97c6-420a-8636-06ced33536f4 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG os_brick.initiator.linuxscsi [None req-b224f4e2-97c6-420a-8636-06ced33536f4 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] SCSI volumes sdb have been removed. {{(pid=72766) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b224f4e2-97c6-420a-8636-06ced33536f4 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403')] {{(pid=72766) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[32697332-9c23-4e25-b4e7-7ecfdabc330c]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b224f4e2-97c6-420a-8636-06ced33536f4 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403 -p 172.16.0.220:3260 --logout {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c393844-e4f3-4ff3-99aa-40c25e3256cf]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b224f4e2-97c6-420a-8636-06ced33536f4 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403, portal: 172.16.0.220,3260]
Aug 14 23:53:12 user nova-compute[72766]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403, portal: 172.16.0.220,3260] successful.
Aug 14 23:53:12 user nova-compute[72766]:  stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403 -p 172.16.0.220:3260 --op delete {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61edf1a3-86eb-4d20-8ac3-6e09e17df403 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83651) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ba6093-eab3-4ced-b404-15eb19512390]: (4, ('', '')) {{(pid=83651) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b224f4e2-97c6-420a-8636-06ced33536f4 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72766) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.base [None req-b224f4e2-97c6-420a-8636-06ced33536f4 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG os_brick.initiator.connectors.iscsi [None req-b224f4e2-97c6-420a-8636-06ced33536f4 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] <== disconnect_volume: return (282ms) None {{(pid=72766) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b224f4e2-97c6-420a-8636-06ced33536f4 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Disconnected iSCSI Volume {{(pid=72766) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 23:53:12 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:53:13 user nova-compute[72766]: DEBUG nova.compute.manager [req-fdd60132-970b-4d5b-a117-f824f97053a4 req-210b0a04-56ff-4e8f-a070-94eb5b4cb4ae service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Received event network-changed-25aa8515-5f80-4dac-a843-3d38eea9ce0b {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:53:13 user nova-compute[72766]: DEBUG nova.compute.manager [req-fdd60132-970b-4d5b-a117-f824f97053a4 req-210b0a04-56ff-4e8f-a070-94eb5b4cb4ae service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Refreshing instance network info cache due to event network-changed-25aa8515-5f80-4dac-a843-3d38eea9ce0b. {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 23:53:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-fdd60132-970b-4d5b-a117-f824f97053a4 req-210b0a04-56ff-4e8f-a070-94eb5b4cb4ae service nova] Acquiring lock "refresh_cache-486c626d-404d-463d-afa2-2310f1bb3797" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:53:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-fdd60132-970b-4d5b-a117-f824f97053a4 req-210b0a04-56ff-4e8f-a070-94eb5b4cb4ae service nova] Acquired lock "refresh_cache-486c626d-404d-463d-afa2-2310f1bb3797" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:53:13 user nova-compute[72766]: DEBUG nova.network.neutron [req-fdd60132-970b-4d5b-a117-f824f97053a4 req-210b0a04-56ff-4e8f-a070-94eb5b4cb4ae service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Refreshing network info cache for port 25aa8515-5f80-4dac-a843-3d38eea9ce0b {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 23:53:13 user nova-compute[72766]: DEBUG nova.objects.instance [None req-b224f4e2-97c6-420a-8636-06ced33536f4 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lazy-loading 'flavor' on Instance uuid 486c626d-404d-463d-afa2-2310f1bb3797 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:53:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b224f4e2-97c6-420a-8636-06ced33536f4 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "486c626d-404d-463d-afa2-2310f1bb3797" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.650s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:53:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:53:14 user nova-compute[72766]: DEBUG nova.network.neutron [req-fdd60132-970b-4d5b-a117-f824f97053a4 req-210b0a04-56ff-4e8f-a070-94eb5b4cb4ae service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Updated VIF entry in instance network info cache for port 25aa8515-5f80-4dac-a843-3d38eea9ce0b. {{(pid=72766) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 23:53:14 user nova-compute[72766]: DEBUG nova.network.neutron [req-fdd60132-970b-4d5b-a117-f824f97053a4 req-210b0a04-56ff-4e8f-a070-94eb5b4cb4ae service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Updating instance_info_cache with network_info: [{"id": "25aa8515-5f80-4dac-a843-3d38eea9ce0b", "address": "fa:16:3e:e0:3b:bf", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25aa8515-5f", "ovs_interfaceid": "25aa8515-5f80-4dac-a843-3d38eea9ce0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:53:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-fdd60132-970b-4d5b-a117-f824f97053a4 req-210b0a04-56ff-4e8f-a070-94eb5b4cb4ae service nova] Releasing lock "refresh_cache-486c626d-404d-463d-afa2-2310f1bb3797" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:53:15 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:53:16 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:53:16 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:53:16 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:53:17 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:53:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:53:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:53:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:53:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:53:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:53:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:53:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:53:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:53:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:53:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:53:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:53:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:53:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:53:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:53:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:53:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:53:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:53:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:53:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:53:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:53:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:53:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:53:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:53:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:53:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:53:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:53:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:53:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:53:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:54:01 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:54:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d52d2de5-e1e8-42e3-b6d3-60e284a8eb24 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquiring lock "486c626d-404d-463d-afa2-2310f1bb3797" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:54:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d52d2de5-e1e8-42e3-b6d3-60e284a8eb24 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "486c626d-404d-463d-afa2-2310f1bb3797" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:54:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d52d2de5-e1e8-42e3-b6d3-60e284a8eb24 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquiring lock "486c626d-404d-463d-afa2-2310f1bb3797-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:54:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d52d2de5-e1e8-42e3-b6d3-60e284a8eb24 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "486c626d-404d-463d-afa2-2310f1bb3797-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:54:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d52d2de5-e1e8-42e3-b6d3-60e284a8eb24 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "486c626d-404d-463d-afa2-2310f1bb3797-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:54:02 user nova-compute[72766]: INFO nova.compute.manager [None req-d52d2de5-e1e8-42e3-b6d3-60e284a8eb24 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Terminating instance
Aug 14 23:54:02 user nova-compute[72766]: DEBUG nova.compute.manager [None req-d52d2de5-e1e8-42e3-b6d3-60e284a8eb24 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:54:02 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:54:02 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:54:02 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:54:02 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:54:02 user nova-compute[72766]: DEBUG nova.compute.manager [req-a4ad7ccb-a00d-4396-a86b-ff5ede4ce271 req-4a8398e3-1782-4b5c-ade1-607741ac0726 service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Received event network-vif-unplugged-25aa8515-5f80-4dac-a843-3d38eea9ce0b {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:54:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a4ad7ccb-a00d-4396-a86b-ff5ede4ce271 req-4a8398e3-1782-4b5c-ade1-607741ac0726 service nova] Acquiring lock "486c626d-404d-463d-afa2-2310f1bb3797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:54:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a4ad7ccb-a00d-4396-a86b-ff5ede4ce271 req-4a8398e3-1782-4b5c-ade1-607741ac0726 service nova] Lock "486c626d-404d-463d-afa2-2310f1bb3797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:54:02 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-a4ad7ccb-a00d-4396-a86b-ff5ede4ce271 req-4a8398e3-1782-4b5c-ade1-607741ac0726 service nova] Lock "486c626d-404d-463d-afa2-2310f1bb3797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:54:02 user nova-compute[72766]: DEBUG nova.compute.manager [req-a4ad7ccb-a00d-4396-a86b-ff5ede4ce271 req-4a8398e3-1782-4b5c-ade1-607741ac0726 service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] No waiting events found dispatching network-vif-unplugged-25aa8515-5f80-4dac-a843-3d38eea9ce0b {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:54:02 user nova-compute[72766]: DEBUG nova.compute.manager [req-a4ad7ccb-a00d-4396-a86b-ff5ede4ce271 req-4a8398e3-1782-4b5c-ade1-607741ac0726 service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Received event network-vif-unplugged-25aa8515-5f80-4dac-a843-3d38eea9ce0b for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:54:02 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:54:03 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Instance destroyed successfully.
Aug 14 23:54:03 user nova-compute[72766]: DEBUG nova.objects.instance [None req-d52d2de5-e1e8-42e3-b6d3-60e284a8eb24 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lazy-loading 'resources' on Instance uuid 486c626d-404d-463d-afa2-2310f1bb3797 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:54:03 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-d52d2de5-e1e8-42e3-b6d3-60e284a8eb24 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:47:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-34373646',display_name='tempest-ServerRescueNegativeTestJSON-server-34373646',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-34373646',id=52,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOq8eR1EAGbJYgvw63CEOWBxTiSB3neI/CoA3G3TNCfoiBNFE3xidnhdFiVuQ5LEsbDo4ydyigXAzeB+0yT0qNLQXwNNNo6AayJCUJspvkI2X9vZT/42kRcVQ/X8ZYvv0A==',key_name='tempest-keypair-591484672',keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:49:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eaadde665b704e4d882299b7f747d7a5',ramdisk_id='',reservation_id='r-rjnagpzg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1344834449',owner_user_name='tempest-ServerRescueNegativeTestJSON-1344834449-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:51:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a1c0e7bd2744a349ecfef160a6f54f5',uuid=486c626d-404d-463d-afa2-2310f1bb3797,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25aa8515-5f80-4dac-a843-3d38eea9ce0b", "address": "fa:16:3e:e0:3b:bf", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25aa8515-5f", "ovs_interfaceid": "25aa8515-5f80-4dac-a843-3d38eea9ce0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:54:03 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-d52d2de5-e1e8-42e3-b6d3-60e284a8eb24 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Converting VIF {"id": "25aa8515-5f80-4dac-a843-3d38eea9ce0b", "address": "fa:16:3e:e0:3b:bf", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25aa8515-5f", "ovs_interfaceid": "25aa8515-5f80-4dac-a843-3d38eea9ce0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:54:03 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-d52d2de5-e1e8-42e3-b6d3-60e284a8eb24 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:3b:bf,bridge_name='br-int',has_traffic_filtering=True,id=25aa8515-5f80-4dac-a843-3d38eea9ce0b,network=Network(71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25aa8515-5f') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:54:03 user nova-compute[72766]: DEBUG os_vif [None req-d52d2de5-e1e8-42e3-b6d3-60e284a8eb24 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:3b:bf,bridge_name='br-int',has_traffic_filtering=True,id=25aa8515-5f80-4dac-a843-3d38eea9ce0b,network=Network(71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25aa8515-5f') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:54:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:54:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25aa8515-5f, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:54:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:54:03 user nova-compute[72766]: INFO os_vif [None req-d52d2de5-e1e8-42e3-b6d3-60e284a8eb24 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:3b:bf,bridge_name='br-int',has_traffic_filtering=True,id=25aa8515-5f80-4dac-a843-3d38eea9ce0b,network=Network(71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25aa8515-5f')
Aug 14 23:54:03 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-d52d2de5-e1e8-42e3-b6d3-60e284a8eb24 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Deleting instance files /opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797_del
Aug 14 23:54:03 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-d52d2de5-e1e8-42e3-b6d3-60e284a8eb24 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Deletion of /opt/stack/data/nova/instances/486c626d-404d-463d-afa2-2310f1bb3797_del complete
Aug 14 23:54:03 user nova-compute[72766]: INFO nova.compute.manager [None req-d52d2de5-e1e8-42e3-b6d3-60e284a8eb24 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 14 23:54:03 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-d52d2de5-e1e8-42e3-b6d3-60e284a8eb24 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:54:03 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:54:03 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:54:04 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:54:04 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Took 0.91 seconds to deallocate network for instance.
Aug 14 23:54:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d52d2de5-e1e8-42e3-b6d3-60e284a8eb24 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:54:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d52d2de5-e1e8-42e3-b6d3-60e284a8eb24 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:54:04 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-d52d2de5-e1e8-42e3-b6d3-60e284a8eb24 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:54:04 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-d52d2de5-e1e8-42e3-b6d3-60e284a8eb24 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:54:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d52d2de5-e1e8-42e3-b6d3-60e284a8eb24 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.149s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:54:04 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-d52d2de5-e1e8-42e3-b6d3-60e284a8eb24 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Deleted allocations for instance 486c626d-404d-463d-afa2-2310f1bb3797
Aug 14 23:54:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-d52d2de5-e1e8-42e3-b6d3-60e284a8eb24 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "486c626d-404d-463d-afa2-2310f1bb3797" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.167s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:54:04 user nova-compute[72766]: DEBUG nova.compute.manager [req-9ef97ef8-b492-4879-b6c3-841fda7f29b8 req-2ba35847-d1b7-420d-8ec0-4f9b2544159c service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Received event network-vif-plugged-25aa8515-5f80-4dac-a843-3d38eea9ce0b {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:54:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9ef97ef8-b492-4879-b6c3-841fda7f29b8 req-2ba35847-d1b7-420d-8ec0-4f9b2544159c service nova] Acquiring lock "486c626d-404d-463d-afa2-2310f1bb3797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:54:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9ef97ef8-b492-4879-b6c3-841fda7f29b8 req-2ba35847-d1b7-420d-8ec0-4f9b2544159c service nova] Lock "486c626d-404d-463d-afa2-2310f1bb3797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:54:04 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-9ef97ef8-b492-4879-b6c3-841fda7f29b8 req-2ba35847-d1b7-420d-8ec0-4f9b2544159c service nova] Lock "486c626d-404d-463d-afa2-2310f1bb3797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:54:04 user nova-compute[72766]: DEBUG nova.compute.manager [req-9ef97ef8-b492-4879-b6c3-841fda7f29b8 req-2ba35847-d1b7-420d-8ec0-4f9b2544159c service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] No waiting events found dispatching network-vif-plugged-25aa8515-5f80-4dac-a843-3d38eea9ce0b {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:54:04 user nova-compute[72766]: WARNING nova.compute.manager [req-9ef97ef8-b492-4879-b6c3-841fda7f29b8 req-2ba35847-d1b7-420d-8ec0-4f9b2544159c service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Received unexpected event network-vif-plugged-25aa8515-5f80-4dac-a843-3d38eea9ce0b for instance with vm_state deleted and task_state None.
Aug 14 23:54:04 user nova-compute[72766]: DEBUG nova.compute.manager [req-9ef97ef8-b492-4879-b6c3-841fda7f29b8 req-2ba35847-d1b7-420d-8ec0-4f9b2544159c service nova] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Received event network-vif-deleted-25aa8515-5f80-4dac-a843-3d38eea9ce0b {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:54:08 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:54:08 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:54:08 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:54:08 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Didn't find any instances for network info cache update. {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 23:54:08 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:54:10 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:54:10 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:54:10 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:54:10 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:54:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:54:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:54:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:54:10 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:54:10 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:54:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:54:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:54:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:54:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:54:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:54:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:54:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:54:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:54:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:54:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:54:11 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:54:12 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:54:12 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:54:12 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=8700MB free_disk=25.216861724853516GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:54:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:54:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:54:12 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 2262995c-232a-4bfd-b8f4-c83b24c12f62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:54:12 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance b9ede44b-eef5-473f-a279-8166a442a45d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:54:12 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:54:12 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:54:12 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:54:12 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:54:12 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:54:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.219s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:54:13 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:54:18 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692057243.127615, 486c626d-404d-463d-afa2-2310f1bb3797 => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:54:18 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] VM Stopped (Lifecycle Event)
Aug 14 23:54:18 user nova-compute[72766]: DEBUG nova.compute.manager [None req-736e6145-096f-4329-910c-c899c0667b2e None None] [instance: 486c626d-404d-463d-afa2-2310f1bb3797] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:54:18 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:54:18 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:54:18 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:54:18 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:54:18 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:54:23 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:54:28 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:54:33 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:54:38 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:54:43 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:54:48 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:54:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:54:53 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:54:58 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:55:01 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:55:03 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:55:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b4fce120-f36c-41a0-9d77-2db8c22d271d tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquiring lock "b9ede44b-eef5-473f-a279-8166a442a45d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:55:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b4fce120-f36c-41a0-9d77-2db8c22d271d tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "b9ede44b-eef5-473f-a279-8166a442a45d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:55:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b4fce120-f36c-41a0-9d77-2db8c22d271d tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquiring lock "b9ede44b-eef5-473f-a279-8166a442a45d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:55:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b4fce120-f36c-41a0-9d77-2db8c22d271d tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "b9ede44b-eef5-473f-a279-8166a442a45d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:55:05 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b4fce120-f36c-41a0-9d77-2db8c22d271d tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "b9ede44b-eef5-473f-a279-8166a442a45d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:55:05 user nova-compute[72766]: INFO nova.compute.manager [None req-b4fce120-f36c-41a0-9d77-2db8c22d271d tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Terminating instance
Aug 14 23:55:05 user nova-compute[72766]: DEBUG nova.compute.manager [None req-b4fce120-f36c-41a0-9d77-2db8c22d271d tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:55:05 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:55:05 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:55:05 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:55:05 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:55:06 user nova-compute[72766]: DEBUG nova.compute.manager [req-55b27d00-831a-405c-a2bd-85eac5ff8fac req-acae057d-cc58-40c8-8265-04d389ea24bf service nova] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Received event network-vif-unplugged-02fed6c3-ea8a-4fd6-a404-29ea7c038c6a {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:55:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-55b27d00-831a-405c-a2bd-85eac5ff8fac req-acae057d-cc58-40c8-8265-04d389ea24bf service nova] Acquiring lock "b9ede44b-eef5-473f-a279-8166a442a45d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:55:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-55b27d00-831a-405c-a2bd-85eac5ff8fac req-acae057d-cc58-40c8-8265-04d389ea24bf service nova] Lock "b9ede44b-eef5-473f-a279-8166a442a45d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:55:06 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-55b27d00-831a-405c-a2bd-85eac5ff8fac req-acae057d-cc58-40c8-8265-04d389ea24bf service nova] Lock "b9ede44b-eef5-473f-a279-8166a442a45d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:55:06 user nova-compute[72766]: DEBUG nova.compute.manager [req-55b27d00-831a-405c-a2bd-85eac5ff8fac req-acae057d-cc58-40c8-8265-04d389ea24bf service nova] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] No waiting events found dispatching network-vif-unplugged-02fed6c3-ea8a-4fd6-a404-29ea7c038c6a {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:55:06 user nova-compute[72766]: DEBUG nova.compute.manager [req-55b27d00-831a-405c-a2bd-85eac5ff8fac req-acae057d-cc58-40c8-8265-04d389ea24bf service nova] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Received event network-vif-unplugged-02fed6c3-ea8a-4fd6-a404-29ea7c038c6a for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:55:06 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Instance destroyed successfully.
Aug 14 23:55:06 user nova-compute[72766]: DEBUG nova.objects.instance [None req-b4fce120-f36c-41a0-9d77-2db8c22d271d tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lazy-loading 'resources' on Instance uuid b9ede44b-eef5-473f-a279-8166a442a45d {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:55:06 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-b4fce120-f36c-41a0-9d77-2db8c22d271d tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:38:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-103213439',display_name='tempest-ServerRescueNegativeTestJSON-server-103213439',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-103213439',id=50,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:40:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eaadde665b704e4d882299b7f747d7a5',ramdisk_id='',reservation_id='r-2kiiyowb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1344834449',owner_user_name='tempest-ServerRescueNegativeTestJSON-1344834449-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:40:48Z,user_data=None,user_id='4a1c0e7bd2744a349ecfef160a6f54f5',uuid=b9ede44b-eef5-473f-a279-8166a442a45d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "02fed6c3-ea8a-4fd6-a404-29ea7c038c6a", "address": "fa:16:3e:52:c1:fe", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02fed6c3-ea", "ovs_interfaceid": "02fed6c3-ea8a-4fd6-a404-29ea7c038c6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:55:06 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-b4fce120-f36c-41a0-9d77-2db8c22d271d tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Converting VIF {"id": "02fed6c3-ea8a-4fd6-a404-29ea7c038c6a", "address": "fa:16:3e:52:c1:fe", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02fed6c3-ea", "ovs_interfaceid": "02fed6c3-ea8a-4fd6-a404-29ea7c038c6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:55:06 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-b4fce120-f36c-41a0-9d77-2db8c22d271d tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:c1:fe,bridge_name='br-int',has_traffic_filtering=True,id=02fed6c3-ea8a-4fd6-a404-29ea7c038c6a,network=Network(71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02fed6c3-ea') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:55:06 user nova-compute[72766]: DEBUG os_vif [None req-b4fce120-f36c-41a0-9d77-2db8c22d271d tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:c1:fe,bridge_name='br-int',has_traffic_filtering=True,id=02fed6c3-ea8a-4fd6-a404-29ea7c038c6a,network=Network(71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02fed6c3-ea') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:55:06 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:55:06 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap02fed6c3-ea, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:55:06 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:55:06 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:55:06 user nova-compute[72766]: INFO os_vif [None req-b4fce120-f36c-41a0-9d77-2db8c22d271d tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:c1:fe,bridge_name='br-int',has_traffic_filtering=True,id=02fed6c3-ea8a-4fd6-a404-29ea7c038c6a,network=Network(71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02fed6c3-ea')
Aug 14 23:55:06 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-b4fce120-f36c-41a0-9d77-2db8c22d271d tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Deleting instance files /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d_del
Aug 14 23:55:06 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-b4fce120-f36c-41a0-9d77-2db8c22d271d tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Deletion of /opt/stack/data/nova/instances/b9ede44b-eef5-473f-a279-8166a442a45d_del complete
Aug 14 23:55:06 user nova-compute[72766]: INFO nova.compute.manager [None req-b4fce120-f36c-41a0-9d77-2db8c22d271d tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Took 0.83 seconds to destroy the instance on the hypervisor.
Aug 14 23:55:06 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-b4fce120-f36c-41a0-9d77-2db8c22d271d tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:55:06 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:55:06 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:55:06 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:55:06 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Took 0.60 seconds to deallocate network for instance.
Aug 14 23:55:06 user nova-compute[72766]: DEBUG nova.compute.manager [req-3c0eee49-6a4d-4d6a-b737-5ff052468fd9 req-a6596236-c150-4a9b-9240-7cee69b67c84 service nova] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Received event network-vif-deleted-02fed6c3-ea8a-4fd6-a404-29ea7c038c6a {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:55:06 user nova-compute[72766]: INFO nova.compute.manager [req-3c0eee49-6a4d-4d6a-b737-5ff052468fd9 req-a6596236-c150-4a9b-9240-7cee69b67c84 service nova] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Neutron deleted interface 02fed6c3-ea8a-4fd6-a404-29ea7c038c6a; detaching it from the instance and deleting it from the info cache
Aug 14 23:55:06 user nova-compute[72766]: DEBUG nova.network.neutron [req-3c0eee49-6a4d-4d6a-b737-5ff052468fd9 req-a6596236-c150-4a9b-9240-7cee69b67c84 service nova] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:55:07 user nova-compute[72766]: DEBUG nova.compute.manager [req-3c0eee49-6a4d-4d6a-b737-5ff052468fd9 req-a6596236-c150-4a9b-9240-7cee69b67c84 service nova] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Detach interface failed, port_id=02fed6c3-ea8a-4fd6-a404-29ea7c038c6a, reason: Instance b9ede44b-eef5-473f-a279-8166a442a45d could not be found. {{(pid=72766) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 23:55:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b4fce120-f36c-41a0-9d77-2db8c22d271d tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:55:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b4fce120-f36c-41a0-9d77-2db8c22d271d tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:55:07 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-b4fce120-f36c-41a0-9d77-2db8c22d271d tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:55:07 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-b4fce120-f36c-41a0-9d77-2db8c22d271d tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:55:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b4fce120-f36c-41a0-9d77-2db8c22d271d tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.133s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:55:07 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-b4fce120-f36c-41a0-9d77-2db8c22d271d tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Deleted allocations for instance b9ede44b-eef5-473f-a279-8166a442a45d
Aug 14 23:55:07 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-b4fce120-f36c-41a0-9d77-2db8c22d271d tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "b9ede44b-eef5-473f-a279-8166a442a45d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.780s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:55:08 user nova-compute[72766]: DEBUG nova.compute.manager [req-3549bc24-a13b-4826-a006-7bd4d91e7703 req-ea3efb1c-8582-4e03-abb8-62fc3d616928 service nova] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Received event network-vif-plugged-02fed6c3-ea8a-4fd6-a404-29ea7c038c6a {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:55:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-3549bc24-a13b-4826-a006-7bd4d91e7703 req-ea3efb1c-8582-4e03-abb8-62fc3d616928 service nova] Acquiring lock "b9ede44b-eef5-473f-a279-8166a442a45d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:55:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-3549bc24-a13b-4826-a006-7bd4d91e7703 req-ea3efb1c-8582-4e03-abb8-62fc3d616928 service nova] Lock "b9ede44b-eef5-473f-a279-8166a442a45d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:55:08 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-3549bc24-a13b-4826-a006-7bd4d91e7703 req-ea3efb1c-8582-4e03-abb8-62fc3d616928 service nova] Lock "b9ede44b-eef5-473f-a279-8166a442a45d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:55:08 user nova-compute[72766]: DEBUG nova.compute.manager [req-3549bc24-a13b-4826-a006-7bd4d91e7703 req-ea3efb1c-8582-4e03-abb8-62fc3d616928 service nova] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] No waiting events found dispatching network-vif-plugged-02fed6c3-ea8a-4fd6-a404-29ea7c038c6a {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:55:08 user nova-compute[72766]: WARNING nova.compute.manager [req-3549bc24-a13b-4826-a006-7bd4d91e7703 req-ea3efb1c-8582-4e03-abb8-62fc3d616928 service nova] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Received unexpected event network-vif-plugged-02fed6c3-ea8a-4fd6-a404-29ea7c038c6a for instance with vm_state deleted and task_state None.
Aug 14 23:55:09 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:55:10 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:55:10 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:55:10 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Rebuilding the list of instances to heal {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 23:55:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "refresh_cache-2262995c-232a-4bfd-b8f4-c83b24c12f62" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 23:55:10 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquired lock "refresh_cache-2262995c-232a-4bfd-b8f4-c83b24c12f62" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 23:55:10 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Forcefully refreshing network info cache for instance {{(pid=72766) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 23:55:10 user nova-compute[72766]: DEBUG nova.objects.instance [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lazy-loading 'info_cache' on Instance uuid 2262995c-232a-4bfd-b8f4-c83b24c12f62 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:55:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:55:11 user nova-compute[72766]: DEBUG nova.network.neutron [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Updating instance_info_cache with network_info: [{"id": "69550d14-e1fb-4c2e-9526-19cae208fd08", "address": "fa:16:3e:bd:82:2f", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69550d14-e1", "ovs_interfaceid": "69550d14-e1fb-4c2e-9526-19cae208fd08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:55:11 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Releasing lock "refresh_cache-2262995c-232a-4bfd-b8f4-c83b24c12f62" {{(pid=72766) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 23:55:11 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Updated the network info_cache for instance {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 23:55:11 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:55:12 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:55:12 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:55:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:55:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:55:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:55:12 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:55:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:55:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:55:12 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 23:55:13 user nova-compute[72766]: DEBUG oslo_concurrency.processutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72766) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 23:55:13 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:55:13 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:55:13 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=8770MB free_disk=25.244239807128906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:55:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:55:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:55:13 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Instance 2262995c-232a-4bfd-b8f4-c83b24c12f62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72766) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 23:55:13 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:55:13 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:55:13 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:55:13 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:55:14 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:55:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.357s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:55:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:55:20 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:55:20 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:55:20 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:55:20 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:55:21 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692057306.231002, b9ede44b-eef5-473f-a279-8166a442a45d => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:55:21 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] VM Stopped (Lifecycle Event)
Aug 14 23:55:21 user nova-compute[72766]: DEBUG nova.compute.manager [None req-34b9baa6-494b-4f8a-9ca4-7640e65d95f2 None None] [instance: b9ede44b-eef5-473f-a279-8166a442a45d] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:55:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:55:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:55:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:55:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:55:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:55:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:55:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:55:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:55:36 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:55:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:55:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:55:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:55:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-3de2899e-7dfe-4e92-a00c-9becc3928336 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquiring lock "2262995c-232a-4bfd-b8f4-c83b24c12f62" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:55:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-3de2899e-7dfe-4e92-a00c-9becc3928336 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:55:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-3de2899e-7dfe-4e92-a00c-9becc3928336 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquiring lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:55:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-3de2899e-7dfe-4e92-a00c-9becc3928336 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:55:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-3de2899e-7dfe-4e92-a00c-9becc3928336 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:55:56 user nova-compute[72766]: INFO nova.compute.manager [None req-3de2899e-7dfe-4e92-a00c-9becc3928336 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Terminating instance
Aug 14 23:55:56 user nova-compute[72766]: DEBUG nova.compute.manager [None req-3de2899e-7dfe-4e92-a00c-9becc3928336 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Start destroying the instance on the hypervisor. {{(pid=72766) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 23:55:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:55:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:55:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:55:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:55:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:55:56 user nova-compute[72766]: DEBUG nova.compute.manager [req-3dee60b9-1875-4266-bb8b-61df11475f9a req-b0824740-8e08-4d0f-bde9-20c622a6dd5b service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Received event network-vif-unplugged-69550d14-e1fb-4c2e-9526-19cae208fd08 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:55:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-3dee60b9-1875-4266-bb8b-61df11475f9a req-b0824740-8e08-4d0f-bde9-20c622a6dd5b service nova] Acquiring lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:55:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-3dee60b9-1875-4266-bb8b-61df11475f9a req-b0824740-8e08-4d0f-bde9-20c622a6dd5b service nova] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:55:56 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-3dee60b9-1875-4266-bb8b-61df11475f9a req-b0824740-8e08-4d0f-bde9-20c622a6dd5b service nova] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:55:56 user nova-compute[72766]: DEBUG nova.compute.manager [req-3dee60b9-1875-4266-bb8b-61df11475f9a req-b0824740-8e08-4d0f-bde9-20c622a6dd5b service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] No waiting events found dispatching network-vif-unplugged-69550d14-e1fb-4c2e-9526-19cae208fd08 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:55:56 user nova-compute[72766]: DEBUG nova.compute.manager [req-3dee60b9-1875-4266-bb8b-61df11475f9a req-b0824740-8e08-4d0f-bde9-20c622a6dd5b service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Received event network-vif-unplugged-69550d14-e1fb-4c2e-9526-19cae208fd08 for instance with task_state deleting. {{(pid=72766) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 23:55:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:55:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:55:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:55:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:55:56 user nova-compute[72766]: INFO nova.virt.libvirt.driver [-] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Instance destroyed successfully.
Aug 14 23:55:56 user nova-compute[72766]: DEBUG nova.objects.instance [None req-3de2899e-7dfe-4e92-a00c-9becc3928336 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lazy-loading 'resources' on Instance uuid 2262995c-232a-4bfd-b8f4-c83b24c12f62 {{(pid=72766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 23:55:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:55:56 user nova-compute[72766]: DEBUG nova.virt.libvirt.vif [None req-3de2899e-7dfe-4e92-a00c-9becc3928336 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T23:38:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-987629422',display_name='tempest-ServerRescueNegativeTestJSON-server-987629422',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-987629422',id=49,image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T23:43:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eaadde665b704e4d882299b7f747d7a5',ramdisk_id='',reservation_id='r-e060wqz6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d2900d30-2c4c-4d57-9135-d45564c0c596',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1344834449',owner_user_name='tempest-ServerRescueNegativeTestJSON-1344834449-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T23:45:33Z,user_data=None,user_id='4a1c0e7bd2744a349ecfef160a6f54f5',uuid=2262995c-232a-4bfd-b8f4-c83b24c12f62,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69550d14-e1fb-4c2e-9526-19cae208fd08", "address": "fa:16:3e:bd:82:2f", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69550d14-e1", "ovs_interfaceid": "69550d14-e1fb-4c2e-9526-19cae208fd08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 23:55:56 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-3de2899e-7dfe-4e92-a00c-9becc3928336 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Converting VIF {"id": "69550d14-e1fb-4c2e-9526-19cae208fd08", "address": "fa:16:3e:bd:82:2f", "network": {"id": "71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-363882550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eaadde665b704e4d882299b7f747d7a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69550d14-e1", "ovs_interfaceid": "69550d14-e1fb-4c2e-9526-19cae208fd08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 23:55:56 user nova-compute[72766]: DEBUG nova.network.os_vif_util [None req-3de2899e-7dfe-4e92-a00c-9becc3928336 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:82:2f,bridge_name='br-int',has_traffic_filtering=True,id=69550d14-e1fb-4c2e-9526-19cae208fd08,network=Network(71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69550d14-e1') {{(pid=72766) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 23:55:56 user nova-compute[72766]: DEBUG os_vif [None req-3de2899e-7dfe-4e92-a00c-9becc3928336 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:82:2f,bridge_name='br-int',has_traffic_filtering=True,id=69550d14-e1fb-4c2e-9526-19cae208fd08,network=Network(71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69550d14-e1') {{(pid=72766) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 23:55:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:55:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69550d14-e1, bridge=br-int, if_exists=True) {{(pid=72766) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 23:55:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:55:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:55:56 user nova-compute[72766]: INFO os_vif [None req-3de2899e-7dfe-4e92-a00c-9becc3928336 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:82:2f,bridge_name='br-int',has_traffic_filtering=True,id=69550d14-e1fb-4c2e-9526-19cae208fd08,network=Network(71d554a0-a26b-4f4b-9f36-9c5a1a34e5d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69550d14-e1')
Aug 14 23:55:56 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-3de2899e-7dfe-4e92-a00c-9becc3928336 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Deleting instance files /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62_del
Aug 14 23:55:56 user nova-compute[72766]: INFO nova.virt.libvirt.driver [None req-3de2899e-7dfe-4e92-a00c-9becc3928336 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Deletion of /opt/stack/data/nova/instances/2262995c-232a-4bfd-b8f4-c83b24c12f62_del complete
Aug 14 23:55:57 user nova-compute[72766]: INFO nova.compute.manager [None req-3de2899e-7dfe-4e92-a00c-9becc3928336 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 14 23:55:57 user nova-compute[72766]: DEBUG oslo.service.loopingcall [None req-3de2899e-7dfe-4e92-a00c-9becc3928336 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72766) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 23:55:57 user nova-compute[72766]: DEBUG nova.compute.manager [-] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Deallocating network for instance {{(pid=72766) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 23:55:57 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] deallocate_for_instance() {{(pid=72766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 23:55:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:55:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:55:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:55:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:55:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:55:57 user nova-compute[72766]: DEBUG nova.network.neutron [-] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Updating instance_info_cache with network_info: [] {{(pid=72766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 23:55:57 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Took 0.81 seconds to deallocate network for instance.
Aug 14 23:55:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-3de2899e-7dfe-4e92-a00c-9becc3928336 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:55:57 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-3de2899e-7dfe-4e92-a00c-9becc3928336 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:55:57 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-3de2899e-7dfe-4e92-a00c-9becc3928336 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:55:58 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-3de2899e-7dfe-4e92-a00c-9becc3928336 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:55:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-3de2899e-7dfe-4e92-a00c-9becc3928336 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.110s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:55:58 user nova-compute[72766]: INFO nova.scheduler.client.report [None req-3de2899e-7dfe-4e92-a00c-9becc3928336 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Deleted allocations for instance 2262995c-232a-4bfd-b8f4-c83b24c12f62
Aug 14 23:55:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-3de2899e-7dfe-4e92-a00c-9becc3928336 tempest-ServerRescueNegativeTestJSON-1344834449 tempest-ServerRescueNegativeTestJSON-1344834449-project-member] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:55:58 user nova-compute[72766]: DEBUG nova.compute.manager [req-756643a0-162b-411c-b39f-6e71a30c646d req-fa085067-ab96-44a8-b196-01dfa3255392 service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Received event network-vif-plugged-69550d14-e1fb-4c2e-9526-19cae208fd08 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:55:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-756643a0-162b-411c-b39f-6e71a30c646d req-fa085067-ab96-44a8-b196-01dfa3255392 service nova] Acquiring lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:55:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-756643a0-162b-411c-b39f-6e71a30c646d req-fa085067-ab96-44a8-b196-01dfa3255392 service nova] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:55:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-756643a0-162b-411c-b39f-6e71a30c646d req-fa085067-ab96-44a8-b196-01dfa3255392 service nova] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:55:58 user nova-compute[72766]: DEBUG nova.compute.manager [req-756643a0-162b-411c-b39f-6e71a30c646d req-fa085067-ab96-44a8-b196-01dfa3255392 service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] No waiting events found dispatching network-vif-plugged-69550d14-e1fb-4c2e-9526-19cae208fd08 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:55:58 user nova-compute[72766]: WARNING nova.compute.manager [req-756643a0-162b-411c-b39f-6e71a30c646d req-fa085067-ab96-44a8-b196-01dfa3255392 service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Received unexpected event network-vif-plugged-69550d14-e1fb-4c2e-9526-19cae208fd08 for instance with vm_state deleted and task_state None.
Aug 14 23:55:58 user nova-compute[72766]: DEBUG nova.compute.manager [req-756643a0-162b-411c-b39f-6e71a30c646d req-fa085067-ab96-44a8-b196-01dfa3255392 service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Received event network-vif-plugged-69550d14-e1fb-4c2e-9526-19cae208fd08 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:55:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-756643a0-162b-411c-b39f-6e71a30c646d req-fa085067-ab96-44a8-b196-01dfa3255392 service nova] Acquiring lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:55:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-756643a0-162b-411c-b39f-6e71a30c646d req-fa085067-ab96-44a8-b196-01dfa3255392 service nova] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:55:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-756643a0-162b-411c-b39f-6e71a30c646d req-fa085067-ab96-44a8-b196-01dfa3255392 service nova] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:55:58 user nova-compute[72766]: DEBUG nova.compute.manager [req-756643a0-162b-411c-b39f-6e71a30c646d req-fa085067-ab96-44a8-b196-01dfa3255392 service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] No waiting events found dispatching network-vif-plugged-69550d14-e1fb-4c2e-9526-19cae208fd08 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:55:58 user nova-compute[72766]: WARNING nova.compute.manager [req-756643a0-162b-411c-b39f-6e71a30c646d req-fa085067-ab96-44a8-b196-01dfa3255392 service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Received unexpected event network-vif-plugged-69550d14-e1fb-4c2e-9526-19cae208fd08 for instance with vm_state deleted and task_state None.
Aug 14 23:55:58 user nova-compute[72766]: DEBUG nova.compute.manager [req-756643a0-162b-411c-b39f-6e71a30c646d req-fa085067-ab96-44a8-b196-01dfa3255392 service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Received event network-vif-plugged-69550d14-e1fb-4c2e-9526-19cae208fd08 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:55:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-756643a0-162b-411c-b39f-6e71a30c646d req-fa085067-ab96-44a8-b196-01dfa3255392 service nova] Acquiring lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:55:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-756643a0-162b-411c-b39f-6e71a30c646d req-fa085067-ab96-44a8-b196-01dfa3255392 service nova] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:55:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-756643a0-162b-411c-b39f-6e71a30c646d req-fa085067-ab96-44a8-b196-01dfa3255392 service nova] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:55:58 user nova-compute[72766]: DEBUG nova.compute.manager [req-756643a0-162b-411c-b39f-6e71a30c646d req-fa085067-ab96-44a8-b196-01dfa3255392 service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] No waiting events found dispatching network-vif-plugged-69550d14-e1fb-4c2e-9526-19cae208fd08 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:55:58 user nova-compute[72766]: WARNING nova.compute.manager [req-756643a0-162b-411c-b39f-6e71a30c646d req-fa085067-ab96-44a8-b196-01dfa3255392 service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Received unexpected event network-vif-plugged-69550d14-e1fb-4c2e-9526-19cae208fd08 for instance with vm_state deleted and task_state None.
Aug 14 23:55:58 user nova-compute[72766]: DEBUG nova.compute.manager [req-756643a0-162b-411c-b39f-6e71a30c646d req-fa085067-ab96-44a8-b196-01dfa3255392 service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Received event network-vif-plugged-69550d14-e1fb-4c2e-9526-19cae208fd08 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:55:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-756643a0-162b-411c-b39f-6e71a30c646d req-fa085067-ab96-44a8-b196-01dfa3255392 service nova] Acquiring lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:55:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-756643a0-162b-411c-b39f-6e71a30c646d req-fa085067-ab96-44a8-b196-01dfa3255392 service nova] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:55:58 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [req-756643a0-162b-411c-b39f-6e71a30c646d req-fa085067-ab96-44a8-b196-01dfa3255392 service nova] Lock "2262995c-232a-4bfd-b8f4-c83b24c12f62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:55:58 user nova-compute[72766]: DEBUG nova.compute.manager [req-756643a0-162b-411c-b39f-6e71a30c646d req-fa085067-ab96-44a8-b196-01dfa3255392 service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] No waiting events found dispatching network-vif-plugged-69550d14-e1fb-4c2e-9526-19cae208fd08 {{(pid=72766) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 23:55:58 user nova-compute[72766]: WARNING nova.compute.manager [req-756643a0-162b-411c-b39f-6e71a30c646d req-fa085067-ab96-44a8-b196-01dfa3255392 service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Received unexpected event network-vif-plugged-69550d14-e1fb-4c2e-9526-19cae208fd08 for instance with vm_state deleted and task_state None.
Aug 14 23:55:58 user nova-compute[72766]: DEBUG nova.compute.manager [req-756643a0-162b-411c-b39f-6e71a30c646d req-fa085067-ab96-44a8-b196-01dfa3255392 service nova] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Received event network-vif-deleted-69550d14-e1fb-4c2e-9526-19cae208fd08 {{(pid=72766) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 23:56:01 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:56:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:56:06 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:56:10 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:56:11 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:56:11 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:56:11 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Rebuilding the list of instances to heal {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 23:56:11 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Didn't find any instances for network info cache update. {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 23:56:11 user nova-compute[72766]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692057356.9255593, 2262995c-232a-4bfd-b8f4-c83b24c12f62 => Stopped> {{(pid=72766) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 23:56:11 user nova-compute[72766]: INFO nova.compute.manager [-] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] VM Stopped (Lifecycle Event)
Aug 14 23:56:11 user nova-compute[72766]: DEBUG nova.compute.manager [None req-4448b807-c179-4e4c-afe1-7062eccee17d None None] [instance: 2262995c-232a-4bfd-b8f4-c83b24c12f62] Checking state {{(pid=72766) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 23:56:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:56:12 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:56:12 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:56:12 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:56:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:56:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:56:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:56:12 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:56:13 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:56:13 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:56:13 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=8896MB free_disk=25.263858795166016GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:56:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:56:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:56:13 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:56:13 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:56:13 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:56:13 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:56:13 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:56:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.161s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:56:16 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:56:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:56:18 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:56:19 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:56:19 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:56:20 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:56:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:56:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:56:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:56:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:56:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:56:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:56:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:56:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:56:36 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:56:36 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:56:36 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72766) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 23:56:36 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:56:36 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72766) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 23:56:36 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:56:41 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:56:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:56:47 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:56:49 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:56:51 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:56:56 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:57:01 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:57:03 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:57:06 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:57:11 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:57:12 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:57:12 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:57:12 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Rebuilding the list of instances to heal {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 23:57:12 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Didn't find any instances for network info cache update. {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 23:57:12 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:57:12 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:57:12 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:57:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:57:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:57:12 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:57:12 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:57:13 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:57:13 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:57:13 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=8926MB free_disk=25.262325286865234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:57:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:57:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:57:13 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:57:13 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:57:13 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Refreshing inventories for resource provider 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 23:57:13 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Updating ProviderTree inventory for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 23:57:13 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Updating inventory in ProviderTree for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 23:57:13 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Refreshing aggregate associations for resource provider 45c8ff08-bf31-4ab6-8452-2e293102f899, aggregates: None {{(pid=72766) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 23:57:13 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Refreshing trait associations for resource provider 45c8ff08-bf31-4ab6-8452-2e293102f899, traits: COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=72766) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 23:57:13 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:57:13 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:57:13 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:57:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.253s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:57:15 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:57:16 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:57:19 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:57:19 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:57:19 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:57:21 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:57:21 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:57:26 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:57:31 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:57:37 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:57:40 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:57:42 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:57:46 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:57:46 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:57:46 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72766) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 23:57:47 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:57:51 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:57:51 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Cleaning up deleted instances {{(pid=72766) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 23:57:51 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] There are 0 instances to clean {{(pid=72766) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 23:57:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:57:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:58:02 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:58:04 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:58:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:58:12 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:58:13 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:58:13 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:58:13 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:58:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:58:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:58:13 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:58:13 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:58:14 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:58:14 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:58:14 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=8939MB free_disk=25.260704040527344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:58:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:58:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:58:14 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:58:14 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:58:14 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:58:14 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:58:14 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:58:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.113s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:58:15 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:58:15 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:58:15 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Rebuilding the list of instances to heal {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 23:58:15 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Didn't find any instances for network info cache update. {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 23:58:16 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:58:17 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:58:17 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:58:19 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:58:19 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:58:19 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:58:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:58:22 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:58:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:58:32 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:58:37 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:58:42 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:58:47 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:58:52 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:58:57 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:59:02 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:59:04 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:59:06 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:59:07 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:59:12 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:59:13 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:59:14 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:59:14 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Starting heal instance info cache {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 23:59:14 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Rebuilding the list of instances to heal {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 23:59:14 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Didn't find any instances for network info cache update. {{(pid=72766) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 23:59:14 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:59:14 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:59:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:59:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:59:14 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:59:14 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Auditing locally available compute resources for user (node: user) {{(pid=72766) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 23:59:15 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:59:15 user nova-compute[72766]: WARNING nova.virt.libvirt.driver [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 23:59:15 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Hypervisor/Node resource view: name=user free_ram=9056MB free_disk=25.25788116455078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72766) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 23:59:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 23:59:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 23:59:15 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 23:59:15 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72766) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 23:59:15 user nova-compute[72766]: DEBUG nova.compute.provider_tree [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed in ProviderTree for provider: 45c8ff08-bf31-4ab6-8452-2e293102f899 {{(pid=72766) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 23:59:15 user nova-compute[72766]: DEBUG nova.scheduler.client.report [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Inventory has not changed for provider 45c8ff08-bf31-4ab6-8452-2e293102f899 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72766) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 23:59:15 user nova-compute[72766]: DEBUG nova.compute.resource_tracker [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Compute_service record updated for user:user {{(pid=72766) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 23:59:15 user nova-compute[72766]: DEBUG oslo_concurrency.lockutils [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.118s {{(pid=72766) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 23:59:17 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 23:59:18 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:59:19 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:59:19 user nova-compute[72766]: DEBUG nova.compute.manager [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72766) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 23:59:20 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:59:22 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 23:59:23 user nova-compute[72766]: DEBUG oslo_service.periodic_task [None req-c2fec6a4-671d-46ea-a3a2-017ba4065b31 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72766) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 23:59:27 user nova-compute[72766]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72766) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}